Databricks Administrator - AWS

Job Overview :

We are looking for an experienced Databricks Administrator with strong expertise in Terraform and a good understanding of AWS services. The role involves administering Databricks environments, analyzing existing architecture, optimizing costs, configuring guardrails, and identifying opportunities for infrastructure and platform improvements.

Key Responsibilities :

- Administer Databricks environments, including platform settings and configurations through the Databricks UI.

- Use Terraform to manage and maintain infrastructure.

- Analyze existing architecture and recommend improvements.

- Perform cost analysis for Databricks and identify optimization opportunities.

- Work with AWS services, including EC2, S3, KMS, IAM, DynamoDB, and Redshift, including troubleshooting issues.

- Create and manage Databricks dashboards and applications.

- Configure guardrails for Databricks features.

- Use Python, SQL, and Bash scripting for basic administrative and operational tasks.

- Apply Linux commands to support administration and troubleshooting activities.

Required Skills and Qualifications :

- 8+ years of professional experience.

- Strong expertise in Terraform.

- Hands-on experience in Databricks Administration.

- Understanding of AWS services, particularly EC2, S3, KMS, IAM, DynamoDB, and Redshift.

- Basic knowledge of Python, SQL, and Bash scripting.

- Experience working with the Databricks UI and platform settings.

- Experience in Databricks cost analysis.

- Experience creating Databricks dashboards and applications.

- Understanding of Linux commands.

- Experience setting up guardrails for Databricks features.

Good to Have :

- Experience with AWS EMR.

- Familiarity with Databricks Asset Bundles (DABs)