Databricks Administrator

Description :

Desired Competencies (Technical/Behavioral Competency).

Must-Have :

- Databricks Platform Administration including environment setup, user and group management, access control configuration and familiarity with networking and firwall rules.

- Cluster and Resource Management.

- Operational Support strong troubleshooting skills, backup and recovery, Rest APIs.

- Security and Compliance IAM, ACL, Unity Catalog.

- Integration with data warehouses, cloud storage, data pipeline orchestration.

- Automation using Terraform, CI/CD pipelines.

Good-to-Have :

- DataBricks Certification.

SN Responsibility of / Expectations from the Role :

- Implement, and maintain the Databricks platform, including workspace setup, user and group management, access control, and security configurations.

- Install, configure, and maintain Databricks clusters and workspaces.

- Monitor and manage cluster performance, resource utilization, and platform costs.

- Provide technical support to data engineering, data science, and application teams.

- Perform restores/recoveries, troubleshoot service issues, and resolve platform-related problems.

- Implement and manage access controls and security policies to protect sensitive data.

- Ensure compliance with relevant data governance and regulatory requirements.

- Manage and maintain connections between Databricks and other data sources like Snowflake.

- Optimize data pipelines and workflows.

- Develop and maintain automation scripts and tools for platform provisioning and routine tasks using Terraform.

Type Details of The Role (For Candidate Briefing) :

- Reporting To Which Role : Service Delivery Manager.

- Size of the Team, if any Reporting to this Role : N/A.

- On-site Opportunity : None.

- Unique Selling Proposition (USP) of The Role : Opportunity to work directly with customer, Enterprise Data platform administration opportunity.

Details of The Project :

- Customer is trying to setup an enterprise scale data platform that can power data engineering, machine learning and analytics.

- Administrator is expected to ensure platform stability and availability along with cost optimization, security and compliance.