Sunware Technologies - Azure Databricks Platform Administrator

Job Role : Azure Databricks Platform Administrator

Experience : 8-10 years

Locations : Chennai, Pune, Hyderabad

Role Overview :

The Azure Databricks Platform Administrator is responsible for designing, configuring, securing, and operating the Databricks platform on Azure. This role ensures scalability, governance, performance optimization, and seamless integration with Azure services across environments.

Key Responsibilities :

- Configure and manage Azure Databricks workspaces and governance

- Administer Unity Catalog, clusters, and access controls

- Manage secrets, storage credentials, and Delta Lake tables

- Manage storage access using SAS, OAuth, and service principals

- Monitor performance and optimize costs

- Handle ADLS Gen2, networking (VNet, private endpoints, firewall rules), Key Vault, and IAM/RBAC

- Set up CI/CD pipelines and automate deployments using DevOps and GitHub

- Manage Dev, QA, Prod environments

- Troubleshoot issues and ensure platform scalability

Must-Have Skills :

- Strong hands-on experience with Azure Databricks administration

- Deep understanding of Unity Catalog and data governance

- Experience with Azure core services (ADLS Gen2, VNet, Key Vault, IAM)

- Proficiency in cluster optimization and cost control

- Manage storage access using SAS, OAuth, and service principals

- Implement CI/CD pipelines using Azure DevOps or GitHub

- Knowledge of Delta Lake architecture

- Troubleshooting and performance tuning expertise

Good to Have :

- Automate deployments and platform operations

- Troubleshooting and perform root cause analysis

- Plan capacity and ensure platform scalability