- Administer, monitor, and optimize Azure Databricks environments and clusters.

- Implement and manage Unity Catalog for secure, centralized data governance across the Databricks workspace.

- Oversee and optimize Delta Lake storage layers to ensure efficient data management and performance.

- Develop, maintain, and troubleshoot CI/CD pipelines for Databricks deployments.

- Automate tasks using Python, Bash, and other scripting languages.

- Ensure adherence to enterprise-level security, compliance, and governance frameworks.

- Perform troubleshooting and performance tuning of Databricks clusters and related services.

- Collaborate with data engineers, data scientists, and platform teams to provide a reliable and efficient data platform.

- Prepare documentation, operational guidelines, and provide training to internal teams when necessary.

- Stay updated with the latest trends and updates in Azure and Databricks ecosystems.

Technical Skills Required :

- Cloud Platforms: Strong hands-on experience with Azure Databricks administration.

- Databricks Components: Deep knowledge of Unity Catalog, Delta Lake, and Databricks runtime configurations.

- Automation & Scripting: Proficiency in Python, Bash, and exposure to tools like Terraform (preferred).

- CI/CD Tools: Experience with Azure DevOps, GitHub Actions, or similar pipeline tools.

- Security & Governance: Familiarity with Azure RBAC, Key Vaults, data encryption, role-based access control, and compliance standards.

- Monitoring & Optimization: Experience with monitoring tools (Azure Monitor, Databricks logs, etc.) and tuning cluster performance.

- Version Control Systems: Git, Bitbucket, or equivalent platforms.

Preferred Qualifications :

- Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field.

- Databricks Certified Associate Developer or Administrator (preferred).

- Microsoft Azure certifications (e.g. , Azure Administrator, Azure Data Engineer Associate) are a plus.

- Strong analytical, problem-solving, and debugging skills.

- Excellent communication and interpersonal skill