Description :

About the Role

We are looking for an experienced Databricks Platform Admin Consultant with strong expertise in Azure Databricks administration, Lakehouse architecture, Unity Catalog governance, and enterprise data platform management.

The ideal candidate should possess deep technical expertise in managing and securing large-scale Databricks environments while enabling scalable, secure, and governed analytics ecosystems on Microsoft Azure.

This role requires hands-on experience with Unity Catalog RBAC, fine-grained access controls, data governance frameworks, Azure data services, and enterprise cloud data platforms.

Candidates with strong platform administration, security governance, performance optimization, and stakeholder management capabilities will be strongly preferred.

Key Responsibilities :

Databricks Platform Administration :

1. Manage and administer enterprise-scale Azure Databricks environments.

2. Configure and maintain :

- Workspaces

- Clusters

- Access policies

- Compute configurations

- Security settings

3. Monitor platform health, performance, usage, and cost optimization.

4. Implement platform governance and operational best practices.

Lakehouse Architecture & Governance :

1. Design and support scalable Lakehouse architectures using Azure Databricks.

2. Implement governance frameworks leveraging :

- Unity Catalog

- RBAC

- Fine-grained access controls

3. Manage access controls across :

- Catalogs

- Schemas

- Tables

- Data assets

4. Ensure secure and compliant data access management across enterprise environments.

Security & Access Management :

1. Implement and manage :

- Role-based access control (RBAC)

- Data security policies

- User provisioning

- Permission governance

2. Support audit readiness, compliance standards, and enterprise security requirements.

3. Collaborate with security and governance teams to establish data protection standards.

Azure Data Platform Management :

Work closely with :

- Azure Data Factory (ADF)

- Azure Synapse Analytics

- SQL-based data systems to support integrated data platform operations.

3. Support orchestration, connectivity, and data movement across Azure ecosystems.

4. Ensure platform scalability, reliability, and performance optimization.

Performance Optimization & Troubleshooting :

1. Troubleshoot platform, security, and performance-related issues.

2. Optimize :

- Cluster utilization

- Query performance

- Resource allocation

- Workload management

3. Support incident management, root cause analysis, and issue resolution.

Stakeholder Collaboration :

1. Collaborate with :

- Data Engineers

- Architects

- Governance Teams

- Security Teams

- Business Stakeholders to support enterprise data initiatives.

2. Provide technical guidance and platform best practices to engineering teams.

Required Skills & Qualifications :

1. 8 to 12 years of experience in :

- Data Platform Administration

- Cloud Data Engineering

- Azure Data Ecosystems

- Databricks Platform Management

2. Strong hands-on expertise in :

- Azure Databricks

- Unity Catalog

- SQL

- Azure Data Factory (ADF)

- Azure Synapse Analytics

3. Strong experience implementing :

- Lakehouse Architecture

- RBAC

- Fine-grained access controls

- Data governance frameworks

4. Strong understanding of :

- Cloud security

- Data governance

- Access management

- Enterprise data platforms

5. Excellent troubleshooting, analytical, and stakeholder management skills.

Technical Skills :

Cloud & Data Platforms :

- Azure Databricks

- Azure Synapse Analytics

- Azure Data Factory (ADF)

- Azure Storage / Data Lake

Governance & Security :

- Unity Catalog

- RBAC

- Fine-grained Access Controls

- Data Governance

- Access Management

Data & Querying :

- SQL

- Data Modeling

- Data Integration

- ETL / ELT Concepts

Platform Operations :

- Cluster Management

- Performance Optimization

- Monitoring & Troubleshooting

- Cost Optimization

Preferred Skills :

1. Experience working on enterprise-scale cloud data modernization programs.

2. Exposure to :

- CI/CD pipelines

- DevOps/DataOps practices

- Delta Lake

- Lakehouse optimization strategies

3. Azure or Databricks certifications preferred.

4. Experience supporting global enterprise environments preferred.