Azure Data Engineer - Databricks/PySpark

Job Title: Azure Databricks Developer

Experience: 6-8 Years

Location: Hyderabad / Delhi (Hybrid/On-site)

Employment Type: Contract

Role Overview:

We are seeking a skilled Azure Databricks Developer with strong expertise in big data processing and cloud-based data engineering. The ideal candidate should have hands-on experience with Databricks, PySpark, and Azure data services, along with strong problem-solving capabilities to build scalable data pipelines.

Key Responsibilities:

- Design and develop scalable data pipelines using Azure Databricks

- Work with large datasets using PySpark for data transformation and processing

- Implement data storage and retrieval solutions using Azure Data Lake Storage (ADLS)

- Optimize and tune data processing jobs for performance and efficiency

- Collaborate with data architects and stakeholders to define data solutions

- Integrate data pipelines with Azure services and external systems

- Troubleshoot and resolve data-related issues in production environments

- Follow best practices for coding, testing, and deployment

Must-Have Skills:

Strong hands-on experience with:

- Azure Databricks (Python-based development)

- PySpark

- Azure Data Lake Storage (ADLS)

- Experience in building and optimizing big data pipelines

- Strong analytical and problem-solving skills

- Knowledge of data processing frameworks and distributed systems