Consultant Data Engineer Databricks | Azure | PySpark | Spark SQL - Bengaluru / Hyderabad / Gurugram

Looking for an experienced Data Engineer with strong expertise in Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), ADLS, ETL, and SQL. You will design scalable data pipelines, build modern Lakehouse solutions, and enable enterprise analytics in a collaborative, fast-paced environment.

Location :

Bengaluru / Hyderabad / Gurugram

Your Future Employer :

A leading global AI and analytics consulting organization delivering cutting-edge data engineering, analytics, and AI solutions for enterprise clients worldwide.

Responsibilities :

- Design and develop scalable data pipelines using PySpark and Spark SQL on Azure Databricks.

- Build and orchestrate ETL workflows using Azure Data Factory (ADF) and ADLS.

- Develop and maintain modern Lakehouse architecture while ensuring data quality and reliability.

- Monitor production data pipelines, troubleshoot issues, and perform root cause analysis.

- Collaborate with cross-functional teams to deliver scalable data solutions and analytics initiatives.

Requirements :

- 5+ years of experience in Data Engineering.

- Strong hands-on experience with Azure Databricks, Azure Data Factory (ADF), and ADLS.

- Proficiency in PySpark, Spark SQL, ETL, and advanced SQL.

- Experience building scalable data pipelines and enterprise data platforms.

- Excellent analytical, problem-solving, and stakeholder management skills.

What is in it for you :

- Opportunity to work on large-scale cloud data engineering projects.

- Exposure to modern Azure and Databricks technologies.

- Collaborative and innovation-driven work culture.

- Excellent learning and career growth opportunities.

- Competitive compensation and benefits.