Key Responsibilities :

- Design and implement scalable data engineering solutions using Azure Databricks.

- Develop and optimize ETL/ELT pipelines for large-scale data processing.

- Build and maintain data lake and lakehouse architectures using Azure services.

- Develop data transformation workflows using PySpark/Scala, Python, and SQL.

- Implement Delta Lake solutions for reliable and high-performance data processing.

- Collaborate with business and technical teams to deliver enterprise data solutions.

- Ensure data quality, security, governance, and performance optimization.

- Implement CI/CD pipelines and follow DevOps best practices for deployment and version control.

Required Skills :

- 12+ years of experience in Data Engineering and Data Architecture.

- Strong expertise in Azure Databricks.

- Hands-on experience with Apache Spark (PySpark/Scala).

- Strong programming skills in Python and SQL.

- Experience with Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS).

- Strong understanding of ETL/ELT, Delta Lake, and Data Modeling.

- Experience with Git, CI/CD, and DevOps practices.

- Excellent analytical, problem-solving, and stakeholder management skills.