Senior Data Engineer - Azure Data Factory/Databricks

Required Skills :

Mandatory Skills :

- Strong experience in :

1. Azure Data Factory (ADF)

2. Azure Databricks

3. Apache Spark

4. Lakeflow Declarative Pipelines

5. SQL

6. PySpark

- Hands-on experience with Azure cloud platform and data services.

- Strong understanding of ETL/ELT concepts and data warehousing principles.

- Experience working with large-scale distributed data processing systems.

- Proficiency in performance tuning and optimization techniques.

- Good understanding of data lake and lakehouse architectures.

- Experience with Git and CI/CD implementation.

Preferred Skills :

- Experience with Delta Lake and Unity Catalog.

- Knowledge of streaming frameworks and real-time processing.

- Exposure to Azure Synapse Analytics or Microsoft Fabric.

- Experience working in Agile/Scrum environments.

- Familiarity with data governance and security best practices.