We are looking for an experienced Data Engineer with strong expertise in Azure Synapse Analytics, Azure Data Factory, and Databricks to lead and execute the migration of existing Synapse workloads into the Databricks Lakehouse platform. This role involves assessment, solution design, code migration, performance optimization, and ensuring end-to-end pipeline reliability.

Key Responsibilities :

- Assess & Plan : Review existing Synapse pipelines, notebooks, SQL scripts, and data flows; identify migration complexity; and create a detailed migration roadmap.

- Migrate & Refactor : Convert Synapse pipelines, ADF workflows, notebooks, and SQL logic into Databricks (PySpark/SQL) and Delta Lakebased architectures.

- Develop ETL/ELT Pipelines : Build optimized data pipelines using PySpark, SQL, and Databricks workflows or Delta Live Tables.

- Optimize Performance : Tune Spark jobs, cluster configurations, and storage layers for performance, scalability, and cost efficiency.

- Testing & Validation : Conduct unit tests, data quality checks, reconciliation, and functional validation post-migration.

- Documentation & KT : Prepare migration documents, mapping sheets, architecture diagrams, and provide knowledge transfer sessions to teams.

Required Skills & Experience :

- 5+ years in Data Engineering, with strong exposure to cloud data platforms.

- Hands-on experience with :

- Azure Synapse Analytics (SQL Pools, Pipelines, Notebooks)

- Azure Data Factory

- Azure Databricks (PySpark, SQL, Delta Lake)

- Azure Storage / ADLS Gen2

- Strong Python, PySpark, SQL, and ETL design experience.

- Experience in Git-based development, DevOps pipelines, and CI/CD.

- Familiarity with big data frameworks and performance optimization strategies.

Must Have :

- Experience with Unity Catalog, Delta Live Tables and Databricks Governance.

- Experience in Agile delivery environments.

- Must have hands on migration experience (synapse to databricks sql). The project should be prominently displayed on CV. Candidate should have apt examples and challenges to speak on this topic.

- Knowledge of aviation domain is added advantage.