Kavi Global - Data Engineer - Big Data & Analytics Technologies

Description :

Job Summary :

We are seeking an experienced Data Engineer to design and build scalable, cloud-based data solutions using modern big data and analytics technologies.

The ideal candidate will have strong hands-on experience with Microsoft Fabric and solid expertise in PySpark, SQL, Databricks, and Azure Synapse Analytics.

This role will support enterprise-level data platforms that enable advanced analytics and data-driven decision-making.

Key Responsibilities :

- Design, develop, and optimize end-to-end data pipelines using PySpark and SQL.

- Build, deploy, and manage scalable data solutions using Microsoft Fabric (Lakehouse, Data Factory, Warehouses, etc.

- Develop and maintain data processing workflows using Databricks and Azure Synapse Analytics.

- Ensure data quality, performance, reliability, and scalability across data platforms.

- Implement and manage ETL/ELT processes for structured and semi-structured data.

- Collaborate with cross-functional teams (analytics, data science, and business stakeholders) to support data-driven initiatives.

- Monitor and troubleshoot data pipelines and optimize performance.

- Follow best practices for data architecture, security, and governance.

Required Skills & Experience:

- 5+ years of experience in Data Engineering or a related role.

- Strong proficiency in PySpark and SQL.

- Hands-on experience with Databricks and Azure Synapse Analytics.

- Solid understanding of data architecture, ETL/ELT processes, and cloud data platforms.

- Experience building scalable and reliable data pipelines in a cloud environment.

Must Have:

- Strong working knowledge of Microsoft Fabric (mandatory).

- Practical experience designing solutions using Fabric components such as Lakehouse, Pipelines, and Warehouses.

Nice to Have:

- Experience with Azure Data Factory, ADLS Gen2, or Delta Lake.

- Knowledge of data governance, security, and performance tuning.

- Exposure to BI/analytics tools consuming Fabric or Synapse data