We are seeking an experienced Lead Data Engineer to spearhead the design, development, and management of robust data solutions on Azure. This role requires strong hands-on experience in PySpark and SQL, coupled with leadership abilities to manage project timelines, mentor junior engineers, and coordinate with clients and cross-functional teams.

Key Responsibilities :

- Lead end-to-end data engineering projects from requirements to deployment.

- Architect and implement scalable data pipelines using Azure Data Factory, Databricks, Synapse, and Azure Blob Storage.

- Write efficient and maintainable code using PySpark and SQL for data transformation and analysis.

- Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver high-quality solutions.

- Monitor and optimize pipeline performance, ensuring data quality and security.

- Manage team workflows, mentor junior engineers, and review code contributions.

- Interact with clients/stakeholders to gather requirements, provide technical inputs, and communicate status updates.

- Maintain documentation, track milestones, and ensure delivery within agreed timelines.

Required Skills :

- 5+ years of experience in data engineering with at least 2+ years in a lead or senior role.

- Strong hands-on experience with PySpark for big data processing.

- Expertise in writing complex SQL queries, optimizing performance, and working with structured/semi-structured data.

Proven experience in Azure ecosystem :

- Azure Data Factory

- Azure Databricks

- Azure Blob Storage / Data Lake

- Azure Synapse Analytics (preferred)

- Solid understanding of data architecture, data modeling, and ETL best practices.

- Strong project management capabilities with exposure to agile delivery models.

- Excellent communication and stakeholder management skills.

Good to Have :

- Experience with DevOps tools (Azure DevOps, Git).

- Familiarity with CI/CD in data engineering projects.

- Exposure to Python scripting beyond PySpark.

- Experience with data governance, security, and compliance frameworks.

Why Join Us?

- Work on cutting-edge Azure data solutions with global clients.

- Opportunity to lead and shape project delivery and team growth.

- Collaborative and flexible work culture.

The job is for:

Women candidates preferred

Differently-abled candidates preferred

Ex-defence personnel preferred

For women joining back the workforce