Data Engineering Lead/Architect - Python/Apache Airflow

Job Title : Lead / Architect Data Engineer

Location : Pune / Bangalore / Hyderabad (Hybrid or Remote flexibility)

Experience : 8+ years (with at least 3+ years in a lead/architect capacity)

Employment Type : Full-time

About the Role :

- Define and implement scalable data architectures on Azure cloud.

- Design ELT/ETL pipelines leveraging Airflow and DBT for workflow orchestration and data transformations.

- Optimize Snowflake usage (warehouses, performance tuning, cost optimization).

Leadership & Strategy :

- Lead a team of data engineers, ensuring high-quality delivery and adherence to best practices.

- Partner with product, analytics, and business stakeholders to translate requirements into data engineering solutions.

- Establish coding, CI/CD, and DevOps standards for data pipelines.

- Hands-on Development & Optimization

- Develop robust, reusable, and efficient data pipelines in Python and SQL.

- Implement monitoring, logging, and alerting for pipeline health.

- Ensure security, compliance, and governance in data solutions.

Innovation & Scaling :

- Explore and introduce new tools/technologies to improve data workflows.

- Contribute to the roadmap for data infrastructure evolution.

Must-Have Skills :

- Strong expertise in SQL, DBT, Airflow, and Python.

- Proven experience in Snowflake (data modeling, performance tuning, best practices).

- Hands-on experience with Azure Data Services (ADLS, ADF, Synapse, Event Hub, etc.).

- Experience designing scalable and fault-tolerant data architectures.

- Strong understanding of data warehousing, ELT/ETL patterns, and distributed systems.

Good to Have :

- Exposure to real-time/streaming data frameworks (Kafka, Event Hub, etc.).

- Familiarity with data governance, cataloging, and security best practices.

- Experience in mentoring teams and conducting architecture reviews.

Soft Skills :

- Strong communication and stakeholder management skills.

- Ability to work independently and in a collaborative team environment.

- Proven track record of leading end-to-end data engineering initiatives.

Why Join Us?

- Work with a talented and collaborative team driving data innovation.

- Freedom to experiment with the latest tools in data engineering and cloud.

- Competitive compensation and growth-oriented career path.