Hiring: Lead Engineer - Data Engineering

Experience: 5 - 7 Years

Location: Chennai

Primary Skills: SQL, Python, Data Engineering

Role Overview:

Looking for an experienced Data Engineer with strong hands-on expertise in SQL and Python to build and optimize data pipelines, perform data profiling, and support scalable data solutions.

Key Responsibilities:

- Perform data profiling to identify primary keys, data quality issues, cardinality, data types, precision, scale, and data skew.

- Develop and maintain ETL/ELT pipelines for data ingestion and transformation.

- Design and update dimensional data structures and use-case-specific datasets.

- Perform unit, functional, and performance testing.

- Optimize data pipelines and queries for performance.

- Work closely with Product teams to understand and refine requirements.

- Collaborate with QA teams to troubleshoot and resolve data-related issues.

- Work independently and collaboratively to deliver project objectives.

- Take ownership of assigned tasks and proactively contribute to the team.

Must-Have Skills:

- Strong hands-on experience with SQL and Python.

- Advanced SQL knowledge including CTEs, Complex Joins, and Analytical / Window Functions.

- Strong understanding of Data Profiling and Data Quality.

- Ability to identify unique and primary keys and analyze data characteristics.

- Strong ETL/ELT and data transformation experience.

- Good communication and stakeholder collaboration skills.

- Ability to work independently and take ownership.

Good to Have:

- Real-world experience with Snowflake.

- Hands-on experience with dbt.

- Experience in the Healthcare / Payer domain.