Senior Data Engineer - Python/SQL

About the Role

We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable data platforms that empower data-driven decision-making.

This role requires deep technical expertise in modern data engineering frameworks, architectural patterns, and cloud-native solutions on AWS.

You will be a key contributor to our data strategy, ensuring data quality, governance, and reliability while mentoring other engineers in the team.

Key Responsibilities

- Architect and implement Data Lake, Data Warehouse, and Lakehouse solutions using modern frameworks and architectural patterns.

- Ensure data quality, governance, and integrity across the entire data lifecycle.

- Monitor, troubleshoot, and optimize the performance of data pipelines.

- Contribute to and enforce best practices, design principles, and technical documentation.

- Partner with cross-functional teams to translate business requirements into effective technical solutions.

- Provide mentorship and guidance to junior data engineers, fostering continuous learning and growth.

Good to Have Skills:

- 8+ years of experience as a Data Engineer, with a proven track record of building large-scale, production-grade pipelines.

- Expertise in AWS Data Services (S3, Glue, Athena, EMR, Kinesis, etc.

- Strong proficiency in SQL and deep understanding of file formats (Parquet, Delta Lake, Apache Iceberg, Hudi, CDC patterns).

- Hands-on experience with stream processing frameworks (Apache Flink, Kafka Streams, or PySpark).

- Proficiency in Apache Airflow or similar workflow orchestration tools.

- Strong knowledge of database systems (relational & NoSQL) and data warehousing concepts.

- Experience with data integration tools and cloud-based data platforms.

- Excellent problem-solving skills and ability to work independently in fast-paced environments.

- Strong communication and collaboration skills to work effectively with both technical and business stakeholders.

- Passion for emerging technologies and keeping pace with industry best practices.

Keywords :

Mandatory Key Skills :

Functional Area :

Qualification :