Senior Data Engineer - Python/ETL

Description :

Key Responsibilities :

- Design, develop, and optimize end-to-end data pipelines using SQL, Python, and Unix-based tools

- Implement and manage Change Data Capture (CDC) solutions for near real-time and batch data integration

- Develop robust ETL/ELT frameworks for large-scale transactional and analytical data

- Ensure data quality, reconciliation, and integrity across multiple source systems

- Optimize SQL queries and database performance for high-volume workloads

- Work with cloud and on-prem data platforms (e.g., data warehouses, data lakes)

- Collaborate with Data Architects to implement enterprise data models and standards

- Support regulatory, risk, finance, and customer analytics use cases

- Automate data workflows and monitoring using Unix scripting and scheduling tools

- Provide technical leadership, code reviews, and mentoring to junior engineers

- Troubleshoot production issues and support BAU data operations

Required Skills & Experience :

- 6+ years of experience as a Data Engineer or similar role

- Strong hands-on experience with SQL (complex joins, performance tuning, stored procedures)

- Proven experience implementing CDC technologies (e.g., GoldenGate, Qlik Replicate, Debezium, Informatica CDC, etc.)

- Solid programming experience in Python for data processing and automation

- Strong Unix/Linux skills (shell scripting, job scheduling, file handling)

- Experience with data warehousing concepts (dimensional modeling, fact tables, slowly changing dimensions)

- Strong understanding of data governance, security, and compliance

- Experience working in Agile delivery environments

Desirable / Nice-to-Have :

- Experience in banking, insurance, or financial services

- Exposure to cloud platforms (AWS, Azure, GCP)

- Experience with Big Data tools (Spark, Kafka)

- Knowledge of CI/CD pipelines for data engineering

- Familiarity with tools such as Informatica, DataStage, Airflow, or similar