Data Validation Engineer

Job Description :

Key Responsibilities :

- Design, execute, and maintain data validation and testing strategies for ETL/ELT pipelines.

- Validate data accuracy, completeness, consistency, and integrity across multiple data sources.

- Develop and execute SQL queries for data analysis, reconciliation, and validation.

- Perform end-to-end testing of data pipelines and transformation processes.

- Create and maintain automated data validation scripts using Python or similar technologies.

- Identify, analyze, and resolve data quality issues and collaborate with engineering teams for remediation.

- Validate schema changes, CDC (Change Data Capture) processes, and data migration activities.

- Prepare test cases, test reports, and documentation while ensuring adherence to quality standards.

- Collaborate with cross-functional teams to support data engineering and analytics initiatives.

Required Skills :

- 4 - 8 years of experience in Data QA, Data Validation, or ETL Testing.

- Strong proficiency in SQL for data validation and analysis.

- Hands-on experience with ETL/ELT processes and data pipeline testing.

- Good understanding of data quality, validation techniques, and data integrity principles.

- Experience with Python or similar scripting languages for test automation.

- Knowledge of CDC (Change Data Capture) patterns and schema evolution.

- Strong analytical, troubleshooting, and communication skills.

Preferred Skills :

- Experience with AWS data services such as Glue, Lambda, Step Functions, and DMS.

- Knowledge of PostgreSQL and Amazon Aurora databases.

- Exposure to Apache Kafka or other event-driven architectures.

- Experience with Docker and Kubernetes.

- Familiarity with financial services, trading, or risk management systems.

- Experience working in Agile/Scrum environments.