Job Description :

We are seeking an experienced ETL/SQL/Python Testing Engineer to design, develop, and execute test cases for data pipelines, ETL processes, and database systems. The ideal candidate will have strong expertise in SQL querying, ETL validation, Python scripting, and test automation to ensure data accuracy, completeness, and optimal performance.

Your future duties and responsibilities :

- Develop and execute ETL test cases to validate data extraction, transformation, and loading processes.

- Perform ETL pipeline testing in Azure Databricks (ADB) environments.

- Write complex SQL queries to verify data integrity, consistency, and correctness across source and target systems.

- Automate ETL testing workflows using Python, PyTest, or similar frameworks.

- Conduct data reconciliation, schema validation, and comprehensive data quality checks.

- Identify and report data anomalies, performance issues, and defects.

- Collaborate with Data Engineers, Analysts, and Business Teams to understand data requirements.

- Design and maintain test datasets for validation activities.

- Implement CI/CD pipelines for automated ETL testing (e.g., Jenkins, GitLab CI).

- Document test results, defects, and detailed validation reports.

Must-Have Skills :

- ETL Testing : Strong hands-on experience with tools such as Informatica, Talend, SSIS, Databricks.

- SQL Expertise : Advanced SQL skills (joins, aggregations, subqueries, stored procedures).

- Python Automation : Proficiency in Python with libraries/frameworks like Pandas, PySpark, PyTest.