Key Responsibilities :

- Design and implement comprehensive test strategies and test plans for ETL processes, ensuring thorough coverage of data transformations and data quality requirements.

- Develop and execute test cases and test scripts using Python to validate data accuracy, data completeness, and data integrity across various stages of the ETL pipeline.

- Perform data validation and data reconciliation activities to identify and resolve data discrepancies and data quality issues.

- Collaborate with ETL developers and data engineers to troubleshoot and resolve defects, ensuring timely and effective resolution of issues.

- Participate in code reviews and provide feedback on ETL code and design to ensure adherence to coding standards and best practices.

- Contribute to the development and maintenance of automated testing frameworks and tools to improve testing efficiency and effectiveness.

- Document test results and communicate findings to stakeholders, providing clear and concise reports on data quality and ETL performance.

- Work with business analysts to understand data requirements and translate them into testable scenarios, ensuring alignment with business needs.

Required Skillset :

- Demonstrated ability to design and execute comprehensive test plans for ETL processes, ensuring thorough coverage of data transformations and data quality requirements.

- Proven expertise in developing and executing test cases and test scripts using Python, showcasing proficiency in data validation and data reconciliation techniques.

- Strong understanding of ETL concepts, data warehousing principles, and data modeling techniques, enabling effective testing of data integration pipelines.

- Hands-on experience with Azure cloud platform, including Azure Data Factory, Azure Databricks, and Azure SQL Data Warehouse, demonstrating proficiency in testing ETL processes in a cloud environment.

- Excellent analytical and problem-solving skills, with the ability to identify and resolve data discrepancies and data quality issues effectively.

- Strong communication and collaboration skills, with the ability to work effectively with ETL developers, data engineers, and business analysts.

- Bachelor's degree in Computer Science, Information Technology, or a related field.