Quality Assurance Manager - Automation Testing

Responsibilities :

- Lead the QA strategy, planning, and execution for ADF-based data pipelines and workflows.

- Design and implement test plans, test cases, and test automation for data ingestion, transformation, and loading processes.

- Validate data accuracy, completeness, and integrity across source systems, staging, and target data stores(e. g., Azure SQL, Synapse, Data Lake).

- Collaborate with data engineers, architects, and business analysts to understand data flows and ensure test coverage.

- Develop and maintain automated data validation scripts using tools like PySpark, SQL, PowerShell, or Azure Data Factory Data Flows.

- Monitor and report on data quality metrics, defects, and test coverage.

- Ensure compliance with data governance, security, and privacy standards.

- Mentor junior QA team members and coordinate testing efforts across sprints.

Requirements :

- At least 2 years in a lead role.

- Experience with Azure cloud.

- Testing file-based data lake solutions or Big Data-based solutions.

- Worked on migration or implementation of Azure Data Factory projects.

- Strong experience in ETL/data pipeline testing, preferably with Azure Data Factory.

- Proficiency in SQL for data validation and test automation.

- Familiarity withAzure services : Data Lake, Synapse Analytics, Azure SQL, Key Vault, and Logic Apps.

- Experience with test management tools(e. g., Azure DevOps, JIRA, TestRail).

- Understanding of CI/CD pipelines and integration of QA in DevOps workflows.

- Experience with data quality frameworks(e. g., Great Expectations, Deequ).

- Knowledge of Python or PySpark for data testing automation.

- Exposure to Power BI or other BI tools for test result visualisation.

- Azure Data Factory.

- Exposure to Azure Databricks.

- SQL/stored procedure on SQL Server.

- ADLS Gen2

- Exposure to Python/ Shell script.

Good to have skills :

- Exposure to any ETL tool experience.

- Any other Cloud experience (AWS / GCP).

- Exposure to Spark architecture, including Spark Core, Spark SQL, DataFrame, Spark.

- Streaming and fault tolerance mechanisms.

- ISTQB or equivalent QA certification.

- Working experience with JIRA and Agile.

- Experience with testing SOAP / API projects.

- Stakeholder communication.

- Microsoft Office.