Job Summary:

We are seeking an experienced Databricks ETL Testing Engineer with 6+ years of experience in validating enterprise data platforms and ETL pipelines. The ideal candidate should have hands-on expertise in Databricks, ETL testing, data validation, SQL, and cloud-based data platforms. The role involves ensuring data quality, accuracy, and performance across end-to-end data integration and analytics solutions.

Key Responsibilities:

- Design, develop, and execute test strategies for ETL and data migration projects.

- Validate ETL workflows, data transformations, and business rules within Databricks.

- Perform source-to-target data validation, reconciliation, and regression testing.

- Develop and execute SQL queries to verify data accuracy, completeness, and integrity.

- Create and maintain test plans, test cases, test scripts, and defect reports.

- Collaborate with data engineers, developers, business analysts, and stakeholders to understand data requirements.

- Identify, log, track, and resolve defects throughout the testing lifecycle.

- Perform functional, integration, regression, and performance testing for data pipelines.

- Validate large datasets and ensure compliance with data quality standards.

- Support production releases, data validation, and post-deployment testing activities.

- Automate ETL test cases wherever applicable to improve testing efficiency.

- Prepare testing documentation and provide regular status updates to project teams.

Required Skills:

- 6+ years of experience in ETL and Data Warehouse testing.

- Strong hands-on experience with Databricks and Spark-based data processing.

- Expertise in ETL testing, data validation, and data reconciliation.

- Strong proficiency in SQL for complex query writing and data analysis.

- Experience with cloud data platforms such as Azure, AWS, or GCP.

- Knowledge of data warehousing concepts, dimensional modeling, and data migration.

- Experience with defect tracking and test management tools such as JIRA, Azure DevOps, or ALM.

- Understanding of Agile/Scrum methodologies and software testing life cycle (STLC).

- Strong analytical, troubleshooting, and problem-solving skills.

- Excellent communication and collaboration abilities.