Info Services - Data Engineer - QA Automation

Description :

We are actively looking for a Data Engineer with strong QA Automation expertise to join our team immediately. This role requires hands-on experience in Azure Databricks, Selenium BDD, API automation, and Python/Java.

Key Responsibilities :

- Design, develop, and maintain automated test frameworks for data pipelines and applications

- Validate and ensure data quality across Azure Databricks pipelines

- Build and execute Selenium BDD test automation scripts

- Develop and maintain REST API automation tests

- Work with large datasets using PySpark and SQL for validation and transformation

- Perform data validation across file formats such as JSON, Parquet, and Avro

- Collaborate with cross-functional teams in an Agile environment

Skills and experiences required :

- 2+ years of Azure Databricks experience

- 3+ years in Selenium BDD and REST API automation

- Strong coding skills in Python and Java (both mandatory)

- Experience with PySpark, SQL, and complex queries in Databricks

- Understanding of file formats: JSON, Parquet, Avro

- Exposure to Azure Data Factory is a plus

Ideal Candidate :