Tao Digital - ETL Tester

WFO 3 days

Requirements :

- Experienced in working on ELT projects/lakehouse architecture

- Must have worked on semi structured data

- Reading & Manipulating Parquet/Avro/CSV files using Pyspark/python

- Reading & flattening of nested Json files using Pyspark/python

- Working knowledge on creating Dataframes & validate the same with source data

- Strong knowledge and experience in Databricks

- Running & monitoring jobs

- Creating Reusable validation Notebooks

- Knowledge in Spark SQL

- Knowledge in creating REPOS/Workspaces

- A good understanding of cloud technology Azure Cloud Platform (ADLS/ADLS Gen2)

- Strong working Knowledge in Snowflake.

- Must have in-depth knowledge of data reconciliation process

- Experience in Banking domain would be good to have

- Excellent communication skills

- Practical experience of testing in an Agile approach (JIRA/Confluence)

- Good to have knowledge on any IDE/Branching Strategy (GITHUB)/Automation using BDD

- Strong SQL skills with experience in writing complex & advanced data validation SQL's

- CTE

- Views

- Windows/Aggregate/String functions

- Subqueries

- Regular Expressions etc.