Job Description :

- 2-3 years of relevant work experience

- To work in capacity of AWS Databricks, Python, Pyspark Hands ON developer

- Work with stakeholders for regular updates, requirement understanding and design discussions. Hands-on experience on designing and developing scripts for custom ETL processes and automation in AWS, data bricks, Python, Pyspark etc.

- Should be skilled in creating architecture and design documentation and knowledge of data engineering tools & technologies

- Expertise in Cloud related Big Data integration and infrastructure Tec stack using Databricks & Apache Spark framework

- Well-versed with scripting languages - Python

- Well versed with Data Orchestration/ETL .

- Good SQL/PL SQL programming Skills - writing complex procedures and queries for Dataframes and Notebooks

- Very good data engineering mindset to build, maintain pipelines, and ability to closely monitor critical pipeline batch jobs and resolve failures on urgent basis.

- Manage and Mentor junior developers in adopting and implementing the data bricks workflows.

- Excellent communication skills is a must

Minimum Qualifications :

- B.E./ master's in computer science, Information systems, or Computer engineering, Systems Engineering with 2+ years of relevant experience

- Minimum of 2+ work experience using Databricks, spark and Databricks workflows, Autoloader.

- Knowledge of other scripting languages such as Scala, JavaScript, API development.

- Knowledge of other Data Orchestration/ETL tools - Alteryx, Snowflake, Azure Data Factory etc.

- Knowledge of any of BI Tools - Tableau, Power BI, Quick Sight.