Senior ETL Lead - Data Engineering

Overall Experience : Overall 6+ years of experience in development and maintenance in a data engineering project.

Responsibilities :

- Collaborate with stakeholders to understand data requirements and translate them into technical solutions.

SQL :

- Experienced in writing complex SQL queries and knowledge of SQL Analytical functions.

Databricks :

- Design, develop, and deploy scalable data pipelines and ETL processes using Databricks.

- Develop and maintain Databricks notebooks, workflows, and dashboards

- Proficient in building and optimizing data pipelines and workflows in Databricks

- Troubleshoot and resolve data pipeline issues and performance bottlenecks

- Monitor and manage data processing jobs to ensure high availability and reliability

- Work with cloud platforms such as AWS, Azure, or Google Cloud to integrate Databricks with other services

- Knowledge of programming languages such as Python, Scala

- Stay current with the latest Databricks and big data technologies and trends

Cloud :

- Experience working in cloud platforms(Azure/AWS platforms) and familiar with the cloud tools and technologies