We are hiring a Data Engineer- Azure Data Bricks for one of our Esteemed clients.

Job Title : Data Engineers- Azure Data Bricks

Location : remote

Contract Duration : 6 months + extendable

Experience : 5+ years

Job Description :

Key Skills :

- Strong experience with Azure Databricks and PySpark

- Proficient in building data pipelines and ETL workflows

- Hands-on with Azure Data Services

- Solid understanding of big data architecture and performance tuning

- Excellent problem-solving and communication skills

- Strong experience with Azure Databricks and PySpark:

- Proficient in building data pipelines and ETL workflows

- Hands-on with Azure Data Services

- Solid understanding of big data architecture and performance tuning

Roles and Responsibilities :

- Design, develop, and manage scalable and robust ETL pipelines using Azure Databricks and PySpark.

- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.

- Build and optimize data models, ensuring high availability and performance.

- Implement and manage data integration solutions across various sources and systems.

- Work with structured and unstructured data, ensuring data quality and integrity.

- Perform data profiling and analysis to identify and resolve data-related issues.

- Optimize data workflows and jobs for cost and performance efficiency.

- Ensure best practices in data governance, security, and compliance.

- Create and maintain documentation related to data engineering processes and workflows.

- Troubleshoot and resolve data issues and performance bottlenecks in pipelines.