Infocus Technologies - Azure Databricks Engineer - Big Data Solutions

Role Overview :

We are seeking a skilled Azure Databricks Engineer to join our growing cloud data engineering team.

The ideal candidate will be responsible for designing, developing, and implementing scalable data processing solutions on Azure Cloud using Databricks, Azure Data Factory, and PySpark.

This role requires hands-on experience with end-to-end data pipeline development, strong analytical thinking, and the ability to collaborate across business and technical teams.

Key Responsibilities :

- Design, build, and maintain data pipelines and ETL workflows using Azure Databricks and Azure Data Factory (ADF).

- Develop and optimize PySpark scripts for large-scale data processing and transformation.

- Integrate data from multiple sources into Azure-based storage and analytics platforms.

- Implement best practices for data quality, performance, and reliability.

- Collaborate with cross-functional teams to understand business requirements and translate them into scalable data engineering solutions.

- Ensure proper data governance, monitoring, and security in all workflows.

- Troubleshoot data pipeline issues, perform root-cause analysis, and recommend performance improvements.

- Stay current with Azure ecosystem developments, Databricks feature updates, and emerging data technologies.

Preferred Candidate Profile :

- 3 to 5 years of hands-on experience with Azure Databricks, Azure Data Factory, and PySpark.

- Strong understanding of Azure Cloud architecture, data lake concepts, and data ingestion frameworks.

- Proficiency in SQL, Python, and data modeling.

- Experience in performance tuning and optimization of big data solutions.

- Familiarity with DevOps practices and CI/CD pipelines for data workflows is a plus.

- Excellent problem-solving, communication, and documentation skills.

- Ability to work independently and collaboratively in a fast-paced environment