Azure Data Engineer - PySpark/SQL

Job Overview :

The ideal candidate will have hands-on experience with Azure Data Factory, Databricks, PySpark, and Azure Synapse Analytics, combined with strong SQL and CI/CD (DevOps) practices.

Key Responsibilities :

- Implement data integration, transformation, and orchestration solutions on Azure cloud platforms.

- Develop and maintain data models and optimized queries in Azure Synapse Analytics and SQL.

- Work with CI/CD pipelines to ensure smooth deployment and integration of data solutions using Azure DevOps.

- Collaborate closely with data architects, business analysts, and application teams to deliver data-driven solutions.

- Ensure data quality, integrity, and security throughout the data lifecycle.

- (Good to Have) Work on real-time data streaming using Event Hub or equivalent technologies.

Required Skills & Qualifications :

- Proficiency in PySpark for big data processing and transformations.

- Strong understanding of Azure Synapse Analytics and SQL for data warehousing and analytics.

- Experience with CI/CD pipelines and Azure DevOps.

- Solid knowledge of data management principles, ETL/ELT best practices, and cloud-native architectures.

- Good communication skills and ability to work in cross-functional teams.

Preferred / Good to Have :

- Exposure to Delta Lake, Lakehouse architecture, or Real-time analytics.

Education & Certifications :

- Bachelors or Masters degree in Computer Science, Information Technology, or related field.