Azure Data Engineer - Python/SQL

Description :

We are looking for a highly skilled Azure Data Engineer to guide and mentor a team in building scalable, enterprise-grade data solutions on Azure using Databricks and Snowflake.

The ideal candidate will have deep expertise in Azure data services, strong hands-on engineering capabilities, experience with Guidewire data structures, and a solid understanding of the insurance domain.

Key Responsibilities :

- Lead and mentor a team of data engineers to develop data analytics solutions, including data warehouses and data marts on Azure Databricks.

- Architect, design, and deliver end-to-end data engineering solutions using Databricks, Snowflake, and other Azure data services.

- Oversee and participate in code reviews, ensuring high coding standards, performance optimization, and best practices.

- Plan and manage Program Increments (PI) and Sprint cycles using Agile methodologies and tools such as Jira.

- Design and develop scalable and secure data pipelines from enterprise systems to Azure/Databricks.

- Implement and enhance CI/CD workflows for data engineering solutions.

- Work closely with cross-functional teams to ensure quality deliverables and proper integration of data assets.

- Maintain strong alignment with DevOps practices, including infrastructure-as-code and automated deployments.

- Contribute to solution design with deep understanding of insurance KPIs, regulatory reporting, and Guidewire data.

Technical Requirements :

Core Skills :

- Strong proficiency in Python, PySpark, SQL, Databricks, and/or Snowflake.

Hands-on experience with Azure data services including :

- Azure Functions

- Azure Data Factory (ADF)

- Azure Synapse Analytics

- Azure Blob Storage

- Proven ability to design and implement scalable ETL/ELT pipelines on Azure and Databricks.

- Practical experience with Terraform or similar IaC tools (e.g., ARM, Bicep).

- Experience developing and maintaining CI/CD pipelines for data workloads.

Domain Expertise :

- Strong understanding of insurance data domains: Policy, Claims and Billing

- In-depth knowledge of Guidewire (PolicyCenter, BillingCenter, ClaimCenter) data structures.

- Experience supporting insurance reporting, KPIs, and regulatory compliance