Description :

Job Title : Principal Data Engineer

Experience : 15+ Years

About the Role :

- We are looking for a Principal Data Engineer to lead the design and delivery of scalable data solutions using Azure Data Factory and Azure Databricks. This is a consulting-focused role that requires strong technical expertise, stakeholder engagement, and architectural thinking.

- You will work closely with business, functional, and technical teams to define data strategies, design robust pipelines, and ensure smooth delivery in an Agile environment.

Responsibilities :

- Collaborate with business and technology stakeholders to gather and understand data needs

- Translate functional requirements into scalable and maintainable data architecture

- Design and implement robust data pipelines

- Lead data modelling, transformation, and performance optimisation efforts

- Ensure data quality, validation, and consistency

- Participate in Agile ceremonies, including sprint planning and backlog grooming

- Support CI/CD automation for data pipelines and integration workflows

- Mentor junior engineers and promote best practices in data engineering

Must Have :

- 15+ years of IT experience, with at least 7 years in data architecture roles in modern metadata-driven and cloud-based technologies, bringing a software engineering mindset

- Strong analytical and problem-solving skills - Ability to determine data patterns and perform root cause analysis to resolve production issues

- Excellent communication skills, with experience in leading client-facing discussions

- Strong hands-on experience with Azure Data Factory and Databricks, leveraging custom solutioning and design beyond drag-and-drop capabilities for big data workloads

- Demonstrated proficiency in SQL, Python, and Spark

- Experience with CI/CD pipelines, version control and DevOps tools

- Experience with applying dimensional and Data Vault methodologies

- Background in working with Agile methodologies and sprint-based delivery

- Ability to produce clear and comprehensive technical documentation