HamburgerMenu
hirist

Data Lead

ARC Consulting
15 - 20 Years
Multiple Locations

Posted on: 17/11/2026

Job Description

Purpose of the Role :

The Data Lead will own the design, development, governance and delivery of the organisation's data platform and data engineering capabilities. The role will lead data architecture and engineering on AWS and Databricks, ensuring that data is ingested, transformed, secured and made available for reporting and business use in a reliable, scalable and cost-effective manner.

Key Responsibilities :

- Define and maintain the data platform architecture, including lakehouse/data lake design and integration patterns.

- Design and implement Medallion Architecture (Bronze, Silver and Gold) and appropriate data layering and naming standards.

- Lead the design and implementation of batch and incremental data pipelines across APIs, files and databases.

- Establish data cataloguing, data dictionary, ownership, stewardship and lineage practices, using Databricks Unity Catalog.

- Lead, coach and develop data engineers and other team members, encouraging knowledge sharing and consistent engineering practices.

Critical Skills Required :

- Data architecture : lakehouse/data lake design, Medallion Architecture, data integration and dimensional modelling.

- Data engineering : Databricks, Apache Spark/PySpark, SQL, Python, batch and incremental processing, orchestration and performance tuning.

- Databricks capabilities : Delta Lake, Databricks Workflows, Delta Live Tables, Auto Loader and Unity Catalog.

- AWS data services : S3, IAM, Glue, CloudWatch and Secrets Manager.

- Leadership : team management, stakeholder engagement, requirements analysis, planning, prioritisation and end-to-end delivery ownership.

Qualifications :

Bachelor's degree in Computer Science, Information Technology, Engineering or a related discipline, or equivalent practical experience.

info-icon

Did you find something suspicious?

Similar jobs that you might be interested in

Loading chat...