Lead Engineer/Architect - Data Modeling

Job Purpose :

You'll lead technical initiatives, guide a team of engineers, and work closely with data scientists, analysts, and business stakeholders to transform complex data requirements into scalable, secure, and high-performance data platforms.

Key Responsibilities :

Azure Data Lake Architecture & Design :

- Define and enforce data ingestion patterns, data processing frameworks, storage strategies, and data governance policies within the Azure Data Lake ecosystem.

- Develop blueprints and roadmaps for data lake evolution, incorporating best practices for security, performance, and reliability.

Data Pipeline Development & Optimization :

sources into the data lake.

- Optimize existing data pipelines and processes for performance, efficiency, and cost-effectiveness.

- Ensure data quality, integrity, and validation throughout the data lifecycle within the lake.

Technical Leadership & Mentorship :

practices in coding, testing, and deployment.

- Conduct code reviews, provide constructive feedback, and ensure adherence to architectural

standards and engineering excellence.

- Mentor junior team members, enhancing their skills in Azure data technologies and data

engineering principles.

Collaboration & Stakeholder Management :

- Collaborate with IT operations and security teams to ensure the data lake infrastructure meets enterprise standards for security, compliance, and operational stability.

- Present technical solutions and architectural decisions clearly to both technical and non-

technical audiences.

Innovation & Best Practices :

- Evaluate new tools and technologies, recommending their adoption to enhance data lake

capabilities and performance.

- Drive continuous improvement initiatives for data engineering practices and the overall data

platform.

Required Skills & Qualifications :

Experience :

- Minimum of 4+ years of hands-on experience specifically with Microsoft Azure Data Lake

technologies and services.

- Proven experience in leading technical teams or significant architectural contributions to data

projects.

Azure Data Lake Expertise :

namespaces, access control, and data organization.

- Strong proficiency in Azure Databricks (Spark, Python/Scala for data processing).

- Extensive experience with Azure Data Factory (ADF) for orchestrating and automating data

pipelines.

- Experience with Azure Synapse Analytics (SQL Pool, Spark Pool, Data Explorer) is highly

desirable.

- Familiarity with Azure Stream Analytics, Azure Event Hubs, or Azure IoT Hub for real-time data processing.

Programming & Scripting :

- Proficiency in SQL for data querying, transformation, and database management.

- Experience with PowerShell or Azure CLI for automation and infrastructure management.

Data Concepts :

(dimensional, 3NF), and data governance.

- Experience with big data concepts and distributed computing.

Cloud Fundamentals :

(Azure AD).

- Experience with Infrastructure as Code (IaC) tools like Azure ARM Templates or Terraform is a

plus.

Problem-Solving & Communication :

- Strong verbal and written communication skills, capable of explaining complex technical concepts to diverse audiences