Azure Data Architect

Description :

- Lead design and implementation of advanced data engineering solutions leveraging Azure Databricks

- Architect scalable and high-performance big data pipelines using Spark and Databricks

- Collaborate with cross functional teams to translate business requirements into technical solutions

- Drive best practices in data engineering including performance tuning optimization and data governance

- Mentor and guide junior engineers and technical teams to enhance skillsets and deliverables

- Ensure security and compliance standards are embedded within data workflows and architecture

- Stay updated with emerging technologies and incorporate innovative solutions to improve data processing and analytics

- Work closely with cloud architects to integrate Databricks solutions within broader Azure ecosystems

- Deep Understanding of Azure Cloud Services

Roles and Responsibilities :

- Lead the development deployment and management of Azure Databricks environments

- Design and optimize ETL pipelines and Spark jobs for largescale data processing

- Oversee data transformation ingestion and integration processes ensuring data quality and consistency

- Collaborate with stakeholders to define KPIs reporting requirements and data strategy

- Collaborate with business stakeholders and Product Managers to develop product vision and roadmap

- Work with Business Analysts to gather requirements and create architecture blueprints and design documents

- Extensive experience in data modelling and database design involving any combination of Databases Data warehousing and Business Intelligence systems and tools

- Performance tuning of applications and databases

- Implement data security measures including role based access and compliance controls

- Guide continuous integration and continuous deployment CICD practices for data engineering projects

- Provide technical leadership and mentorship to data engineering teams

- Troubleshoot and resolve complex technical issues related to Databricks and Spark workload

- Lead the creation of common services frameworks and reusable components and review design and code to manage technical debt

- Govern architecture and technology by leading reviews assessments and ensuring compliance with frameworks

- Drive continuous architecture improvement and cost optimization in collaboration with technical and product management teams

- Stay updated with emerging technologies and trends especially in AI and incorporate them into the architecture