Data/AI Architect - Microsoft Fabric/Databricks

Total Experience : 12 - 17 years

Position Overview :

We are seeking a 12+ experienced Data Architect with strong expertise in Microsoft Fabric, Azure Databricks, Azure Data Factory, Azure Data Lake, SQL Data Warehouse, and modern cloud data platforms to define and implement scalable, secure, high-performance data architectures.

The ideal candidate will be responsible for translating business and technical requirements into robust enterprise data architecture and solution designs, defining data platforms, integration patterns, data models, governance frameworks, and analytics solutions.

Key Responsibilities :

- Design and define end-to-end enterprise data architectures using Microsoft Fabric, Azure Databricks, Azure Data Factory, Azure Data Lake, Synapse, and related cloud services.

- Translate business requirements into scalable, secure, and maintainable data architecture and solution designs.

- Design Lakehouse, Data Warehouse, and Medallion Architecture solutions.

- Define data architecture patterns for Generative AI, LLM, RAG, embeddings, and vector search solutions.

- Evaluate and recommend appropriate technologies based on performance, scalability, security, and cost.

- Create architecture diagrams, data flow diagrams, and technical documentation.

- Integrate AI agents with APIs, databases, and enterprise applications.

Microsoft Fabric & Databricks Architecture :

- Define enterprise architecture using Microsoft Fabric, including OneLake, Lakehouse, Warehouse, and Power BI.

- Design scalable Azure Databricks and Delta Lake architectures using Apache Spark, Structured Streaming, and Unity Catalog.

- Guide teams in optimizing Databricks workloads for performance and cloud cost efficiency.

Data Integration & ETL/ELT Architecture :

- Design data integration architectures for databases, APIs, SaaS applications, and streaming sources.

- Establish ETL/ELT patterns using ADF, Fabric Data Factory, and Databricks.

- Define frameworks for incremental loads, CDC, SCD, and data reconciliation.

Data Governance, Security & Compliance :

- Define enterprise data governance and security architecture.

- Implement Microsoft Purview, Unity Catalog, RBAC, and data lineage standards.

- Define security patterns for row/column-level security, masking, and encryption.

Key Competencies :

- Enterprise Data Architecture

- Solution Architecture

- Cloud Data Architecture

- Databricks & Lakehouse Architecture

- Data Modeling

- Data Governance & Security

- Technical Leadership