Job Summary :

We are seeking a Databricks BI Architect to lead the delivery, and operational excellence of enterprise-scale BI and analytics platforms on Databricks. This role requires strong delivery ownership, hands-on Databricks expertise, and proven experience leading managed services teams to ensure SLA-driven, cost-effective, and scalable analytics solutions. The ideal candidate will bridge business intelligence, data engineering, and platform governance, while leveraging modern capabilities such as AI-assisted development and MLOps practices to accelerate delivery and improve quality.

Key Responsibilities :

Architecture & Solution Design :

- Own the end-to-end BI and analytics architecture on Databricks (Lakehouse).

- Design scalable data models, semantic layers, and reporting architectures for enterprise BI.

- Define data ingestion, transformation, and aggregation strategies using Delta Lake, Spark SQL, and PySpark.

- Establish multi-layered architectures (Bronze, Silver, Gold) aligned with BI consumption needs.

- Ensure performance optimization for dashboards, reports, and ad-hoc analytics.

- Leverage AI capabilities within Databricks (e.g., AI-assisted code generation and development accelerators) to speed up development and improve consistency.

BI & Analytics Enablement :

- Architect and govern integration with BI tools (Power BI, Tableau, Looker, etc.).

- Define best practices for dataset design, refresh strategies, and query optimization.

- Enable self-service BI through well-defined data products and curated datasets.

- Collaborate with business teams to translate requirements into scalable BI solutions.

Managed Services Leadership :

- Lead managed services teams responsible for Databricks BI platforms.

- Drive 24x7 operational support, incident management, and SLA adherence.

- Define and monitor KPIs, SLAs, and SLOs for platform stability and performance.

- Implement runbooks, support models, escalation paths, and operational governance.

- Mentor and upskill team members across Databricks, BI, and modern analytics practices.

Platform Governance, AI & MLOps :

- Establish data governance, security, and access control using Unity Catalog.

- Define standards for cost optimization, cluster management, and workload isolation.

- Promote adoption of AI-driven development practices within Databricks to improve delivery speed.

- Exposure to MLOps concepts and tooling, including MLflow, will be an added advantage.

- Ensure compliance with enterprise data, security, and regulatory requirements.

Required Skills & Qualifications :

Technical Skills :

- Strong hands-on experience with Databricks (Azure / AWS / GCP).

- Expertise in Spark SQL, PySpark, Delta Lake, and performance tuning.

- Solid understanding of BI architecture, dimensional modeling, and semantic layers.

- Experience integrating Databricks with Power BI, Tableau, or similar tools.

- Working knowledge of AI-assisted development tools within Databricks for code generation and productivity.

- Knowledge of data governance, Unity Catalog, and security best practices.

- Familiarity with CI/CD for data platforms (Azure DevOps, GitHub, etc.).

Leadership & Managed Services :

- Proven experience leading managed services or support teams.

- Strong understanding of SLA-based delivery, incident/problem management.

- Ability to balance architecture ownership with operational excellence.