Job Title : Databricks Architect / Data Engineer / Azure Data Architect

Experience : 8.5 to 12 Years

Location : Bangalore/Mumbai/Pune/Noida

Role Overview :

We are seeking a highly experienced Databricks Architect to design, implement, and lead scalable data platform solutions for enterprise-grade analytics and cloud data modernization initiatives.

The ideal candidate will be responsible for defining architecture standards, ensuring security and performance optimization, and leading end-to-end data engineering and analytics implementations on cloud platforms (preferably Azure).

This role requires strong hands-on expertise in Databricks, Spark, and modern data architecture principles, along with the ability to mentor engineering teams and drive strategic data initiatives.

Key Responsibilities :

- Design and architect scalable, secure, and high-performance data platforms using Databricks.

- Lead end-to-end implementation of data engineering solutions on cloud platforms (preferably Microsoft Azure).

- Define data architecture standards, best practices, and governance frameworks.

- Architect batch and real-time data pipelines using Apache Spark.

- Optimize performance tuning of large-scale distributed data processing systems.

- Integrate Databricks with enterprise systems, data warehouses, APIs, and third-party platforms.

- Implement robust security models, access control, and data protection strategies.

- Guide and mentor data engineering teams; provide technical leadership and architectural oversight.

- Collaborate with business stakeholders to translate analytics requirements into scalable technical solutions.

- Ensure CI/CD implementation, DevOps practices, and deployment automation for data pipelines.

Required Experience & Skills :

- 12+ years of overall IT experience in Data Engineering / Data Architecture.

- 7+ years of experience in Data Architecture and solution design.

- 4+ years of hands-on experience with Databricks.

- Strong expertise in Apache Spark (Core, SQL, Structured Streaming).

- Proficiency in SQL and Python or Scala.

- Extensive experience with Azure cloud services (ADF, ADLS, Synapse, etc.).

- Experience in designing modern data lake / lakehouse architectures.

- Strong understanding of data modeling, ETL/ELT frameworks, and performance optimization.

- Knowledge of DevOps practices, CI/CD pipelines, and infrastructure-as-code.

- Experience with data security, governance, and compliance frameworks.

Preferred Qualifications :

- Experience working in enterprise-scale data transformation programs.

- Knowledge of real-time streaming and event-driven architectures.

- Exposure to data warehousing concepts and BI tools.

- Relevant cloud or Databricks certifications.

Soft Skills :

- Strong leadership and stakeholder management skills.

- Excellent problem-solving and analytical capabilities.

- Ability to work in a fast-paced, collaborative environment.

- Strong communication and documentation skills.