HamburgerMenu
hirist

Data Engineering & AI Platform Architect

Zorba Consulting
6 - 10 Years
Bangalore

Posted on: 20/11/2026

Job Description

Data Engineering & AI Platform Architect

Domain: BFSI / Financial Services

Experience: 6 - 10 Years

Location: Bengaluru

Work Mode: Work from Office - 4 days per week

Notice Period: Immediate to 30 days

Role Overview:

We are looking for a Data Engineering & AI Platform Architect with strong hands-on experience in building scalable, cloud-native data platforms and end-to-end data engineering solutions. The ideal candidate will combine expertise in Python, SQL, Spark/PySpark, distributed data processing and modern lakehouse architectures with practical exposure to Generative AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG) and vector databases. Experience in the BFSI domain is essential.

Key Responsibilities:

- Design and develop scalable, cloud-native, AI-ready data platforms and modern data architectures.

- Build, optimize and maintain end-to-end batch and streaming data pipelines using Python, SQL and Spark/PySpark.

- Implement data ingestion, transformation, processing and integration across enterprise data sources.

- Design and implement lakehouse architectures using platforms such as Databricks and Snowflake.

- Integrate enterprise data platforms with LLM-based applications, RAG workflows and vector databases.

- Develop reusable data services and frameworks to support analytics, machine learning and AI use cases.

- Implement orchestration, CI/CD, monitoring, data quality, governance and security practices.

- Drive MLOps/LLMOps practices to support reliable deployment, monitoring and lifecycle management of AI-enabled solutions.

- Collaborate with data scientists, AI engineers, architects and business stakeholders to deliver production-ready solutions.

- Support data platform modernization, cloud migration, performance optimization and operational reliability.

Mandatory Technical Skills:

- Strong programming experience in Python and SQL.

- Hands-on experience with Apache Spark and PySpark.

- Strong data engineering experience, including end-to-end ETL/ELT pipeline development.

- Experience with distributed data processing and large-scale data platforms.

- Experience with cloud platforms such as AWS, Microsoft Azure or Google Cloud Platform (GCP).

- Exposure to Databricks and/or Snowflake, including modern lakehouse architecture.

- Practical understanding of LLM integration, RAG and vector databases.

- Experience with workflow orchestration, CI/CD, monitoring, data governance and security.

Domain Requirement:

Mandatory experience in BFSI, banking, financial services or insurance. Candidates should be able to demonstrate hands-on involvement in relevant financial-services data platforms, workflows or use cases.

Preferred Experience:

- Experience implementing production-grade RAG or LLM-powered applications.

- Exposure to vector databases, embeddings, semantic search and enterprise knowledge retrieval.

- Experience with MLOps/LLMOps tools, model or prompt evaluation, observability and governance.

- Experience designing secure, scalable and highly available data platforms.

Candidate Requirements:

- 6 - 10 years of relevant professional experience.

- Immediate joiners or candidates with a notice period of up to 30 days.

- Willingness to work from the office 4 days per week.

info-icon

Did you find something suspicious?

Similar jobs that you might be interested in

Posted by

Nancey

TA at Zorba Consulting

Last Active: NA as recruiter has posted this job through third party tool.

Job Views:  
16
Applications:  9
Recruiter Actions:  0

Functional Area

Data Engineering

Job Code

1684963

Loading chat...