Posted on: 20/11/2026
Data Engineering & AI Platform Architect
Domain: BFSI / Financial Services
Experience: 6 - 10 Years
Location: Bengaluru
Work Mode: Work from Office - 4 days per week
Notice Period: Immediate to 30 days
Role Overview:
We are looking for a Data Engineering & AI Platform Architect with strong hands-on experience in building scalable, cloud-native data platforms and end-to-end data engineering solutions. The ideal candidate will combine expertise in Python, SQL, Spark/PySpark, distributed data processing and modern lakehouse architectures with practical exposure to Generative AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG) and vector databases. Experience in the BFSI domain is essential.
Key Responsibilities:
- Design and develop scalable, cloud-native, AI-ready data platforms and modern data architectures.
- Build, optimize and maintain end-to-end batch and streaming data pipelines using Python, SQL and Spark/PySpark.
- Implement data ingestion, transformation, processing and integration across enterprise data sources.
- Design and implement lakehouse architectures using platforms such as Databricks and Snowflake.
- Integrate enterprise data platforms with LLM-based applications, RAG workflows and vector databases.
- Develop reusable data services and frameworks to support analytics, machine learning and AI use cases.
- Implement orchestration, CI/CD, monitoring, data quality, governance and security practices.
- Drive MLOps/LLMOps practices to support reliable deployment, monitoring and lifecycle management of AI-enabled solutions.
- Collaborate with data scientists, AI engineers, architects and business stakeholders to deliver production-ready solutions.
- Support data platform modernization, cloud migration, performance optimization and operational reliability.
Mandatory Technical Skills:
- Strong programming experience in Python and SQL.
- Hands-on experience with Apache Spark and PySpark.
- Strong data engineering experience, including end-to-end ETL/ELT pipeline development.
- Experience with distributed data processing and large-scale data platforms.
- Experience with cloud platforms such as AWS, Microsoft Azure or Google Cloud Platform (GCP).
- Exposure to Databricks and/or Snowflake, including modern lakehouse architecture.
- Practical understanding of LLM integration, RAG and vector databases.
- Experience with workflow orchestration, CI/CD, monitoring, data governance and security.
Domain Requirement:
Mandatory experience in BFSI, banking, financial services or insurance. Candidates should be able to demonstrate hands-on involvement in relevant financial-services data platforms, workflows or use cases.
Preferred Experience:
- Experience implementing production-grade RAG or LLM-powered applications.
- Exposure to vector databases, embeddings, semantic search and enterprise knowledge retrieval.
- Experience with MLOps/LLMOps tools, model or prompt evaluation, observability and governance.
- Experience designing secure, scalable and highly available data platforms.
Candidate Requirements:
- 6 - 10 years of relevant professional experience.
- Immediate joiners or candidates with a notice period of up to 30 days.
- Willingness to work from the office 4 days per week.
Did you find something suspicious?
Posted by
Nancey
Last Active: NA as recruiter has posted this job through third party tool.
Posted in
Data Engineering
Functional Area
Data Engineering
Job Code
1684963