ChiStats - Senior Data Engineer - Python

Description :

Year of Experience 5-7 Years

Location Hybrid, Pune

Shift Timings 02 :30 PM to 11 :30 PM (Mon-Fri)

Department : Information Technology

Job Description : At ChiStats, were on the lookout for a passionate Senior Data Engineer to help us shape the future of intelligent solutions.

Youll join a fast-moving, innovation-driven team solving real-world problems using the latest in Python-based data stacks, scalable APIs, modern databases, and cloud-native infrastructure.

As a Senior Data Engineer AI Systems at Bold Penguin, youll design and build the data and AI infrastructure that powers the next generation of commercial insurance experiences. Youll work at the intersection of data engineering, machine learning, and AI agent systems, helping redefine how small business owners shop, quote, and bind insurance.

Youll lead initiatives that combine traditional data engineering with cutting-edge AI capabilitiesLLMs, embeddings, and agentic workflowsenabling intelligent automation, contextual insights, and faster decision-making across our platform.

Responsibilities :

- Architect and implement large-scale data pipelines supporting analytics, machine learning, and AI agent workloads.

- Integrate AI models (LLMs, embeddings, chat models) into data services to power intelligent search, summarization, and reasoning features.

- Design and maintain retrieval-augmented generation (RAG) pipelines, including vector storage, prompt templates, and context assembly mechanisms.

- Develop and orchestrate AI agent workflows using frameworks such as LangChain, CrewAI, LlamaIndex, or AutoGen.

- Collaborate with ML and product teams to transform business and insurance data into structured knowledge for use in chat or reasoning models.

- Build and scale microservices and APIs for data and AI integration, using Python, Java, or Node.js.

- Implement CI/CD, data quality, and monitoring pipelines using AWS native or CNCF-aligned tools.

- Optimize performance of large data processing and semantic search pipelines through parallelization and caching strategies.

- Provide technical leadership and mentorship to junior data engineers in architecture, coding best practices, and AI integration patterns.

- Troubleshoot, diagnose, and resolve production issues within defined SLAs.

Qualifications :

- Bachelors or Masters degree in Computer Science, Data Engineering, or a related technical field.

- 5+ years of experience in software or data engineering, with a proven record of delivering production-grade systems.

- Strong proficiency in Python and one other language (Java, Node.js, or Go).

- Deep experience with data modeling, ETL pipelines, and both document (MongoDB) and relational databases (PostgreSQL).

- Hands-on experience integrating LLMs, embeddings, or vector databases (e.g., Pinecone, Weaviate, FAISS, or Chroma).

- Proficiency in prompt engineering and context management for AI and chat applications.

- Experience with AI agent frameworks (LangChain, CrewAI, LlamaIndex, or similar) and modern orchestration tools (Prefect, Airflow).

- Solid understanding of CI/CD, infrastructure-as-code, and observability within AWS or Kubernetes environments.

- Excellent communication and cross-functional collaboration skills.

- (Preferred) Familiarity with insurance, fintech, or regulated data environments.

Additional Information :

Why ChiStats :

At ChiStats, we believe our people are our greatest strength. Thats why we offer a holistic benefits package designed to support your wellbeing, professional growth, and financial security so you can thrive both at work and in life.

Flexible & Remote Work Options :

We understand that life happens and we respect individual circumstances. Whether you're navigating a personal transition or simply value work-life balance, we offer the flexibility to help you succeed on your terms.

Financial Wellbeing :

We care about your future as much as your present. Our benefits include :

- Provident Fund contributions

- Comprehensive Healthcare Cover

Employee Wellbeing & Family Support :

We offer inclusive leave policies such as maternity and paternity leave, recognizing the importance of family time and lifes big moments.

Recognition That Matters :

Our ChiStats Honors Platform is designed to celebrate achievements, milestones, and day-to-day excellence because recognition should be timely, meaningful, and part of our culture.

Growth Through Learning Elevate :

We invest in your continuous learning through our internal training platform, Elevate, which identifies personalized development needs and offers targeted upskilling opportunities across tech, tools, and soft skills.

Company Description :

Chistats is a data science company helping clients leverage data to accelerate and augment business value.

- At the core, our team of passionate data scientists, love solving complex problems for clients and partners.

- We are able to do so through a solid research and development foundation (#5 individual patents and #20 publications and growing).

- At one spectrum, we've helped Asia's largest Oil & Gas company in remote monitoring of the pumps and generating early warning signals before the asset failures.

- On another spectrum, we are working with the largest Defense company in India on a strategic project with the Indian Navy in the area of signal processing.

- As part of recent recognitions, Chistats is part of the NASSCOM, CoE for IoT and AI incubation center. And, Chistats is also a winner of DRDO, Dare to Dream Innovation Contest 2.0.

Chistats is at the forefront of leveraging data science and artificial intelligence to deliver impactful business solutions