HamburgerMenu
hirist

Principal Engineer - Generative AI

Neemtree
5 - 6 Years
Multiple Locations

Posted on: 03/04/2026

Job Description

Role Overview :


We are looking for a highly skilled Principal Engineer GenAI to lead the design and development of scalable LLM-powered platforms and AI systems.


This is a hands-on, high-impact role focused on solving complex problems in model deployment, inference optimization, and GenAI applications at scale.


You will work at the intersection of research and production, driving innovation in applying GenAI to real-world domains such as fashion and apparel data.


Key Responsibilities :


- Design and build scalable GenAI/LLM platforms for production use cases


- Lead development of low-latency, high-throughput inference systems for LLMs


- Optimize model performance, cost, and latency across deployment pipelines


- Implement and fine-tune open-source LLMs and generative models


- Build and scale RAG pipelines, embeddings, and vector search systems


- Solve complex challenges in model serving, orchestration, and distributed systems


- Collaborate with product and engineering teams to translate AI capabilities into real-world features


- Mentor engineers and contribute to best practices in GenAI system design


Core Technical Skills :


- Strong hands-on experience with Python and ML/AI frameworks (PyTorch / TensorFlow)


- Deep understanding of LLMs, transformers, and generative AI architectures


- Experience with LLM fine-tuning (LoRA, PEFT), prompt engineering, and evaluation


- Strong expertise in RAG architectures, vector databases (FAISS, Pinecone, Weaviate)


- Experience with model serving frameworks (vLLM, Triton, Hugging Face, TensorRT-LLM)


- Strong knowledge of distributed systems, APIs, and microservices architecture


- Experience with cloud platforms (AWS / GCP / Azure) and GPU-based deployments


- Familiarity with Docker, Kubernetes, and scalable infrastructure


Key Requirements :


- 5 to 6 years of experience in software engineering with strong focus on AI/ML systems


- Proven experience building and deploying LLM-based or GenAI applications in production


- Strong problem-solving skills with ability to work on high-scale, performance-critical systems


- Ability to work in a fast-paced, innovation-driven environment


info-icon

Did you find something suspicious?

Similar jobs that you might be interested in

Loading chat...