Technical Project Manager - AI Training & Evaluation Platform

Location : Bengaluru, India

About KGeN / KAI :

KGeN's "KAI - Training & Evaluation" business taps a network of 1M+ verified experts across 60+ countries and 20+ languages, delivering specialised datasets across domains such as coding, STEM, healthcare, content, design, legal and general data collection and labeling power large- language and multimodal AI systems.

KGeN is one the fastest growing startups with revenue growth to $50M+ ARR within 3 years. Funded by the most marquee investors - Accel, Prosus, Sequoia, Nexus and Lightspeed.

Role Overview :

You will own the end- to- end operations of GenAI data pipelines - from data collection and human- annotation through model evaluation and feedback loops. You will build and optimize processes to ensure high throughput, high annotation quality, scalability across modalities (text, image, audio, video), multiple languages and verticals (e.g., healthcare, legal, design). You'll collaborate with product, engineering, quality, and vendor/annotator networks to drive efficiency, cost control and quality metrics. This is a strategic operational role in a fast- scaling AI training business.

Key Responsibilities :

- Design, implement and manage annotation/response- generation pipelines for GenAI systems :

- Multi- modal data collection & preprocessing (text, image, audio, video)

- Human- in- the- loop (HITL) annotation : object detection, localisation, transcription, prompt and response generation.

- Set and track KPIs for pipeline performance : throughput, cost per unit, annotation accuracy, inter- annotator agreement, revision rates, turnaround time, multilingual coverage.

- Scale operations : build out annotator networks (in- house + global contractors), vendor relationships, training programmes for annotators, monitoring and escalation mechanisms

- Collaborate with engineering and data science teams to integrate annotation tools, APIs, dashboards, and automation into pipelines

- Drive process improvement and workflow automation for efficiency and cost optimization across domains

- Ensure data governance, quality, and compliance : maintain annotation standards, audit trails, and data security

- Manage stakeholder relationships with business/product leads and model teams to prioritise and deliver high- impact annotation projects

Requirements :

- Bachelor's/Master's degree in engineering or a related field.

- 3-5 years of experience in AI/Data annotation/training pipelines, with at least 2 years focused on GenAI operations.

- Strong understanding of GenAI ecosystems : large- language models, multimodal data pipelines, annotation and model evaluation workflows

- Experience scaling annotation and evaluation operations : managing global annotator networks, setting metrics, optimising cost, quality, and throughput

- Excellent stakeholder management skills : collaboration with product, engineering, and data science teams

- Strong analytical and process improvement mindset; comfort with KPIs and data- driven decision making.

- Experience in workflow automation and tooling integration (dashboards, APIs, annotation tools)

- Excellent communication skills; ability to train, mentor, and manage global teams

- Exposure to regulated domains (healthcare, legal) or multilingual/multicultural annotator networks is a plus

What We Offer :

- Opportunity to work at the cutting- edge of GenAI training and evaluation for multimodal AI systems.

- Opportunity to directly work with global AI clients and related travel.

- Competitive salary + performance incentives.

- Fast tracked career growth in a rapidly expanding business within KGeN.