Description :

About Us :

Skit.ai is pioneering the new frontier of customer engagement.

As a leading Conversational AI company, we are fundamentally transforming the collections industry with our suite of Generative AI-powered voice and message assistants.

Our flagship Collection Orchestration Platformthe first of its kindharmonizes communications across all channels, while our proprietary Large Collection Model (LCM) serves as the strategic brain, optimizing every interaction for unparalleled efficiency and customer experience.

Our trophy shelf, which includes the BIG AI Excellence Award 2024 and a Stevie Gold Winner for Most Innovative Company, reflects our commitment to innovation.

But our true north is the tangible impact we deliver.

We are a global team of pioneers headquartered in New York City, and we are looking for a visionary product leader to take ownership of our core intelligence engine from our Bangalore innovation hub.

Job Title : Product Analyst AI Engineering.

Location : Bangalore, India (100% WFO).

Shift Hours : 1 :00 PM 10 :00 PM IST.

Key Responsibilities :

Center of Excellence (CoE) Leadership :

- Establish and maintain Skit.

AI's AI Engineering CoE with documented best practices, prompt libraries, and quality frameworks.

- Develop standardised prompt templates, ASR and TTS best practices, patterns for common use cases (debt collection, appointment setting, payment processing, etc.

- Work on Voice Bot evaluation frameworks and testing protocols to measure effectiveness.

- Build and maintain a knowledge repository of high-performing prompts across different LLM models and use cases.

Cross-Client Analysis & Pattern Recognition :

- Analyse Voice Bot performance data across all active client deployments to identify trends, common failure patterns, and optimization opportunities.

- Conduct root cause analysis on bot performance issues and trace them back to prompt design decisions.

- Generate monthly insights reports highlighting prompt-related improvements and their business impact.

- Identify opportunities for prompt reusability and standardization across similar client use cases.

Continuous Improvement & Innovation :

- Monitor latest developments in LLM capabilities, prompt engineering techniques, ASR, TTS and conversational AI research.

- Experiment with emerging prompting strategies (chain-of-thought, few-shot learning, retrieval-augmented generation, etc.

- Pilot new prompt architectures and evaluate their effectiveness for collections/customer service scenarios.

- Develop A/B testing frameworks for prompt variations and measure impact on KPIs (containment rate, NPS, compliance, etc.

Technical Implementation :

- Design and optimize system prompts, user prompts, and guardrails for voice AI applications.

- Collaborate with engineering teams to implement prompt versioning, testing, and deployment workflows.

- Work with data teams to build feedback loops between prompt changes and performance metrics.

- Ensure Voice Bots maintain compliance with FDCPA, CFPB, TCPA, and other regulatory requirements.

Stakeholder Collaboration :

- Partner with Delivery/PM teams to understand client-specific requirements and constraints.

- Train and mentor AI Engineers on best practices and emerging techniques.

- Present Voice Bot performance insights to leadership and clients during QBRs.

- Support pre-sales and solutioning teams with prompt strategy for new opportunities.

Essential :

Required Work Experience & Skills :

- 3-6 years in product analysis, AI/ML product roles, or conversational AI development.

- Hands-on experience with LLM prompting.

- Strong analytical skills with proficiency in Python, or similar data analysis tools.

- Experience designing and analyzing A/B tests or controlled experiments.

- Deep understanding of NLP, conversational AI, and voice bot architectures.

- Proven ability to identify patterns in large datasets and translate insights into actionable recommendations.

Preferred :

- Prior experience in voice AI, chatbot development, or conversational design.

- Strong educational background from Tier-1 institutions.

- Knowledge of collections industry, financial services, or regulated customer communication.

- Experience with prompt engineering frameworks and evaluation tools.

- Publication or thought leadership in prompt engineering or conversational AI space.

Technical Skills :

- Advanced prompt engineering across multiple LLM providers.

- Data analysis and visualization (SQL, Python, Tableau/Looker).

- Understanding of RAG (Retrieval-Augmented Generation) architectures.

- API integration and web-hook workflows for voice systems.

- Git/version control for prompt management.

Soft Skills :

- Exceptional written communication for crafting precise, effective prompts.

- Systems thinking to understand how prompt changes impact overall bot performance.

- Curiosity and continuous learning mindset in a rapidly evolving field.

- Ability to balance innovation with production stability.

- Strong documentation and knowledge-sharing practices.

Other Qualifications :

- Must be comfortable working US business hours.

- Self-starter who can establish Problem-Solve from the ground up.

- Comfortable working in a fast-paced, ambiguous environment.