Data Scientist - AI/LLM Evaluation

Job Title : Data Scientist AI / LLM Evaluation

Location : Bangalore (Hybrid)

Experience : 4-8 Years

Qualification : B.E / B.Tech / M.Tech (Stats / CS / DS preferred)

Job Description :

We are hiring a Data Scientist AI / LLM Evaluation to build intelligent ML systems and design robust evaluation frameworks for GenAI applications.

Must Have Skills :

- Strong proficiency in Python (Pandas, NumPy, Scikit-learn, PyTorch/TensorFlow)

- Solid ML fundamentals (regression, classification, clustering, A/B testing)

- Hands-on experience with LLM evaluation (RAG, faithfulness, hallucination detection)

- Strong SQL (Azure SQL / PostgreSQL)

- Data engineering basics (ADF pipelines, parquet data formats)

- Experience with MLflow / experiment tracking tools

- Data visualization (Power BI / Plotly)

Good to Have :

- Experience with Azure ML, Databricks, Azure OpenAI

- NLP (embeddings, NER, document classification)

- Computer Vision (inspection imagery use cases)

- Time-series forecasting

- Agentic evaluation (tool-call accuracy, task completion metrics)

- Domain exposure (inspection / logistics / testing / certification)