About the Role :

We're looking for an experienced Senior Python Engineer to join our AI/LLM-focused engineering team. This role is at the forefront of Large Language Model (LLM) evaluation and repository validation, contributing to scalable tools and platforms that help assess model performance, validate datasets, and support AI-driven development environments.

You'll work alongside ML researchers and backend engineers to build and optimize frameworks that enable high-confidence model evaluation and code repository analysis.

Key Responsibilities :

- Design and build Python-based tools for automating LLM evaluation and code repository validation workflows

- Implement scalable backend services and APIs that interface with LLMs, evaluation pipelines, and external tools

- Integrate version control platforms (e.g., GitHub) and manage repository metadata parsing and validation

- Collaborate with cross-functional teams including ML, product, and DevOps

- Write clean, efficient, well-tested Python code that supports high-throughput evaluation environments

- Conduct profiling, logging, and performance tuning to ensure platform reliability

- Contribute to design discussions, documentation, and iterative feature improvements.

Requirements :

- 3+ years of hands-on software development experience in Python (post-internship)

- Solid understanding of Python 3.x, object-oriented programming, and best practices

- Experience building RESTful APIs, backend systems, and automation tools

- Exposure to LLM technologies, evaluation frameworks, or ML pipelines is a strong plus

- Familiarity with tools like LangChain, RAG pipelines, or agent frameworks is an advantage

- Experience with data parsing, JSON/YAML handling, and working with APIs

- Git/GitHub workflow proficiency; CI/CD familiarity

- Strong problem-solving, debugging, and collaboration skills

- Comfortable working independently in a remote, asynchronous team

Offer details :

- Commitment required : 20 hours per week with some overlap with PST

- Employment type : Contractor assignment (no medical/paid leave)

- Duration of contract : 3 months with expected start date as next week