HamburgerMenu
hirist

Job Description

Now Hiring : Senior Code Reviewer (Python + Docker) | LLM Data Training

Remote


Contract

Focus: Code Review, AI Evaluation, Python, Docker

Project : Atlas High-Quality Data for AI. Are you passionate about Python and excited by the future of AI?


Were looking for a Senior Code Reviewer to help ensure the quality and integrity of data used to train large language models (LLMs).


About the Role :


As a Senior Code Reviewer, youll review evaluations made by data annotators assessing AI-generated Python code. Your mission: ensure that the evaluations adhere to strict standards around functionality, instruction-following, and factual accuracy. Youll work within a fast-moving team, using your technical expertise to help shape the training data that powers cutting-edge AI systems.


What You'll Do :


- Audit and review annotator evaluations of Python code generated by AI.

- Confirm that code is functional, accurate, and follows the given instructions.

- Validate technical correctness using hands-on proof-of-work including execution in Docker environments.

- Flag and correct inconsistencies or errors in annotator feedback.

- Provide constructive guidance to annotators to uphold quality standards.

- Follow strict evaluation protocols as defined by Project Atlas.


Required Qualifications :


- 5 to 7+ years in Python development, QA, or code review roles.

- Strong understanding of Python syntax, testing, debugging, and edge cases.

- Proficient with Docker for code execution and environment replication.

- Comfortable working in structured QA or annotation workflows.

- Excellent written communication skills.

- English proficiency at B2+ level or higher.


Preferred Experience :


- Familiarity with LLM evaluation, AI training data, or RLHF workflows.

- Hands-on experience with annotation platforms or structured data review pipelines.

- Understanding of model alignment and evaluation techniques in AI.


info-icon

Did you find something suspicious?