Engineering · Senior
Code Reviewer – Python
Remote · Short-term contract
Review real-world code and help shape how AI models fix bugs. Join a short-term project working hands-on with public GitHub repositories. You'll set up codebases, triage issues and evaluate test quality to help researchers understand how well AI models handle real bug-fixing work.
Responsabilidades
- — Analyze and triage GitHub issues across trending open-source libraries.
- — Set up and configure repositories, including Dockerization and environment setup.
- — Evaluate unit test coverage and quality.
- — Modify and run codebases locally to assess LLM performance on bug fixes.
- — Work with researchers to identify repositories and issues that challenge LLMs.
Requisitos
- — Senior-level software engineering experience.
- — Strong Python skills.
- — Proficiency with Git, Docker and basic software pipeline setup.
- — Ability to navigate complex codebases and run, modify and test real-world projects locally.
- — Experience contributing to or evaluating open-source projects is a plus.
Nice to have
- — Previous work on LLM research or evaluation projects.
- — Experience building or testing developer tools or automation agents.
Engagement & compensation
- — Short-term contract, 4 weeks, immediate start.
- — 8 hours per day, with at least 4 hours of overlap with PST.
- — $25 per task, with an average of 45–60 minutes per task.
- — Fully remote.
Selection process
- — Applications are subject to approval by Turing.
