Scientific Coding - Biology and Python
Remote full-time contractor opportunity for Biology experts with strong Python and scientific computing skills to create, implement, test, and review rigorous scientific coding tasks for AI training and evaluation.
About this opportunity
Turing is seeking Biology experts for the SciCode project, which involves creating high-quality scientific coding tasks used to train and evaluate frontier AI models. The role focuses on authoring complex scientific problems, implementing verified Python solutions with complete unit test coverage, designing discriminative test cases, performing quality-control validation, and iterating tasks based on evaluation feedback.
What the listing describes
- Write scientific problem specifications consisting of one main problem and at least 3 logically connected sub-problems
- Implement verified golden solutions in Python with complete unit test coverage
- Design discriminative test cases that clearly differentiate correct from incorrect model outputs
- Run QC validation checks on the Turing Central Task Platform, including Tier 1 structure checks and Tier 2 quality rubrics
- Iterate on tasks based on QC feedback to meet Pass@K evaluation criteria across multiple LLM judges
- Maintain high output quality with a low rework rate
- Participate in sync calls for reviews, feedback sessions, and project standups during overlap hours
Requirements shown on the source
- Master's or PhD in Biology or similar fields
- Strong Python programming skills with experience in scientific computing
- Ability to write rigorous, well-posed scientific problems with clear constraints and expected outputs
- Strong attention to detail regarding well-posedness, test case discriminativeness, scientific correctness, and determinism
- Prior experience in AI data annotation, research, or scientific writing
- Familiarity with LLM evaluation frameworks or coding benchmarks
- Experience with libraries such as NumPy, SciPy, SymPy, or domain-specific scientific tools
- Published research or academic project experience in a STEM domain
Relevant backgrounds mentioned
- Advanced academic background in Biology or a related field
- Experience creating scientific computing problems and verified Python solutions
- Experience with AI training or evaluation datasets
- Experience with LLM evaluation frameworks or coding benchmarks
- Experience using scientific Python libraries such as NumPy, SciPy, or SymPy
Details to verify before applying
- Country eligibility
- Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Pakistan, Indonesia, Kenya, Nigeria, Turkey, Vietnam
- Compensation
- No pay rate was stated on the source page reviewed.
- Last checked
Source and current details
Our summary is not the full job description. Review the external listing for the latest requirements, terms and application process.
Open the source listing on Turing