Python + Full-Stack (JS) Developer

About this opportunity

Turing is seeking talented developers proficient in Python and JavaScript/TypeScript to work with US-based companies developing commercial and research AI solutions. The role combines full-stack software development with AI model training and evaluation activities, including creating high-quality code, conducting model evaluations, ranking AI responses, contributing to supervised fine-tuning and reinforcement learning workflows, designing evaluation strategies, and collaborating with researchers and annotators.

What the listing describes

• ✓Design, develop, and maintain efficient, high-quality code to train and optimize AI models
• ✓Conduct evaluations (Evals) to benchmark AI model performance and analyze results for continuous improvement
• ✓Evaluate and rank AI model responses to user queries across diverse domains according to predefined criteria
• ✓Develop comprehensive explanations and rationales for technical and model evaluations
• ✓Lead efforts in Supervised Fine-Tuning (SFT), including creating and maintaining high-quality, task-specific datasets
• ✓Collaborate with researchers and annotators to execute Reinforcement Learning with Human Feedback (RLHF) and refine reward models
• ✓Design evaluation strategies and processes to improve model alignment with user needs and ethical guidelines
• ✓Create and refine optimal responses to improve AI performance, emphasizing clarity, relevance, and technical accuracy
• ✓Conduct peer reviews of code and documentation
• ✓Provide constructive feedback and identify areas for code and documentation improvement
• ✓Collaborate with cross-functional teams to improve model performance and contribute to product enhancements
• ✓Continuously explore and integrate new tools, techniques, and methodologies to enhance AI training processes
• ✓Develop web applications using modular development practices and scalable architectures
• ✓Write readable, reusable, maintainable, secure, stable, and well-tested software

Requirements shown on the source

• ✓Strong proficiency in Python and JavaScript/TypeScript
• ✓Extensive experience working with JavaScript or TypeScript and Python
• ✓Ability to write readable, reusable, and maintainable code
• ✓Ability to participate effectively in code reviews and maintain software quality standards
• ✓Ability to provide clear, clean, well-organized, correct, and clearly annotated code
• ✓Bachelor’s or Master’s degree in Engineering, Computer Science, or equivalent practical experience
• ✓Demonstrable experience developing web applications using modular development practices and scalable architectures
• ✓Strong focus on code readability, security, stability, and testing
• ✓Strong understanding of Python syntax and conventions
• ✓Strong understanding of JavaScript and TypeScript syntax and conventions
• ✓Solid understanding of JavaScript ES6
• ✓Experience with Node.js or Nest.js
• ✓Experience with React, Angular, or Vue.js
• ✓Excellent spoken and written English communication skills
• ✓Mandatory knowledge of Docker
• ✓Ability to work effectively in a remote environment

Relevant backgrounds mentioned

• ✓Prior software quality assurance experience
• ✓Experience with test planning
• ✓Experience with test-driven development
• ✓Experience with large language models and prompting in ChatGPT or other LLMs
• ✓Experience with AI model training or evaluation
• ✓Experience with Supervised Fine-Tuning (SFT)
• ✓Experience with Reinforcement Learning with Human Feedback (RLHF)
• ✓Experience collaborating with AI researchers and data annotators
• ✓Experience developing scalable commercial or research web applications