LLM Java Developer

About this opportunity

Turing is seeking talented Java developers to work with cross-functional teams on the definition, design, and delivery of new features for next-generation dialogue agents. The role combines Java software engineering with LLM evaluation, model training, supervised fine-tuning, reinforcement learning with human feedback, and AI response evaluation.

What the listing describes

• ✓Design, develop, and maintain efficient, high-quality code to train and optimize AI models
• ✓Conduct evaluations to benchmark model performance and analyze results for continuous improvement
• ✓Evaluate and rank AI model responses to user queries across diverse domains
• ✓Develop explanations and rationales for model evaluations
• ✓Lead efforts in Supervised Fine-Tuning (SFT), including creating and maintaining task-specific datasets
• ✓Collaborate with researchers and annotators on Reinforcement Learning with Human Feedback (RLHF)
• ✓Design evaluation strategies and processes to improve model alignment
• ✓Create and refine optimal responses to improve AI performance
• ✓Conduct peer reviews of code and documentation
• ✓Collaborate with cross-functional teams to improve model performance and product capabilities
• ✓Explore and integrate new tools, techniques, and methodologies for AI training

Requirements shown on the source

• ✓Bachelor’s or Master’s degree in Engineering, Computer Science, or equivalent experience
• ✓Experience developing web applications using modular development and scalable architectures
• ✓Strong focus on code readability, security, stability, and testing
• ✓Proficiency with Java syntax and conventions
• ✓Ability to train LLM models using stable and scalable backend components
• ✓Ability to participate in code reviews and maintain code quality standards
• ✓Ability to provide clear, clean, well-organized, correct, and annotated code
• ✓Excellent spoken and written English communication skills

Relevant backgrounds mentioned

• ✓Prior software Quality Assurance experience
• ✓Test Planning experience
• ✓Experience with Spring
• ✓Experience with Spring Boot
• ✓Experience working with AI model evaluation or training
• ✓Experience with SFT or RLHF workflows