Data Scientist/Analyst

About this opportunity

Turing is seeking talented Data Scientists and Analysts with strong Python, data analysis, and business reasoning skills to work on advanced AI projects. The role combines software development, data analysis, AI model evaluation, supervised fine-tuning, reinforcement learning with human feedback, and collaboration with researchers to improve model performance.

What the listing describes

• ✓Design, develop, and maintain efficient, high-quality code to train and optimize AI models
• ✓Conduct AI model evaluations and analyze benchmark results for continuous improvement
• ✓Evaluate and rank AI model responses across diverse domains using predefined criteria
• ✓Develop comprehensive explanations and rationales for model evaluations
• ✓Support Supervised Fine-Tuning (SFT) by creating and maintaining high-quality task-specific datasets
• ✓Collaborate with researchers and annotators on Reinforcement Learning with Human Feedback (RLHF)
• ✓Help refine reward models and AI training processes
• ✓Design evaluation strategies and processes to improve model alignment with user needs and ethical guidelines
• ✓Create and refine responses designed to improve AI model performance, clarity, relevance, and technical accuracy
• ✓Conduct peer reviews of code and documentation
• ✓Provide constructive feedback and identify areas for technical improvement
• ✓Analyze datasets from sources such as Kaggle, the United Nations, and government databases
• ✓Use business and analytical reasoning to answer important questions using available datasets
• ✓Collaborate with cross-functional teams to improve model performance and product capabilities
• ✓Explore and integrate new tools, techniques, and methodologies for AI training
• ✓Clearly document reasoning and logic in Python code, Jupyter notebooks, or other appropriate formats

Requirements shown on the source

• ✓Bachelor's or Master's degree in Engineering, Computer Science, or equivalent experience
• ✓Strong data analysis and analytical abilities
• ✓Strong business sense and ability to draw appropriate conclusions from datasets
• ✓Ability to clearly communicate key findings and analytical conclusions
• ✓Excellent problem-solving and analytical skills
• ✓Excellent communication skills for working with stakeholders and researchers
• ✓Fluent conversational and written English
• ✓Strong Python programming skills
• ✓Ability to work remotely and collaborate with distributed teams
• ✓Available for at least 4 hours per day and a minimum of 20 hours per week
• ✓Able to provide approximately 4 hours of overlap with PST

Relevant backgrounds mentioned

• ✓Experience with AI model evaluation and benchmarking
• ✓Experience with Supervised Fine-Tuning (SFT)
• ✓Experience with Reinforcement Learning with Human Feedback (RLHF)
• ✓Experience creating or maintaining datasets for machine learning
• ✓Experience working with public datasets and databases
• ✓Experience with Jupyter notebooks