Machine Learning Engineer (MLE Bench) - Benchmark Evaluation Specialist

About Turing

Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.

About The Role

We are seeking experienced Machine Learning Engineers (MLE Bench) to join our team and contribute to benchmark-driven evaluation projects focused on real-world machine learning systems. This role involves hands-on work with production-grade ML codebases, model training and evaluation pipelines, and deployment-oriented workflows. The primary objective is to assess and enhance the capabilities of advanced AI systems through rigorous benchmarking and systematic analysis. The ideal candidate will possess a strong ability to bridge research and engineering, working deeply with models, data, and infrastructure in realistic ML environments. This role offers a unique opportunity to work on cutting-edge AI evaluation projects that influence the development and deployment of state-of-the-art systems.

Responsibilities

• Work with real-world ML codebases to support MLE Bench–style evaluation tasks, ensuring accuracy and reliability.
• Build, run, and modify model training, evaluation, and inference pipelines to optimize performance and robustness.
• Prepare datasets, features, and metrics specifically designed for benchmarking and validation of machine learning models.
• Debug, refactor, and enhance production-like ML systems to improve correctness, efficiency, and scalability.
• Evaluate model behavior, identify failure modes, and analyze edge cases relevant to benchmark tasks.

Interested in remote work opportunities in Development & Programming? Discover Development & Programming Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

• Write clean, reproducible, and well-documented Python code to support ML workflows and evaluation procedures.
• Participate in code reviews to uphold high standards of engineering quality and best practices.
• Collaborate closely with researchers and engineers to design challenging, real-world ML engineering tasks for comprehensive AI system evaluation.
  
  

Qualifications

• Minimum of 3+ years of experience as a Machine Learning Engineer or Software Engineer with a focus on ML.
• Strong proficiency in Python for machine learning and data workflows.
• Hands-on experience with model training, evaluation, and inference pipelines.
• Solid understanding of machine learning fundamentals, including supervised and unsupervised learning, evaluation metrics, and optimization techniques.
• Experience working with ML frameworks such as PyTorch, TensorFlow, JAX, or similar.

Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

• Ability to comprehend, navigate, and modify complex, real-world ML codebases effectively.
• Proven track record of writing readable, reusable, and maintainable production-quality code.
• Strong problem-solving and debugging skills to troubleshoot complex issues efficiently.
• Excellent spoken and written English communication skills to collaborate effectively with multidisciplinary teams.
  
  

Benefits

Joining Turing as a freelance Machine Learning Engineer offers the flexibility to work remotely from anywhere, empowering you to balance your professional and personal life. You will have the opportunity to work on cutting-edge AI projects with leading language model companies and innovative research labs. This role provides exposure to state-of-the-art technology and methodologies in AI evaluation, enriching your skill set and professional portfolio. Additionally, Turing offers a collaborative and dynamic environment where your contributions directly impact the development of next-generation AI systems. As a contractor, you will benefit from flexible working hours, allowing you to tailor your workload to your availability and preferences.

Equal Opportunity

Turing is committed to creating an inclusive environment for all employees and contractors. We are proud to be an equal opportunity employer and do not discriminate based on race, gender, religion, age, national origin, disability, or any other protected characteristic. We value diversity and believe that a broad range of perspectives enhances our innovation and success. We encourage individuals from all backgrounds to apply and join our team in shaping the future of artificial intelligence.