Senior Software Engineer - Large Language Model (LLM) Evaluation and Training Datasets

About The Company

Turing is a leading technology company specializing in artificial intelligence and software development. Renowned for its innovative approach, Turing leverages cutting-edge AI systems to revolutionize the software engineering landscape. The company is committed to fostering a dynamic environment where talented professionals can collaborate on impactful projects that shape the future of technology. With a global presence and a focus on remote work, Turing empowers its team members to contribute to high-impact initiatives from anywhere in the world, promoting diversity, inclusion, and continuous learning.

About The Role

We are seeking experienced software engineers at the tech lead level to join our groundbreaking project focused on building large language model (LLM) evaluation and training datasets. This role offers a unique opportunity to work at the intersection of software engineering and AI research, contributing directly to the development of datasets that enhance the capabilities of LLMs in understanding and solving real-world software engineering problems. The ideal candidate will have a strong background in managing and analyzing complex codebases, automating development environments, and evaluating test coverage and quality. As a key member of our team, you will collaborate closely with researchers and other engineers to design, implement, and optimize workflows that support our dataset creation efforts.

Qualifications

• Minimum 3+ years of professional experience in software engineering or related fields.
• Proficiency in at least one programming language, with a strong preference for Python.
• Hands-on experience with Git for version control and Docker for environment management.
• Ability to understand, navigate, and modify complex codebases effectively.

Interested in remote work opportunities in Development & Programming? Discover Development & Programming Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

• Experience in setting up, configuring, and testing software environments locally.
• Familiarity with open-source projects, including contribution, evaluation, or maintenance, is a plus.
• Strong problem-solving skills and the ability to work independently and collaboratively in a remote setting.
  
  

Responsibilities

• Analyze and triage issues across trending open-source repositories on GitHub to identify challenging tasks for LLMs.
• Set up and configure code repositories, including environment setup and Dockerization, to facilitate testing and evaluation.
• Assess unit test coverage and quality, providing insights to improve dataset robustness.

Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

• Modify and run codebases locally to evaluate LLM performance in bug-fixing and code understanding scenarios.
• Collaborate with research teams to design datasets and identify repositories that present meaningful challenges for LLMs.
• Lead or mentor junior engineers, fostering a collaborative and innovative work environment.
  
  

Benefits

Joining Turing offers a range of benefits designed to support your professional growth and work-life balance. You will have the opportunity to work remotely from anywhere in the world, providing flexibility and convenience. You will be involved in cutting-edge AI projects that have a tangible impact on the future of software development. Turing also promotes a culture of continuous learning, offering access to resources and community engagement to enhance your skills. Additionally, you will be part of a forward-thinking organization that values diversity, inclusion, and innovation, enabling you to collaborate with some of the brightest minds in AI and software engineering.

Equal Opportunity

Turing is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All employment decisions are made based on qualifications, merit, and business needs without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. We believe that a diverse team fosters innovation and drives our success forward, and we welcome applicants from all backgrounds to join our team.