Seeking experienced Software Engineers for high-impact AI research collaborations. Responsibilities include building evaluation datasets for AI reasoning and technical judgment in coding interactions. Requires 2+ years of experience and proficiency in programming languages.
Key Highlights
Key Responsibilities
Technical Skills Required
Benefits & Perks
Job Description
hiring experienced Software Engineers to support high-impact research collaborations with leading AI labs. Freelancers will contribute to building evaluation datasets that assess AI reasoning, explanation quality, and technical judgment in coding-related interactions.
This is a unique opportunity to apply your engineering expertise toward shaping the next generation of intelligent systems.
About The Project
This evaluation dataset is code question and answer data. This data is designed to assess natural-language reasoning, explanation quality, and technical judgment in coding-related interactions, rather than executable correctness. Tasks are structured as chat-pasteable prompts that reflect realistic developer questions and include all necessary context inline (e.g., code snippets, error messages, logs, or requirements)
Key Responsibilities
- Craft realistic developer prompts across multiple categories (code review, debugging, error diagnosis, configuration, and more)
- Source and adapt content from real PRs to create authentic scenarios
- Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality
- 2+ years of experience in software engineering, technical research, or educational content development
- Degree in Software Engineering, Computer Science, or a related field (Bachelor’s minimum; advanced degree preferred)
- Strong proficiency in languages like Python, JavaScript, Java, or C++
- Experience with debugging, testing, and validating code
- Comfortable with technical writing and attention to detail
Interested in remote work opportunities in QA & Testing? Discover QA & Testing Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.
- Start Date: Immediate
- Duration: 1-2 months
- Commitment: Part-time (15–25 hours/week, with flexibility up to 40 hours/week)
Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.
- Upload your resume
- AI interview: A short, 15-minute conversational session to understand your background, experience, and interest in the role
- Follow-up communication within a few days with next steps and onboarding details
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Contract and Payment Terms
- You will be engaged as an independent contractor.
- This is a fully remote role that can be completed on your own schedule.
- Projects can be extended, shortened, or concluded early depending on needs and performance.
Similar Jobs
Explore other opportunities that match your interests
Software Engineer in Test for Prisma Access Cloud Service
Jobs via Dice
QA Analyst for Secrets Management Platform
Keeper Security, Inc.
Senior Test Engineer