Software Engineer - Code Quality Assurance

crossing hurdles New Zealand
Remote
Apply
AI Summary

We are seeking a skilled Software Engineer to craft realistic developer prompts and evaluate AI outputs. The ideal candidate will have strong experience in software engineering, technical research, or educational content development. This is a remote, hourly contract position.

Key Highlights
Craft realistic developer prompts
Evaluate AI outputs
Contribute to structured evaluation datasets
Key Responsibilities
Craft realistic, chat-style developer prompts
Source and adapt real pull requests and engineering discussions
Evaluate AI outputs based on logic, clarity, and technical judgment
Technical Skills Required
Python JavaScript Java C++
Benefits & Perks
Hourly compensation: $70-$120/hour
Remote work
Flexible hours (10-40 hours/week)

Job Description


Position: Software Engineer – Code QA

Type: Hourly contract

Compensation: $70–$120/hour

Location: Remote

Commitment: 10–40 hours/week


Role Responsibilities

  • Craft realistic, chat-style developer prompts covering code review, debugging, error diagnosis, configuration, and related scenarios.
  • Source and adapt real pull requests and engineering discussions to create authentic evaluation tasks.
  • Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality.
  • Evaluate AI outputs based on logic, clarity, and technical judgment rather than executable correctness.
  • Apply software engineering expertise to ensure prompts and responses reflect real-world developer workflows.
  • Contribute to structured evaluation datasets used to assess AI reasoning and communication quality.
  • Collaborate asynchronously with research teams to refine task quality and consistency.


Requirements

  • Strong experience in software engineering, technical research, or educational content development.
  • Bachelor’s degree in Software Engineering, Computer Science, or a related field.
  • Strong proficiency in one or more languages such as Python, JavaScript, Java, or C++.
  • Hands-on experience with debugging, testing, and validating code.
  • Strong technical writing skills with high attention to detail.
  • Ability to work independently in a fully remote, project-based environment.


Application Process (Takes 20 Min)

  • Upload resume
  • Interview (15 min)
  • Submit form

Similar Jobs

Explore other opportunities that match your interests

Senior Engineer

Programming
2d ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Envato

New Zealand

Intermediate Software Engineer

Programming
1w ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

groov

New Zealand

Cybersecurity AI Model Trainer

Programming
1w ago
Visa Sponsorship Relocation Remote
Job Type Part-time
Experience Level Entry level

DataAnnotation

New Zealand

Subscribe our newsletter

New Things Will Always Update Regularly