Software Engineer - Code Quality Assessment

Position: Software Engineer – Code QA

Type: Hourly contract

Compensation: $70–$120/hour

Location: Remote

Commitment: 10–40 hours/week

Role Responsibilities

• Craft realistic, chat-style developer prompts covering code review, debugging, error diagnosis, configuration, and related scenarios.
• Source and adapt real pull requests and engineering discussions to create authentic evaluation tasks.

Interested in remote work opportunities in Development & Programming? Discover Development & Programming Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

• Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality.
• Evaluate AI outputs based on logic, clarity, and technical judgment rather than executable correctness.
• Apply software engineering expertise to ensure prompts and responses reflect real-world developer workflows.
• Contribute to structured evaluation datasets used to assess AI reasoning and communication quality.
• Collaborate asynchronously with research teams to refine task quality and consistency.

Requirements

• Strong experience in software engineering, technical research, or educational content development.
• Bachelor’s degree in Software Engineering, Computer Science, or a related field.
• Strong proficiency in one or more languages such as Python, JavaScript, Java, or C++.
• Hands-on experience with debugging, testing, and validating code.
• Strong technical writing skills with high attention to detail.
• Ability to work independently in a fully remote, project-based environment.

Application Process (Takes 20 Min)

• Upload resume
• Interview (15 min)
• Submit form