AI Summary
Evaluate AI-generated code, assess quality, correctness, and best practices. Work on cutting-edge AI projects, and contribute to shaping AI understanding and generation of code at scale. Senior-level software engineer with 5+ years of experience required.
Key Highlights
Evaluate AI-generated code
Assess quality, correctness, and best practices
Work on cutting-edge AI projects
Key Responsibilities
Compare pairs of AI-generated code solutions and rank them based on quality, correctness, and engineering best practices
Evaluate code for functional accuracy
Assess code quality factors including readability, efficiency, maintainability, and adherence to idiomatic patterns
Technical Skills Required
Benefits & Perks
Fully remote and flexible work
Freelance autonomy with task-based work
Potential for ongoing work and contract extension
Nice to Have
Experience with machine learning, AI/ML pipelines, or training data curation
Background in competitive programming, technical interviewing, or algorithmic problem-solving
Job Description
About The Role
What if your deep software engineering expertise could directly shape how the next generation of AI writes code? We're looking for senior-level developers in the São Paulo metro to evaluate, compare, and rank AI-generated code — helping AI systems learn what separates good code from great code.
You'll review pairs of code solutions, assess them on correctness, efficiency, readability, and best practices, and provide the preference rankings that teach AI models to produce better software. Your engineering judgment becomes the training signal that makes AI smarter.
This is a fully remote, flexible contract role designed for experienced software engineers who want meaningful, intellectually engaging work on their own schedule.
- Organization: Alignerr
- Type: Hourly Contract
- Location: Remote
- Commitment: 10–40 hours/week
- Compare pairs of AI-generated code solutions and rank them based on quality, correctness, and engineering best practices
- Evaluate code for functional accuracy — verifying that solutions produce correct outputs across standard and edge cases
- Assess code quality factors including readability, efficiency, maintainability, and adherence to idiomatic patterns
- Identify bugs, logic errors, security issues, and performance bottlenecks in AI-generated code
- Write clear, structured justifications explaining your ranking decisions
- Work across multiple programming languages and problem domains — from algorithms and data structures to systems design and API integrations
- Complete task-based assignments independently on your own schedule
Interested in remote work opportunities in Development & Programming? Discover Development & Programming Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.
- Senior-level software engineer with 5+ years of professional development experience
- Proficient in at least two of the following: Python, JavaScript/TypeScript, Java, C++, Go, or Rust
- Strong understanding of algorithms, data structures, and computational complexity
- Experienced in code review — you can quickly spot issues and articulate what makes one solution better than another
- Deep knowledge of software engineering best practices: clean code, design patterns, testing, and performance optimization
- Clear written communicator who can explain technical reasoning concisely in English
- Self-motivated and consistent when working independently without supervision
Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.
- Experience with machine learning, AI/ML pipelines, or training data curation
- Background in competitive programming, technical interviewing, or algorithmic problem-solving
- Familiarity with RLHF (Reinforcement Learning from Human Feedback) or preference-based AI training
- Experience across both backend and frontend development
- Contributions to open-source projects or technical mentoring experience
- Knowledge of security best practices and common vulnerability patterns
- Work on cutting-edge AI projects alongside leading research labs
- Fully remote and flexible — work when and where it suits you
- Freelance autonomy with the structure of meaningful, task-based work
- Your engineering expertise directly shapes how AI understands and generates code at scale
- Intellectually stimulating work that keeps your skills sharp across languages and domains
- Potential for ongoing work and contract extension as new projects launch
Similar Jobs
Explore other opportunities that match your interests
Visa Sponsorship
Relocation
Remote
Job Type
Contract
Experience Level
Entry level
Alignerr
Brazil
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Mid-Senior level
99x brazil
Brazil
Generalist Software Engineer
••••••
••••••
••••••
Job Type
••••••
Experience Level
••••••
MixRank
Brazil