AI Red Team Specialist

Mercor • United State
Remote
Apply
AI Summary

Evaluate AI models, generate human data, and document findings to enhance safety. Collaborate with customers and maintain consistent testing. Strong communication skills required.

Key Highlights
Evaluate AI models
Generate human data
Document findings
Key Responsibilities
Evaluate AI models by probing with adversarial inputs
Generate high-quality human data by annotating failures and classifying vulnerabilities
Document findings reproducibly to produce actionable reports and datasets for customers
Technical Skills Required
Adversarial ML Cybersecurity Socio-technical probing
Benefits & Perks
$58/hour
Remote work
20+ hours/week
Nice to Have
Experience with Adversarial ML, Cybersecurity, or Socio-technical risk
Skills in Creative probing such as psychology or unconventional adversarial thinking

Job Description


About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Red Team Specialist

Type: Full-time or Part-time Contract Work

Compensation: $58/hour

Location: Remote

Commitment: 20+ hours/week

Role Responsibilities

  • Evaluate AI models by probing with adversarial inputs to surface vulnerabilities and enhance safety.
  • Generate high-quality human data by annotating failures and classifying vulnerabilities.
  • Apply structured frameworks and benchmarks to maintain consistent testing.
  • Document findings reproducibly to produce actionable reports and datasets for customers.
  • Collaborate on sensitive topics with clear guidelines and wellness resources.

Qualifications

Must-Have

  • Fluent in English and Hebrew.
  • Prior experience in AI adversarial work, cybersecurity, or socio-technical probing.
  • Strong communication skills to explain risks to both technical and non-technical stakeholders.

Preferred

  • Experience with Adversarial ML, Cybersecurity, or Socio-technical risk.
  • Skills in Creative probing such as psychology or unconventional adversarial thinking.

Compensation & Legal

  • Hourly contractor, Paid weekly via Stripe Connect.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

,


Similar Jobs

Explore other opportunities that match your interests

Lead Software QA / Test Analyst

Testing
•
10h ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Associate

Wiraa

United State
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

Jobs via Dice

United State

Lead Test Automation Engineer in Java

Testing
•
14h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

Jobs via Dice

United State

Subscribe our newsletter

New Things Will Always Update Regularly