We are hiring an Evaluation Campaign Manager to support a high-priority AI evaluation initiative. The role involves reviewing professional tasks, deliverables, and rubrics to ensure they are realistic and properly scoped. Ideal candidates have a strong background in management consulting, strategy, business operations, or private equity operations.
Key Highlights
Key Responsibilities
Technical Skills Required
Benefits & Perks
Nice to Have
Job Description
Evaluation Campaign Manager
Industry: AI / Technology
Location: Fully Remote
Type: Contract 3-6 months starting
I’m hiring an Evaluation Campaign Manager to support a high-priority AI evaluation initiative focused on benchmarking model performance against complex, real-world professional tasks.
This role is ideal for someone with a strong management consulting, strategy, business operations, enterprise transformation, or private equity operations background who understands how internal teams, workflows, responsibilities, and deliverables function across different industries.
This is not just about having exposure to different industries. The team needs someone who can review professional tasks and determine whether they reflect how work actually happens inside a company.
Responsibilities:
- Review submitted tasks, deliverables, and rubrics to ensure they are realistic, complete, clear, feasible, and properly scoped.
- Evaluate whether tasks reflect real internal business workflows, team structures, responsibilities, handoffs, and deliverable expectations.
- Identify quality issues such as vague requirements, unrealistic scope, missing context, unclear success criteria, or weak rubric alignment.
- Provide clear, actionable feedback to contributors and reviewers to improve task quality and reduce rework.
- Monitor campaign progress, submission quality, bottlenecks, turnaround times, and recurring issue themes.
- Help improve documentation, examples, QC checklists, templates, and “good vs. bad” task guidance.
Interested in remote work opportunities in Development & Programming? Discover Development & Programming Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.
Ideal Background:
- 3+ years of experience in management consulting, strategy consulting, business operations, corporate strategy, org design, transformation, M&A integration, or private equity portfolio operations.
- Strong understanding of how teams operate internally across different business functions or industries.
- Experience reviewing workflows, operating models, implementation plans, org structures, business processes, or cross-functional deliverables.
- Strong judgment around whether a task, workflow, or deliverable is realistic and high quality.
- Excellent attention to detail and ability to apply quality standards consistently.
- Comfortable working in ambiguous, fast-moving environments.
- Strong spreadsheet skills required.
- SQL or Python experience is a plus, but not required.
Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.
Strong-fit profiles may include:
- Management consultants who have worked on org design, operating model, restructuring, transformation, or workflow mapping projects.
- Strategy or business operations professionals with experience across multiple departments or functions.
- Private equity professionals focused on portfolio operations, post-acquisition integration, cost reduction, or operational improvement.
Similar Jobs
Explore other opportunities that match your interests
Provisions Group
Embedded Software Engineer
Actalent
