Join BeGig as an AI Testing Engineer to develop and execute test plans for machine learning models and AI workflows. Collaborate with engineering teams to automate testing pipelines and ensure release readiness. Fully remote and flexible freelance opportunities.
Key Highlights
Technical Skills Required
Benefits & Perks
Job Description
About BeGig
BeGig is the leading tech freelancing marketplace. We empower innovative, early-stage, non-tech founders to bring their visions to life by connecting them with top-tier freelance talent. By joining BeGig, you're not just taking on one role—you’re signing up for a platform that will continuously match you with high-impact opportunities tailored to your expertise.
Your Opportunity
Join our network as an AI Testing Engineer and help ensure the reliability, accuracy, safety, and performance of AI models and applications. You’ll work closely with developers and data scientists to build testing frameworks, run evaluations, and flag issues in LLMs, ML models, and AI-driven systems before they go live.
Role Overview
As an AI Testing Engineer, you will:
- Develop and execute test plans for machine learning models and AI workflows
- Evaluate LLM and model outputs for quality, bias, correctness, and edge cases
- Collaborate with engineering teams to automate testing pipelines and ensure release readiness
What You’ll Do
- Design unit, integration, and regression tests for ML models and LLM applications
- Build automated evaluation frameworks to assess accuracy, latency, and behavior
- Create synthetic datasets and edge cases to stress-test AI systems
- Perform human-in-the-loop evaluations for prompt and agent-based workflows
- Track model versioning, performance metrics, and testing coverage
Technical Requirements
- 2+ years in QA, ML testing, or AI application development
- Proficiency in Python and testing tools such as pytest, unittest, or custom scripts
- Experience testing LLMs or generative models (OpenAI, Claude, etc.)
- Familiarity with LangChain, RAG workflows, or agent systems is a plus
- Bonus: experience with CI/CD for AI/ML pipelines, MLflow, or similar tooling
What We’re Looking For
- A detail-oriented tester with a deep understanding of AI system behaviors
- A freelancer who can anticipate risks and ensure the reliability of AI applications
- Someone comfortable working closely with dev, product, and AI research teams
Why Join Us
- Contribute to building safe, effective, and production-ready AI tools
- Fully remote and flexible freelance opportunities
- Get matched with future roles in AI QA, model evaluation, and test automation
- Join a growing community building trust and accountability in AI systems
Ready to put AI systems through their paces? Apply now to become an AI Testing Engineer with BeGig.