QA Engineer (Backend + Machine Learning Testing)

QA Engineer (Backend + Machine Learning Testing)

📍 Remote – LATAM required | Full-time | USD Payment

About Stateside

Stateside is a US-based digital creative and technology agency that connects highly skilled LATAM talent with innovative US companies. We build modern software, data and AI experiences for top-tier brands — fostering a culture of ownership, collaboration, continuous improvement, and a true sense of belonging.

We are scaling data-driven and ML-powered services across APIs and microservices. We are seeking a Quality Engineer who will own quality strategy and test automation for backend/API systems and machine-learning workflows.

✅ What You’ll Do

Backend & API Test Automation

• Define and execute multi-layer testing strategies (unit, integration, contract, end-to-end).
• Build automated tests for REST/GraphQL/gRPC including schema, idempotency, and auth validation.
• Conduct performance & reliability testing (k6, JMeter) and chaos/negative scenarios.
• Maintain full traceability, coverage, and auditable evidence in TestRail.

Data & ML Quality Validation

• Automate data quality checks (schema, nulls, drift).
• Evaluate models against accuracy, AUC/F1, fairness & baseline metrics.
• Validate train → serve parity and feature consistency.
• Support canary/shadow/A-B deployments, drift monitoring (Evidently/WhyLabs).
• Track ML artifacts and reproducibility using MLflow and DVC.

CI/CD Quality Gates & Observability

• Integrate automated quality into GitHub Actions / GitLab CI / Jenkins.
• Block deployments on failing gates, manage flaky test control and parallelism.
• Build synthetic API monitors and model health checks.
• Maintain release evidence for SOC 2 and customer requirements.

Enablement & Quality Culture

• Create and maintain test playbooks, runbooks, and quality documentation.
• Mentor engineers on shift-left testing and contract testing.
• Drive continuous improvement through incident learnings and defect analytics.

🧩 Required Experience & Technical Skills

Experience

• 4–6+ years in Backend QA/SDET roles with strong automation.
• Strong hands-on API and microservices testing.
• Prior exposure to ML, data pipelines, or model validation.
• TestRail experience for planning, execution, reporting.
• Automating quality gates in CI/CD pipelines.

Technical Skills

• Python or Java; pytest / JUnit / TestNG
• API testing: REST Assured, Postman/Insomnia, pytest/requests, Pact
• Performance testing: k6 or JMeter
• Data/ML validation: Great Expectations, MLflow, DVC
• Infrastructure: Docker; familiarity with Kubernetes
• Git & versioning best practices

⭐️ Preferred Skills

• Datadog, New Relic, Grafana, Prometheus, OpenTelemetry
• MLOps platforms: Kubeflow, SageMaker, Vertex AI
• SQL/NoSQL databases, Kafka/RabbitMQ
• OWASP for API security, chaos testing
• ISTQB Advanced / AWS-GCP-Azure certification

🎓 Education

• BS in Computer Science, Engineering, or equivalent experience.

💙 What We Offer at Stateside

• Office Equipment
• Payment in USD (Monthly payment made through Deel.com)
• Work from home - 100% Remote
• Paid Vacations (12 days per year)
• Paid National Holiday off (11 days per year)
• Birthday Off, Personal Days off, Paid Sick Leave
• English Lessons
• Referral Program
• Learning & Development
• Education Expenditure
• Wellness and entertainment

We celebrate diversity, creativity, accountability — and we truly care about our people.

✅ Ready to Apply?

Please submit your updated resume in English. We can’t wait to meet you!