Machine Learning Infrastructure Engineer

austinworks โ€ข United State
Visa Sponsorship Relocation
Apply
AI Summary

Design and build scalable distributed systems for machine learning infrastructure. Optimize infrastructure for performance and reliability. Work closely with ML researchers and product engineers to bring new models into production.

Key Highlights
Building and scaling serving infrastructure for multimodal AI models
Optimizing inference systems for latency, throughput, and cost
Architecting real-time systems that support long-lived video and audio connections
Key Responsibilities
Building and scaling the serving infrastructure for multimodal AI models
Optimizing inference systems for latency, throughput, and cost
Architecting real-time systems that support long-lived video and audio connections
Designing distributed data pipelines for large-scale processing and evaluation
Managing and optimizing GPU clusters using Kubernetes and Terraform
Building CI/CD, evaluation, and deployment systems for safe and reliable model iteration
Technical Skills Required
Python Rust Go Kubernetes Terraform Cloud infrastructure
Benefits & Perks
$250K โ€“ $450K + equity
Relocation support
Visa sponsorship
Nice to Have
Experience with real-time systems, multimedia models, or GPU inference infrastructure

Job Description


ML Infrastructure / Systems Engineer


Seattle, WA (5 days onsite)

Compensation: $250K โ€“ $450K + equity

Relocation support and visa sponsorship available


About:

Our client is a well-funded AI startup building real-time visual conversational AI that allows users to interact with AI through live video and voice experiences. They recently raised a $50M Series A and are scaling their engineering team ahead of their first major product release. The founding team includes researchers and engineers from leading AI labs and technology companies, and they are building a small, highly technical team focused on developing core AI systems and infrastructure.


What they are looking for

Our client is seeking engineers who enjoy building production-grade infrastructure for machine learning systems. The ideal candidate has experience designing scalable distributed systems, optimizing infrastructure for performance and reliability, and supporting machine learning workloads in production environments.


What you will work on

  • Building and scaling the serving infrastructure for multimodal AI models
  • Optimizing inference systems for latency, throughput, and cost
  • Architecting real-time systems that support long-lived video and audio connections
  • Designing distributed data pipelines for large-scale processing and evaluation
  • Managing and optimizing GPU clusters using Kubernetes and Terraform
  • Building CI/CD, evaluation, and deployment systems for safe and reliable model iteration
  • Working closely with ML researchers and product engineers to bring new models into production


What they are looking for in candidates

  • 2+ years of experience building machine learning infrastructure or distributed systems
  • Strong experience building or operating large-scale data pipelines
  • Experience supporting production services, including monitoring, incident response, and capacity planning
  • Proficiency in Python and either Rust or Go
  • Strong experience with Kubernetes, Terraform, and cloud infrastructure
  • Experience working in fast-paced engineering environments


Experience with real-time systems, multimedia models, or GPU inference infrastructure is a strong plus.



This is a full-time role based in Seattle, and candidates should be open to working onsite five days per week.


Similar Jobs

Explore other opportunities that match your interests

GenAI Engineer

Programming
โ€ข
7m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

โ€ขโ€ขโ€ขโ€ขโ€ขโ€ข โ€ขโ€ขโ€ขโ€ขโ€ขโ€ข โ€ขโ€ขโ€ขโ€ขโ€ขโ€ข
Job Type โ€ขโ€ขโ€ขโ€ขโ€ขโ€ข
Experience Level โ€ขโ€ขโ€ขโ€ขโ€ขโ€ข

Abridge

United State

Autonomy Software Engineer Lead

Programming
โ€ข
15m ago

Premium Job

Sign up is free! Login or Sign up to view full details.

โ€ขโ€ขโ€ขโ€ขโ€ขโ€ข โ€ขโ€ขโ€ขโ€ขโ€ขโ€ข โ€ขโ€ขโ€ขโ€ขโ€ขโ€ข
Job Type โ€ขโ€ขโ€ขโ€ขโ€ขโ€ข
Experience Level โ€ขโ€ขโ€ขโ€ขโ€ขโ€ข

Skydio

United State
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Associate

BeaconFire Inc.

United State

Subscribe our newsletter

New Things Will Always Update Regularly