Senior AI Engineer, Enterprise LLM Platform (Hybrid, New York)
Build and deploy a custom, production-grade AI/LLM platform for regulated enterprises, ensuring full infrastructure control and compliance. Own end-to-end technical architecture, deployment, and reliability for marquee enterprise customers, collaborating closely with core engineering teams. Requires 6-12 years of backend/AI engineering experience with LLM deployment expertise in high-stakes environments.
Key Highlights
Key Responsibilities
Technical Skills Required
Benefits & Perks
Nice to Have
Job Description
AI Engineer, Enterprise LLM Platform
Company: Series A, VC backed - Applied AI / Enterprise Software
Location: Hybrid, New York, NY
Salary: $200K–$350K + competitive equity
Sponsorship: open to visa transfers (OPT, H1B)
We're hiring an AI Engineer at a fast-moving, well-funded Series A startup building a custom AI/LLM platform for regulated enterprises, starting with one of the top 5 banks in the US, a seven-figure deal already closed. The founding team are repeat entrepreneurs on their second venture together, with deep technical and applied AI research backgrounds.
This is a high-ownership role, not a narrow slice of a larger stack. You'll own the technical build-out of a custom AI/LLM platform end-to-end, architecture, deployment, and production reliability, for a marquee enterprise customer, working directly with the core engineering team.
The problem you'd help solve: Regulated enterprises need production-grade AI deployed entirely within their own environment, with no data leaving their infrastructure. This company builds a workflow intelligence platform that understands how employees work and augments it with custom, self-hosted AI models, deployed per customer, with full infrastructure control. It's a fundamentally harder deployment problem than typical SaaS AI, since security, compliance, and customization requirements are set by the enterprise, not the vendor.
Searching for Development & Programming roles that provide visa sponsorship? Connect with international employers through Development & Programming Jobs with Visa Sponsorship opportunities actively seeking talented professionals.
You'll fork and customize the core platform for the customer's environment, collaborate daily with the core engineering team to merge customer-specific work into the main product, and serve as the go-to technical point of contact for the bank's engineering stakeholders (~20% customer-facing).
You'll likely be a fit if you have:
- 6-12 years of backend/AI engineering experience, building and deploying LLM systems in production
- Recent experience (past 2-3 years) at a well-funded, actively-innovating AI startup, not exclusively Big Tech
- Backend engineering ownership for enterprise customers: architecture, APIs, integrations, deployments
- Strong software architecture and system design ability, comfortable owning end-to-end technical delivery
- Experience with enterprise customers in banking, fintech, or other regulated environments
- BS in Computer Science or related field
Nice to have:
- Cloud, Kubernetes, CI/CD, and observability tooling experience
- High ownership, independence, and leadership potential
Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.
What you won't find here: This role won't suit you if you want a well-scoped ticket and someone else making the architecture calls, or if your background is purely academic AI research with no production deployment experience. You'll be setting technical precedent that the team and the customer both build on.
Sponsorship: open to visa transfers (e.g. OPT, H1B). Hybrid role based in New York, NY.
Seniority Level: Mid-Senior level
Industry:
- Artificial Intelligence
- Financial Services
- Technology, Information and Internet
Interested in opportunities specifically in United State? Discover our dedicated Visa Sponsorship Jobs in United State page featuring roles from top employers in this location.
Employment Type: Full-time
Skills:
- Python
- Machine Learning
- Natural Language Processing (NLP)
- Large Language Models (LLM)
- Kubernetes
- CI/CD
- Amazon Web Services (AWS)
- REST APIs
- Cloud Computing
- System Design
Similar Jobs
Explore other opportunities that match your interests