C

Senior AI Engineer, Enterprise LLM Platform (Hybrid, New York)

Confidential United State
Visa Sponsorship
Apply
AI Summary

Build and deploy a custom, production-grade AI/LLM platform for regulated enterprises, ensuring full infrastructure control and compliance. Own end-to-end technical architecture, deployment, and reliability for marquee enterprise customers, collaborating closely with core engineering teams. Requires 6-12 years of backend/AI engineering experience with LLM deployment expertise in high-stakes environments.

Key Highlights
End-to-end ownership of a custom AI/LLM platform for regulated enterprises (e.g., top 5 US banks)
High-impact role with direct collaboration on product architecture and customer-facing technical leadership
Focus on security, compliance, and customization for enterprise-grade deployments within customer environments
Key Responsibilities
Design and implement a custom AI/LLM platform tailored for enterprise environments with strict security and compliance requirements
Fork and customize the core platform for customer-specific deployments while merging changes into the main product
Serve as the primary technical point of contact for the enterprise customer’s engineering stakeholders (~20% customer-facing)
Ensure production reliability, scalability, and performance of the LLM platform in regulated environments
Collaborate with the core engineering team to define and implement architecture, APIs, and integrations
Technical Skills Required
Large Language Models (LLM) Backend Engineering System Design
Benefits & Perks
$200K–$350K annual salary + competitive equity
Hybrid work location (New York, NY)
Visa sponsorship for OPT/H1B transfers
Nice to Have
Experience with Kubernetes
CI/CD and observability tooling expertise
Cloud infrastructure (e.g., AWS) knowledge

Job Description


AI Engineer, Enterprise LLM Platform


Company: Series A, VC backed - Applied AI / Enterprise Software

Location: Hybrid, New York, NY

Salary: $200K–$350K + competitive equity

Sponsorship: open to visa transfers (OPT, H1B)


We're hiring an AI Engineer at a fast-moving, well-funded Series A startup building a custom AI/LLM platform for regulated enterprises, starting with one of the top 5 banks in the US, a seven-figure deal already closed. The founding team are repeat entrepreneurs on their second venture together, with deep technical and applied AI research backgrounds.


This is a high-ownership role, not a narrow slice of a larger stack. You'll own the technical build-out of a custom AI/LLM platform end-to-end, architecture, deployment, and production reliability, for a marquee enterprise customer, working directly with the core engineering team.


The problem you'd help solve: Regulated enterprises need production-grade AI deployed entirely within their own environment, with no data leaving their infrastructure. This company builds a workflow intelligence platform that understands how employees work and augments it with custom, self-hosted AI models, deployed per customer, with full infrastructure control. It's a fundamentally harder deployment problem than typical SaaS AI, since security, compliance, and customization requirements are set by the enterprise, not the vendor.


You'll fork and customize the core platform for the customer's environment, collaborate daily with the core engineering team to merge customer-specific work into the main product, and serve as the go-to technical point of contact for the bank's engineering stakeholders (~20% customer-facing).


You'll likely be a fit if you have:

  • 6-12 years of backend/AI engineering experience, building and deploying LLM systems in production
  • Recent experience (past 2-3 years) at a well-funded, actively-innovating AI startup, not exclusively Big Tech
  • Backend engineering ownership for enterprise customers: architecture, APIs, integrations, deployments
  • Strong software architecture and system design ability, comfortable owning end-to-end technical delivery
  • Experience with enterprise customers in banking, fintech, or other regulated environments
  • BS in Computer Science or related field


Nice to have:

  • Cloud, Kubernetes, CI/CD, and observability tooling experience
  • High ownership, independence, and leadership potential


What you won't find here: This role won't suit you if you want a well-scoped ticket and someone else making the architecture calls, or if your background is purely academic AI research with no production deployment experience. You'll be setting technical precedent that the team and the customer both build on.


Sponsorship: open to visa transfers (e.g. OPT, H1B). Hybrid role based in New York, NY.


Seniority Level: Mid-Senior level


Industry:

  • Artificial Intelligence
  • Financial Services
  • Technology, Information and Internet


Employment Type: Full-time


Skills:

  • Python
  • Machine Learning
  • Natural Language Processing (NLP)
  • Large Language Models (LLM)
  • Kubernetes
  • CI/CD
  • Amazon Web Services (AWS)
  • REST APIs
  • Cloud Computing
  • System Design

Similar Jobs

Explore other opportunities that match your interests

Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

Stealth Startup

United State
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

Stealth Startup

United State
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Entry level

BeaconFire Inc.

United State

Subscribe our newsletter

New Things Will Always Update Regularly