Senior AI/LLM Engineer

Senior AI / LLM Engineer

Location: 100% Remote (USA)

Employment Type: Full-Time

Final Interview Locations: Nashville, TN

Compensation: Competitive annual base salary (based on experience and location)

About the Role

We are seeking a highly skilled Senior AI / LLM Engineer to design and build next-generation AI systems that power intelligent, production-grade enterprise solutions. This role is ideal for someone passionate about AI agents, RAG architectures, scalable inference systems, and integrating LLM-powered applications into real-world business workflows.

You will work closely with product, engineering, and domain stakeholders to transform fragmented data into actionable, trustworthy intelligence using cutting-edge AI technologies.

Key Responsibilities

• Design and implement AI agent systems using frameworks such as LangGraph, Semantic Kernel, or custom orchestration architectures
• Build and optimize Retrieval-Augmented Generation (RAG) pipelines leveraging structured, semi-structured, and unstructured data
• Develop AI systems capable of synthesizing fragmented information into prioritized and actionable insights
• Architect and maintain scalable, low-latency inference systems for production environments
• Build evaluation and validation frameworks to ensure AI outputs are accurate, reliable, unbiased, and aligned with source-of-truth data
• Implement and manage vector database infrastructure using Pinecone, Milvus, Weaviate, or similar technologies
• Perform model fine-tuning, PEFT/LoRA optimization, and production model deployment
• Develop high-performance backend services using C#/.NET to integrate AI capabilities with enterprise systems

Interested in remote work opportunities in Devops? Discover Devops Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

• Ensure compliance with security, privacy, and regulatory standards (HIPAA experience is a plus)
• Research and evaluate emerging AI technologies to continuously improve platform capabilities
• Mentor junior engineers and contribute to engineering best practices and technical leadership
• Participate in code reviews and maintain high-quality development standards
• Collaborate cross-functionally with product, clinical, and engineering teams to translate workflows into intelligent AI-driven solutions

Required Qualifications

• Bachelor’s degree preferred
• 5+ years of professional experience in ML/LLM engineering with production-grade systems
• Strong expertise in LLM orchestration, tool calling, AI agents, and long-context document processing
• Hands-on experience with vector databases such as Pinecone, Milvus, or Weaviate
• Experience building and deploying scalable, low-latency AI inference systems
• Strong proficiency in C#/.NET backend development
• Hands-on MLOps experience including Docker, Kubernetes, CI/CD pipelines, and deployment automation
• Strong understanding of data modeling and workflow mapping
• Experience building AI evaluation frameworks and automated testing systems
• Proficiency with Git, Azure DevOps, and modern development workflows
• Experience using JIRA or similar project/task management tools

Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

• Strong analytical, debugging, and problem-solving skills
• Experience with modern AI engineering tools such as GitHub Copilot or Cursor

Nice-to-Have Qualifications

• Healthcare, EHR, claims, or clinical data domain experience
• Familiarity with healthcare interoperability standards such as FHIR or HL7
• Experience working within regulated environments and HIPAA-compliant systems

Why Join Us?

• Fully remote opportunity
• Work on cutting-edge AI and agentic systems
• High-impact engineering environment
• Opportunity to influence architecture and AI strategy
• Collaborative and innovation-focused culture

If you are passionate about building intelligent AI systems at scale and solving complex real-world challenges, we’d love to hear from you.