Lead AI Engineer (LLM & Platform) - Remote Canada

Harvey Nash • Canada
Remote
Apply
AI Summary

Harvey Nash is seeking a Lead AI Engineer to design, build, and scale production-grade AI features, focusing on LLM-powered systems. This hands-on role requires deep AI/ML expertise, strong software engineering fundamentals, and experience with cloud-native architectures. The engineer will architect RAG pipelines, agentic workflows, and scalable Python microservices, while mentoring teams and influencing best practices.

Key Highlights
Design, build, and scale AI-powered features in production environments.
Focus on LLM-powered systems, RAG pipelines, and agentic workflows.
Develop scalable Python microservices and contribute to cloud-native architectures.
Technical Skills Required
Python FastAPI Flask Django Databricks pgVector Docker Kubernetes AWS GCP Azure LangChain Google ADK
Benefits & Perks
100% remote anywhere in Canada
Full-time employment

Job Description


Job Title: Lead AI Engineer (LLM & Platform)

Location: 100% remote anywhere in Canada

Duration: Full-time


Job Description:

Role Overview

We are seeking a highly experienced Lead AI Engineer to design, build, and scale AI-powered features used in production environments. This role is hands-on and execution-focused, combining deep AI/ML expertise with strong software engineering fundamentals. You will play a key role in shaping our AI architecture, validating AI capabilities through experimentation, and delivering reliable, high-quality AI systems at scale.

Key Responsibilities

  • Design, develop, and deploy production-grade AI/ML features, with a strong focus on LLM-powered systems.
  • Architect and implement RAG pipelines, agentic workflows, and AI services using vector databases such as Databricks, pgVector, or equivalent.
  • Build scalable Python-based microservices using frameworks like FastAPI, Flask, or Django.
  • Collaborate with product, data, and engineering teams to translate business problems into effective AI solutions.
  • Define and execute experimentation strategies, including A/B testing, evaluation frameworks, and hypothesis-driven validation of AI features.
  • Ensure high code quality and system reliability through testing, monitoring, observability, and performance optimization.
  • Contribute to cloud-native architectures leveraging AWS, GCP, or Azure, with containerization (Docker/Kubernetes) and CI/CD pipelines.
  • Mentor engineers and influence best practices in AI engineering, architecture, and delivery.

Core Technical Skills

  • 10+ years of software engineering experience, with significant hands-on focus on AI/ML systems in production.
  • Deep expertise in LLMs, including prompt engineering, RAG architectures, and agentic AI frameworks (e.g., LangChain, Google ADK, or similar).
  • Strong proficiency in Python and modern backend frameworks.
  • Solid foundation in statistical methods, data processing, ETL pipelines, and large-scale data workflows.
  • Experience with cloud platforms, container orchestration, and modern DevOps practices.
  • Strong understanding of AI system observability, monitoring, testing, and operational excellence.

Ways You’ll Stand Out (Nice to Have)

  • Experience with model fine-tuning, RLHF, or custom model training.
  • Familiarity with MLOps tools and metrics (e.g., MLflow, precision/recall, model evaluation frameworks).
  • Knowledge of frontend technologies (React) for full-stack contributions.
  • Background in NLP, multimodal AI, document processing, or real-time / streaming AI systems.
  • Open-source contributions, technical writing, or public speaking experience.


Similar Jobs

Explore other opportunities that match your interests

Platform Engineer

Devops
•
1d ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

Shift Markets

Canada
Visa Sponsorship Relocation Remote
Job Type Contract
Experience Level Mid-Senior level

Iris Software Inc.

Canada

Automation Solution Architect

Devops
•
2d ago
Visa Sponsorship Relocation Remote
Job Type Full-time
Experience Level Mid-Senior level

opsmill

Canada

Subscribe our newsletter

New Things Will Always Update Regularly