N

Tech Lead - AI Backend Platform & Kubernetes GPU Orchestration

nebul Netherlands
Visa Sponsorship
Apply
AI Summary

Lead the architecture and development of a scalable AI backend platform on Kubernetes and GPU infrastructure. Design and implement backend systems, APIs, and orchestration services for LLM inference, model serving, and distributed AI workloads. Guide engineering teams to ensure reliability, scalability, and maintainability of production-grade AI systems.

Key Highlights
Build and lead the backend architecture for Europe’s sovereign AI cloud platform
Design scalable microservices, APIs, and GPU orchestration systems for AI workloads
Hands-on technical leadership with Go, Kubernetes, and distributed systems in production
Key Responsibilities
Design and architect scalable backend systems and APIs for AI workloads running on Kubernetes and GPU infrastructure
Lead technical decisions for microservices, asynchronous workflows, state management, and distributed systems primarily using Go
Guide engineering teams, lead design discussions, and set engineering standards for reliability, observability, testing, and maintainability
Collaborate with AI, platform, infrastructure, and networking engineers to ensure seamless integration between software and infrastructure layers
Identify and resolve bottlenecks to prevent scaling issues in production AI systems
Build and maintain LLM inference, model serving, and distributed AI application systems
Ensure fault tolerance, idempotency, and high availability in production AI workloads
Technical Skills Required
Go Kubernetes Distributed Systems
Benefits & Perks
Visa sponsorship for eligible candidates
Travel to Leiden office
Nice to Have
Python
LLM inference
Model serving
AI agents
RAG
GPU workloads
Kubernetes controllers
NVIDIA infrastructure
vLLM
Triton
KServe
Ray
Kafka
NATS
Redis
OpenTelemetry

Job Description


About Nebul

At Nebul, we’re building Europe’s sovereign AI cloud — secure, high-performance and purpose-built as a European alternative to the American hyperscalers.

Our NeoCloud platform runs on Nebul-owned infrastructure and open-source technologies, giving us control from the hardware layer all the way through to the AI and cloud services our customers use.


Within our AI engineering teams, we’re building the backend and platform capabilities needed to run modern AI workloads at scale. That means everything from LLM inference and model serving to Kubernetes-based services, GPU orchestration and distributed AI applications.

We’re looking for a Tech Lead – AI Backend, Kubernetes & GPU Platform who combines strong backend engineering experience with hands-on technical leadership.


What You’ll Be Doing

This is a deeply technical role. You’ll help shape the architecture behind our AI platform, while staying close to the software being built.

Your focus will be on designing scalable backend systems, APIs and orchestration services that allow AI workloads to run reliably across Kubernetes and GPU infrastructure. You’ll work on systems supporting LLM inference, model serving, AI applications, multi-tenant environments and distributed GPU workloads.

You’ll lead architectural decisions around microservices, APIs, asynchronous workflows, state management and distributed systems, primarily using Go. You’ll work closely with AI, platform, infrastructure and networking engineers to make sure the software and infrastructure layers work together as one system.

This is not an ML research role and you do not need to be a machine-learning scientist. You do, however, need to understand how modern LLMs and AI applications behave in production and what that means for scalability, availability, networking and GPU utilisation.

Alongside building software yourself, you’ll guide engineers, lead design discussions, identify bottlenecks before they become scaling problems and help set the engineering standards for reliability, observability, testing and maintainability.


What You Bring

You have extensive backend engineering experience and strong production experience with Go / Golang — this is a must-have.

You’ve worked as a Senior, Staff, Principal, Lead Engineer or Tech Lead and have designed large-scale microservices and distributed systems in production. You understand APIs, service-to-service communication, asynchronous processing, databases, queues, caching, retries, idempotency and fault tolerance.

You’re comfortable working in Kubernetes and cloud-native environments and understand Kubernetes beyond simply deploying applications. Most importantly, you can take ownership of complex technical problems, create clear architectural direction and help other engineers make better technical decisions.


Experience with Python, LLM inference, model serving, AI agents, RAG, GPU workloads, Kubernetes controllers, NVIDIA infrastructure, vLLM, Triton, KServe, Ray, Kafka, NATS, Redis or OpenTelemetry would be a strong advantage.


This Role Is Not

This is not a traditional Engineering Manager, Scrum, DevOps or ML research role. You won’t spend your days managing delivery plans, training foundation models, manually provisioning infrastructure or writing endless Terraform and YAML.

Your primary responsibility is technical leadership across backend software and AI platform engineering.


Eligibility

You must already live and work in the Netherlands and be able to travel to our Leiden office. We offer visa sponsorship, but only for candidates who are already based in the Netherlands.

English fluency is required. Dutch is not.


Build the Backend Behind Europe’s AI Infrastructure

Running AI in production is about much more than the model. It requires scalable backend architecture, intelligent orchestration, reliable distributed systems and infrastructure capable of handling demanding GPU workloads.


If that is the kind of engineering challenge you enjoy, we’d like to hear from you.

Apply through Frank Poll and help us build the technology powering Europe’s sovereign AI future.


Similar Jobs

Explore other opportunities that match your interests

Senior Data Migration Lead - Dynamics 365 F&O

Programming
6h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

HSO

Netherlands

Software Engineer - Livestock Farming Digital Solutions

Programming
7h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

wageningen university & resear...

Netherlands

Software Engineer - Livestock Farming Digital Solutions

Programming
7h ago

Premium Job

Sign up is free! Login or Sign up to view full details.

•••••• •••••• ••••••
Job Type ••••••
Experience Level ••••••

cpte wur

Netherlands

Subscribe our newsletter

New Things Will Always Update Regularly