We're seeking an experienced Senior Kernel Engineer to design, implement, and maintain high-performance kernels. As a key member of our team, you will be responsible for optimizing kernels to accelerate throughput and latency during training and inference. You will work closely with our team to achieve our mission of building safe AGI that accelerates humanity's progress.
Key Highlights
Key Responsibilities
Technical Skills Required
Benefits & Perks
Job Description
Magic’s mission is to build safe AGI that accelerates humanity’s progress on the world’s most important problems. We believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more reliably than humans can alone. Our approach combines frontier-scale pre-training, domain-specific RL, ultra-long context, and inference-time compute to achieve this goal.
About the role:
As a Kernel Engineer, you will design, implement, and maintain high-performance kernels to optimize throughput and latency during training and inference.
Magic's long-context windows create distinct kernel optimization challenges around memory utilization, data movement, and sustained throughput.
Shared expectations
- Design and implement kernels that support high-performance long-context behavior
- Ownership of kernel design, implementation, deployment, and production reliability
- Focus on robustness, extensive testing, and functional correctness, while pushing on performance
- Strong depth over shallow breadth: for kernel engineering, we prefer candidates with deep expertise in computer architecture, low-level machine optimizations, and code generation, with breadth across ML
Looking to advance your Development & Programming career with relocation support? Explore Development & Programming Jobs with Relocation Packages that include comprehensive packages to help you move and settle in your new role.
- Design, develop and optimize custom high-performance GPU kernels
- Evaluate porting Magic’s compute kernels to alternative hardware options
- Co-design kernel with understanding and interaction with training, inference, and RL teams
- For a sample of our work, see Magic-Attention, presented at GTC 2026
- Low-level programming experience targeting AI accelerators such as NVIDIA Blackwell or Google TPUs
- Develop and optimize GPU kernels in frameworks such as NCCL, MSCCLPP, CUTLASS, CuTeDSL, Triton, Quack, Flash-Attention, and similar frameworks
- Experience in other kernel authoring frameworks such as Pallas/Mosaic (GPU or TPU), or Mojo also maps well to the work on Magic's kernel team
- Agility, ownership mindset, and grit
Discover our full range of relocation jobs with comprehensive support packages to help you relocate and settle in your new location.
Our culture:
- Integrity. Words and actions should be aligned
- Hands-on. At Magic, everyone is building
- Teamwork. We move as one team, not N individuals
- Focus. Safely deploy AGI. Everything else is noise
- Quality. Magic should feel like magic
Interested in relocating to United State? Check out our comprehensive Relocation Jobs in United State page with detailed relocation packages and benefits.
- Annual salary ranges between $225K - $550K based on experience
- Equity is a significant part of total compensation, in addition to salary
- 401(k) plan with 6% salary matching
- Generous health, dental and vision insurance for you and your dependents
- Unlimited paid time off
- Visa sponsorship and relocation stipend to bring you to SF, if possible
- A small, fast-paced, highly focused team
Similar Jobs
Explore other opportunities that match your interests
BeaconFire Inc.
Bright Vision Technologies
Senior Gameplay Engineer, Diablo