AI infrastructure roles, filterable by the stack you actually work on.

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · mid

trainiuminferencepost-trainingreinforcement-learningsglang-engine

posted 5d ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · senior

inferencepython-langsoftware-engineercpp-langdistributed-inference

posted 4d ago · verified 3d ago

Lila Sciencesai startup

Alewife, Cambridge, MA · Cambridge, MA USA +2 more · $204K–$348K · manager

eng-managerinferenceinference-engineskv-cache-systemsquantization

posted 5d ago · verified 3d ago

Boson AIfrontier lab

Toronto · hybrid · CA$70K–CA$100K · junior

cudagpu-kernelsinferenceinference-enginesquantization

posted 8d ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · mid

inferenceinference-enginespost-trainingreinforcement-learningtraining-frameworks

posted 9d ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +5 more · staff plus

inferenceinference-enginesgpu-generickv-cache-systemsperformance-engineer

posted 10d ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $131K–$197K · junior

inferenceperformance-engineercpp-langcudapython-lang

posted 11d ago · verified 3d ago

OpenAIfrontier lab

San Francisco · hybrid · $380K–$500K/year · unknown

inferencetpuinference-enginesperformance-engineergpu-kernels

posted 11d ago · verified 3d ago

Mistral AIfrontier lab

London · Paris · unknown

inferenceinference-enginespython-langquantizationresearch-engineer

posted 11d ago · verified 3d ago

Waymoenterprise

Mountain View, California, United States · Mountain View (US-MTV-EMF680) +1 more · $251K–$310K · staff plus

model-parallelismperformance-engineerpython-langquantizationgpu-generic

posted 4mo ago · verified 3d ago

Mirageai startup

Union Square, New York City · $175K–$300K/year · mid

cudagpu-genericgpu-kernelsquantizationresearch-engineer

posted 4w ago · verified 3d ago

Prime Intellectneocloud

Remote · San Francisco · unknown

inferenceinference-enginesresearch-engineervllm-enginedistributed-inference

posted 15d ago · verified 3d ago

Anthropicfrontier lab

New York City, NY · San Francisco, CA +1 more · $290K–$435K · senior

gpu-genericinferenceinference-enginestputrainium

posted 17d ago · verified 3d ago

Amazon (AWS)hyperscaler

Culver City, California, USA · New York, New York, USA · onsite · senior

gpu-genericinferencekubernetes-opsscheduling-orchestrationsoftware-engineer

posted 19d ago · verified 3d ago

Nebiusneocloud

Remote - Europe · Zurich, Switzerland · senior

distributed-inferenceinferenceinference-engineskv-cache-systemspython-lang

posted 19d ago · verified 3d ago

Nebiusneocloud

London, United Kingdom · Remote - Europe · senior

distributed-inferenceinferenceinference-engineskv-cache-systemspython-lang

posted 19d ago · verified 3d ago

Nebiusneocloud

Berlin, Germany · Remote - Europe · senior

distributed-inferencegpu-genericinferenceinference-engineskv-cache-systems

posted 19d ago · verified 3d ago

Nebiusneocloud

Remote - United States · United States · $208K–$261K · staff plus

solutions-architectfine-tuninginferenceinference-engineskv-cache-systems

posted 3w ago · verified 3d ago

Reactorinference provider

San Francisco · onsite · unknown

cpp-langgpu-genericinferenceinference-enginespython-lang

added 3w ago · verified 3d ago

Cerebraschip vendor

Bengaluru, IND · hybrid · unknown

cpp-langinferencemlir-llvmpython-langinference-engines

posted 3w ago · verified 3d ago

DigitalOceanneocloud

DigitalOcean Seattle Office · Seattle · $250K–$312K/year est. · staff plus

amdcpp-langcudacutlass-cutedistributed-inference

posted 3w ago · verified 3d ago

DoorDashenterprise

San Francisco, CA · Seattle, WA +1 more · $131K–$192K · unknown

fine-tuninggpu-genericinferenceinference-enginesml-platform

posted 3w ago · verified 3d ago

Hedraai startup

San Francisco · unknown

cudatriton-langgpu-kernelsinferencegpu-generic

posted 3w ago · verified 3d ago

River AIfrontier lab

HQ · Palo Alto, CA · $200K–$420K/year est. · unknown

cpp-langcudacutlass-cutefine-tuninggpu-kernels

posted 7w ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $240K–$270K/year · manager

eng-managerinference-enginesgpu-genericgpu-kernelsinference

posted 3w ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · senior

trainiumpython-langquantizationresearch-engineergpu-kernels

posted 3w ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · mid

inferenceinference-enginessglang-enginesoftware-engineertrainium

posted 3w ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $180K–$360K/year · unknown

inferenceinference-enginesperformance-engineerquantizationspeculative-decoding

posted 3w ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +6 more · senior

inferenceinference-enginesquantizationresearch-engineercuda

posted 4w ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · hybrid · unknown

performance-engineerpython-langcpp-langgpu-kernelsmodel-parallelism

posted 4w ago · verified 3d ago