AI infrastructure roles, filterable by the stack you actually work on.
Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.
1538 open roles · 87 companies · last verified 3d ago
47 roles
Lila Sciencesai startup
Alewife, Cambridge, MA · Cambridge, MA USA +2 more · $204K–$348K · manager
eng-managerinferenceinference-engineskv-cache-systemsquantization
posted 5d ago · verified 3d ago
Reactorinference provider
San Francisco · onsite · unknown
distributed-inferenceinferencekubernetes-opsnvidiascheduling-orchestration
added 9d ago · verified 3d ago
Waymoenterprise
Mountain View, California, United States · Mountain View (US-MTV-EMF680) +1 more · $251K–$310K · staff plus
model-parallelismperformance-engineerpython-langquantizationgpu-generic
posted 4mo ago · verified 3d ago
Waymoenterprise
Mountain View, CA, USA · Mountain View (US-MTV-EMF680) +2 more · $251K–$310K · staff plus
model-parallelismtpujax-pallasml-platformreinforcement-learning
posted 10mo ago · verified 3d ago
Prime Intellectneocloud
Remote · San Francisco · unknown
gpu-genericgpu-kernelsmodel-parallelismpytorch-distreinforcement-learning
posted 13d ago · verified 3d ago
Cerebraschip vendor
Bengaluru, IND · hybrid · unknown
cpp-langinferencemlir-llvmpython-langinference-engines
posted 3w ago · verified 3d ago
DigitalOceanneocloud
DigitalOcean Seattle Office · Seattle · $250K–$312K/year est. · staff plus
gpu-genericnccl-libnetwork-fabricnvidianvlink-topology
posted 3w ago · verified 3d ago
River AIfrontier lab
HQ · Palo Alto, CA · $200K–$420K/year est. · unknown
fine-tuninggpu-genericpython-langreinforcement-learningsoftware-engineer
posted 7w ago · verified 3d ago
Amazon (AWS)hyperscaler
Cupertino, California, USA · onsite · mid
software-engineertrainiummodel-parallelismpost-trainingpre-training
posted 3w ago · verified 3d ago
Mistral AIfrontier lab
London · Munich +1 more · hybrid · unknown
inferenceinference-enginescudadistributed-inferencegpu-generic
posted 3w ago · verified 3d ago
Anthropicfrontier lab
New York City, NY · San Francisco, CA +1 more · $500K–$850K · unknown
python-langreinforcement-learningresearch-engineerjax-pallasmodel-parallelism
posted 4w ago · verified 3d ago
Cerebraschip vendor
Sunnyvale, CA · hybrid · unknown
performance-engineerpython-langcpp-langgpu-kernelsmodel-parallelism
posted 4w ago · verified 3d ago
Amazon (AWS)hyperscaler
Cupertino, California, USA · onsite · senior
software-engineertrainiummodel-parallelismcollectivesjax-pallas
posted 5w ago · verified 3d ago
Amazon (AWS)hyperscaler
Cupertino, California, USA · onsite · senior
trainiummodel-parallelismsoftware-engineerpost-trainingreinforcement-learning
posted 5w ago · verified 3d ago
Amazon (AWS)hyperscaler
Cupertino, California, USA · onsite · mid
software-engineertrainiumcollectivescpp-langfine-tuning
posted 5w ago · verified 3d ago
Nscaleneocloud
Houston · New York +2 more · $220K–$330K · staff plus
inferenceinference-engineskv-cache-systemspost-trainingpython-lang
posted 6w ago · verified 3d ago
Amazon (AWS)hyperscaler
Austin, Texas, USA · Dallas, Texas, USA +2 more · onsite · staff plus
cluster-datacentercollectivesdeepspeed-libdistributed-inferenceefa-fabric
posted 3mo ago · verified 3d ago
Inferactinference provider
San Francisco · onsite · junior
amdcudagpu-kernelsinferenceinference-engines
posted 6w ago · verified 3d ago
Black Forest Labsfrontier lab
Freiburg (Germany) · onsite · unknown
fine-tuningfsdpgpu-genericgpu-kernelsmodel-parallelism
posted 25mo ago · verified 3d ago
Together AIneocloud
San Francisco · $270K–$300K/year est. · senior
inference-engineskv-cache-systemspython-langspeculative-decodinginference
posted 5mo ago · verified 3d ago
Cognitionai startup
San Francisco · onsite · unknown
cpp-langgpu-genericmodel-parallelismpython-langresearch-engineer
posted 12w ago · verified 3d ago
Reflection AIfrontier lab
London · New York, NY +1 more · onsite · unknown
pre-trainingsoftware-engineerdeepspeed-libgpu-genericmodel-parallelism
posted 7mo ago · verified 3d ago
Prime Intellectneocloud
Remote · San Francisco · unknown
collectivesdeepspeed-libfsdpgpu-genericgpu-kernels
posted 3mo ago · verified 3d ago
Thinking Machines Labfrontier lab
San Francisco · onsite · unknown
reinforcement-learningpython-langresearch-engineerinference-enginesdistributed-inference
posted 10w ago · verified 3d ago
Thinking Machines Labfrontier lab
San Francisco · onsite · unknown
cudagpu-kernelstriton-langresearch-engineergpu-generic
posted 12w ago · verified 3d ago
Thinking Machines Labfrontier lab
San Francisco · onsite · unknown
gpu-kernelsmodel-parallelismquantizationresearch-engineercollectives
posted 12w ago · verified 3d ago
Amazon (AWS)hyperscaler
Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior
gpu-kernelsinferenceinference-engineskv-cache-systemsperformance-engineer
posted 9w ago · verified 3d ago
OpenAIfrontier lab
San Francisco · hybrid · $266K–$445K/year · unknown
software-engineerinference-enginesinferencekv-cache-systemsscheduling-orchestration
posted 9w ago · verified 3d ago
Amazon (AWS)hyperscaler
Austin, Texas, USA · onsite · mid
performance-engineercustom-asicjax-pallaspre-trainingpytorch-dist
posted 5mo ago · verified 3d ago
Amazon (AWS)hyperscaler
Cupertino, California, USA · Seattle, Washington, USA · onsite · mid
trainiummodel-parallelismtraining-frameworkscollectivesperformance-engineer
posted 11w ago · verified 3d ago