AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

47 roles

model-parallelism ✕

Lila Sciencesai startup

Alewife, Cambridge, MA · Cambridge, MA USA +2 more · $204K–$348K · manager

eng-managerinferenceinference-engineskv-cache-systemsquantization

posted 5d ago · verified 3d ago

Waymoenterprise

Mountain View, California, United States · Mountain View (US-MTV-EMF680) +1 more · $251K–$310K · staff plus

model-parallelismperformance-engineerpython-langquantizationgpu-generic

posted 4mo ago · verified 3d ago

Waymoenterprise

Mountain View, CA, USA · Mountain View (US-MTV-EMF680) +2 more · $251K–$310K · staff plus

model-parallelismtpujax-pallasml-platformreinforcement-learning

posted 10mo ago · verified 3d ago

Cerebraschip vendor

Bengaluru, IND · hybrid · unknown

cpp-langinferencemlir-llvmpython-langinference-engines

posted 3w ago · verified 3d ago

DigitalOceanneocloud

DigitalOcean Seattle Office · Seattle · $250K–$312K/year est. · staff plus

gpu-genericnccl-libnetwork-fabricnvidianvlink-topology

posted 3w ago · verified 3d ago

River AIfrontier lab

HQ · Palo Alto, CA · $200K–$420K/year est. · unknown

fine-tuninggpu-genericpython-langreinforcement-learningsoftware-engineer

posted 7w ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · mid

software-engineertrainiummodel-parallelismpost-trainingpre-training

posted 3w ago · verified 3d ago

Mistral AIfrontier lab

London · Munich +1 more · hybrid · unknown

inferenceinference-enginescudadistributed-inferencegpu-generic

posted 3w ago · verified 3d ago

Anthropicfrontier lab

New York City, NY · San Francisco, CA +1 more · $500K–$850K · unknown

python-langreinforcement-learningresearch-engineerjax-pallasmodel-parallelism

posted 4w ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · mid

software-engineertrainiumcollectivescpp-langfine-tuning

posted 5w ago · verified 3d ago

Nscaleneocloud

Houston · New York +2 more · $220K–$330K · staff plus

inferenceinference-engineskv-cache-systemspost-trainingpython-lang

posted 6w ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · junior

amdcudagpu-kernelsinferenceinference-engines

posted 6w ago · verified 3d ago

Black Forest Labsfrontier lab

Freiburg (Germany) · onsite · unknown

fine-tuningfsdpgpu-genericgpu-kernelsmodel-parallelism

posted 25mo ago · verified 3d ago

Together AIneocloud

San Francisco · $270K–$300K/year est. · senior

inference-engineskv-cache-systemspython-langspeculative-decodinginference

posted 5mo ago · verified 3d ago

Cognitionai startup

San Francisco · onsite · unknown

cpp-langgpu-genericmodel-parallelismpython-langresearch-engineer

posted 12w ago · verified 3d ago

Reflection AIfrontier lab

London · New York, NY +1 more · onsite · unknown

pre-trainingsoftware-engineerdeepspeed-libgpu-genericmodel-parallelism

posted 7mo ago · verified 3d ago

Prime Intellectneocloud

Remote · San Francisco · unknown

collectivesdeepspeed-libfsdpgpu-genericgpu-kernels

posted 3mo ago · verified 3d ago

Thinking Machines Labfrontier lab

San Francisco · onsite · unknown

cudagpu-kernelstriton-langresearch-engineergpu-generic

posted 12w ago · verified 3d ago

Amazon (AWS)hyperscaler

Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior

gpu-kernelsinferenceinference-engineskv-cache-systemsperformance-engineer

posted 9w ago · verified 3d ago

OpenAIfrontier lab

San Francisco · hybrid · $266K–$445K/year · unknown

software-engineerinference-enginesinferencekv-cache-systemsscheduling-orchestration

posted 9w ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · Seattle, Washington, USA · onsite · mid

trainiummodel-parallelismtraining-frameworkscollectivesperformance-engineer

posted 11w ago · verified 3d ago