AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

Modalinference provider

New York · San Francisco · $150K–$350K/year · unknown

inferencespeculative-decodingkv-cache-systemsquantizationresearch-engineer

posted 3mo ago · verified 3d ago

Fireworks AIinference provider

London · hybrid · unknown

fine-tuninginferencepost-trainingpython-langgpu-generic

posted 8w ago · verified 3d ago

Fireworks AIinference provider

Greater Seattle Area · New York +1 more · hybrid · $175K–$220K/year · unknown

python-langsoftware-engineergo-langinferenceinference-engines

posted 12mo ago · verified 3d ago

Fireworks AIinference provider

San Mateo · hybrid · $175K–$220K/year · unknown

gpu-kernelsperformance-engineercudagpu-genericsoftware-engineer

posted 18mo ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · Seattle, WA · $180K–$440K/year est. · unknown

cpp-langinferenceinference-enginessoftware-engineerdistributed-inference

posted 25mo ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · $180K–$440K/year est. · unknown

inferenceinference-enginespython-langreinforcement-learningcpp-lang

posted 3mo ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · $180K–$440K/year est. · senior

post-trainingpre-trainingpython-langsoftware-engineertraining-data-infra

posted 6mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $188K–$275K/year est. · staff plus

inferenceinference-enginesdistributed-inferencegpu-generickubernetes-ops

posted 5mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $152K–$204K/year est. · senior

cudadistributed-inferencego-langgpu-genericgpu-kernels

posted 13mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $139K–$204K/year est. · senior

software-engineerinferenceinference-engineskubernetes-opsgpu-generic

posted 9mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $206K–$333K/year est. · staff plus

cudaperformance-engineergpu-genericinferenceinference-engines

posted 10mo ago · verified 3d ago

OpenAIfrontier lab

San Francisco · Seattle · hybrid · $293K–$385K/year · unknown

evaluationgpu-kernelsinferencesoftware-engineercollectives

posted 6mo ago · verified 3d ago

OpenAIfrontier lab

San Francisco · $266K–$500K/year · unknown

inferenceinference-enginesperformance-engineersoftware-engineergpu-generic

posted 6mo ago · verified 3d ago

OpenAIfrontier lab

San Francisco · Seattle · hybrid · $293K–$385K/year · senior

collectivescpp-langcudadistributed-inferencegpu-generic

posted 7mo ago · verified 3d ago

OpenAIfrontier lab

San Francisco · $295K–$555K/year · unknown

gpu-genericinferenceinference-enginessoftware-engineerdistributed-inference

posted 17mo ago · verified 3d ago

OpenAIfrontier lab

San Francisco · $266K–$500K/year · unknown

cudainferenceinference-enginesnvidiasoftware-engineer

posted 21mo ago · verified 3d ago

Anthropicfrontier lab

Dublin, IE · €295K–€355K · staff plus

inferenceinference-enginessoftware-engineerdistributed-inferencekubernetes-ops

posted 7mo ago · verified 3d ago

Anthropicfrontier lab

London, UK · £325K–£390K · staff plus

inferenceinference-enginespython-langdistributed-inferencekubernetes-ops

posted 9mo ago · verified 3d ago

Anthropicfrontier lab

New York City, NY · San Francisco, CA +1 more · $320K–$485K · staff plus

inferenceinference-enginesdistributed-inferencescheduling-orchestrationsoftware-engineer

posted 4mo ago · verified 3d ago

Anthropicfrontier lab

New York City, NY · San Francisco, CA +1 more · $320K–$485K · staff plus

inferenceinference-enginessoftware-engineerdistributed-inferencescheduling-orchestration

posted 4mo ago · verified 3d ago

Anthropicfrontier lab

San Francisco, CA · $315K–$560K · senior

python-langinferenceinference-enginesml-platformpytorch-dist

posted 11mo ago · verified 3d ago

Anthropicfrontier lab

New York City, NY · San Francisco, CA +1 more · $350K–$850K · unknown

performance-engineerinferenceinference-enginesobservabilitypython-lang

posted 5mo ago · verified 3d ago

Anthropicfrontier lab

New York City, NY · Remote-Friendly US (Travel Required) +2 more · $280K–$850K · unknown

performance-engineergpu-kernelsinferenceinference-enginescluster-datacenter

posted 30mo ago · verified 3d ago

Anthropicfrontier lab

New York City, NY · San Francisco, CA · $350K–$500K · unknown

ml-platformpython-langsoftware-engineerevaluationinference

posted 3mo ago · verified 3d ago

Nebiusneocloud

Palo Alto · Palo Alto, California, United States · $195K–$262K · senior

model-parallelismpost-trainingpytorch-distreinforcement-learningtraining-frameworks

posted 3mo ago · verified 3d ago

Nebiusneocloud

Palo Alto, California, United States · San Francisco Bay Area · $195K–$262K · senior

inferenceinference-engineskv-cache-systemsquantizationsglang-engine

posted 3mo ago · verified 3d ago

Nebiusneocloud

Palo Alto, California, United States · San Francisco Bay Area · $195K–$262K · senior

cudadistributed-inferencegpu-genericinferencekv-cache-systems

posted 3mo ago · verified 3d ago

Nebiusneocloud

Amsterdam · Amsterdam, Netherlands +3 more · remote · $200–$350K · senior

solutions-architectinference-enginesml-platformgpu-genericinference

posted 7mo ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Czech Republic +5 more · remote · unknown

cudagpu-genericgpu-kernelsnccl-libperformance-engineer

posted 5mo ago · verified 3d ago

Nebiusneocloud

Remote - United States · United States · remote · $170K–$300K · manager

gpu-genericperformance-engineercluster-datacentercpp-langinfiniband-ops

posted 6mo ago · verified 3d ago