AI infrastructure roles, filterable by the stack you actually work on.

Anyscaleai startup

Palo Alto · San Francisco · hybrid · $170K–$245K/year · unknown

distributed-inferenceinferenceinference-enginessoftware-engineervllm-engine

posted 5mo ago · verified 3d ago

Fireworks AIinference provider

San Mateo · hybrid · $175K–$220K/year · unknown

gpu-kernelsperformance-engineercudagpu-genericsoftware-engineer

posted 18mo ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · Seattle, WA · $180K–$440K/year est. · unknown

cpp-langinferenceinference-enginessoftware-engineerdistributed-inference

posted 25mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $188K–$275K/year est. · staff plus

inferenceinference-enginesdistributed-inferencegpu-generickubernetes-ops

posted 5mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $206K–$333K/year est. · staff plus

cudaperformance-engineergpu-genericinferenceinference-engines

posted 10mo ago · verified 3d ago

OpenAIfrontier lab

San Francisco · Seattle · hybrid · $293K–$385K/year · unknown

evaluationgpu-kernelsinferencesoftware-engineercollectives

posted 6mo ago · verified 3d ago

OpenAIfrontier lab

San Francisco · Seattle · hybrid · $381K–$485K/year · unknown

cpp-langcudagpu-kernelsperformance-engineerpython-lang

posted 7mo ago · verified 3d ago

OpenAIfrontier lab

San Francisco · Seattle · hybrid · $293K–$445K/year · senior

inference-enginesml-platformcpp-langgo-langinference

posted 3mo ago · verified 3d ago

Anthropicfrontier lab

New York City, NY · Remote-Friendly (Travel-Required) +2 more · remote · $405K–$485K · staff plus

tputrainiumgpu-genericsoftware-engineercuda

posted 4mo ago · verified 3d ago

Nebiusneocloud

Austin, Texas, United States · Netherlands +4 more · remote · unknown

cpp-langcudagpu-kernelscutlass-cutegpu-generic

posted 9mo ago · verified 3d ago

Nebiusneocloud

Palo Alto · Palo Alto, California, United States · $195K–$262K · senior

model-parallelismpost-trainingpytorch-distreinforcement-learningtraining-frameworks

posted 3mo ago · verified 3d ago

Nebiusneocloud

Palo Alto, California, United States · San Francisco Bay Area · $195K–$262K · senior

inferenceinference-engineskv-cache-systemsquantizationsglang-engine

posted 3mo ago · verified 3d ago

Nebiusneocloud

Palo Alto, California, United States · San Francisco Bay Area · $195K–$262K · senior

cudadistributed-inferencegpu-genericinferencekv-cache-systems

posted 3mo ago · verified 3d ago

Together AIneocloud

San Francisco · $200K–$300K/year est. · unknown

cudagpu-kernelsperformance-engineerresearch-engineertriton-lang

posted 33mo ago · verified 3d ago

Together AIneocloud

San Francisco · $200K–$290K/year est. · senior

inferenceinference-enginesnvidiasoftware-engineerdistributed-inference

posted 14mo ago · verified 3d ago

Together AIneocloud

San Francisco · $200K–$290K/year est. · unknown

research-engineerfine-tuninggo-langinferenceinference-engines

posted 3mo ago · verified 3d ago

Together AIneocloud

San Francisco · $200K–$290K/year est. · unknown

cudafine-tuningml-platformnccl-libnvidia

posted 3mo ago · verified 3d ago

Together AIneocloud

San Francisco · $200K–$300K/year est. · mid

inferenceinference-enginespython-langpytorch-distsoftware-engineer

posted 29mo ago · verified 3d ago