AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

421 roles

ml-platform ✕

Scale AIai startup

New York, NY · San Francisco, CA +1 more · $190K–$237K · unknown

cudaflash-attentioninference-enginesml-platformresearch-engineer

posted 20mo ago · verified 3d ago

Anyscaleai startup

San Francisco · hybrid · $200K–$240K/year · mid

reliability-sresrego-langkubernetes-opspython-lang

posted 9w ago · verified 3d ago

Anyscaleai startup

San Francisco · hybrid · $215K–$265K/year · staff plus

go-langkubernetes-opspython-langsoftware-engineerray-distributed

posted 5w ago · verified 3d ago

Anyscaleai startup

San Francisco · hybrid · $200K–$240K/year · mid

kubernetes-opsray-distributedsoftware-engineergo-langml-platform

posted 10w ago · verified 3d ago

Anyscaleai startup

Palo Alto · San Francisco · hybrid · $170K–$245K/year · unknown

distributed-inferenceinferenceinference-enginessoftware-engineervllm-engine

posted 5mo ago · verified 3d ago

Anyscaleai startup

Bengaluru, Karnataka · unknown

ray-distributedsoftware-engineercpp-langscheduling-orchestrationml-platform

posted 3mo ago · verified 3d ago

Modalinference provider

New York · San Francisco · $150K–$350K/year · unknown

inferencespeculative-decodingkv-cache-systemsquantizationresearch-engineer

posted 3mo ago · verified 3d ago

Modalinference provider

New York · $275K–$330K/year · manager

eng-managercpp-langrust-langml-platformgpu-generic

posted 9mo ago · verified 3d ago

Modalinference provider

Stockholm · $140K–$200K/year · senior

software-engineerml-platformlinux-kernelperformance-engineersre

posted 9mo ago · verified 3d ago

Modalinference provider

New York · San Francisco · onsite · $180K–$240K/year · mid

kubernetes-opssolutions-architectterraform-iacscheduling-orchestrationgpu-generic

posted 13mo ago · verified 3d ago

Fireworks AIinference provider

Greater Seattle Area · New York +1 more · hybrid · $175K–$220K/year · unknown

python-langsoftware-engineergo-langinferenceinference-engines

posted 12mo ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo · hybrid · $175K–$220K/year · senior

software-engineerkubernetes-opsml-platformpython-langobservability

posted 16mo ago · verified 3d ago

Fireworks AIinference provider

Greater Seattle Area · New York +2 more · hybrid · $210K–$320K/year · unknown

fsdpkubernetes-opsmodel-parallelismsoftware-engineertraining-frameworks

posted 3mo ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · $150K–$450K/year est. · unknown

jax-pallaskubernetes-opspytorch-distsoftware-engineerevaluation

posted 7mo ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · $180K–$440K/year est. · unknown

gpu-genericpython-langsoftware-engineernvidiacluster-datacenter

posted 3mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $188K–$275K/year est. · staff plus

inferenceinference-enginesdistributed-inferencegpu-generickubernetes-ops

posted 5mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $188K–$275K/year est. · staff plus

scheduling-orchestrationgo-langkubernetes-opsml-platformsoftware-engineer

posted 9mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Livingston, NJ +4 more · $153K–$204K/year est. · senior

cluster-datacenterkubernetes-opspython-langrust-langsoftware-engineer

posted 3mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $182K–$242K/year est. · senior

kubernetes-opsperformance-engineerpython-langsoftware-engineergo-lang

posted 5mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $152K–$204K/year est. · senior

cudadistributed-inferencego-langgpu-genericgpu-kernels

posted 13mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $182K–$242K/year est. · senior

kubernetes-opsml-platformreinforcement-learningsoftware-engineerevaluation

posted 4mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $139K–$204K/year est. · senior

scheduling-orchestrationgo-langkubernetes-opssoftware-engineerobservability

posted 7mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $182K–$242K/year est. · senior

gpu-genericpost-trainingpython-langreinforcement-learningresearch-engineer

posted 7mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $206K–$333K/year est. · staff plus

cudaperformance-engineergpu-genericinferenceinference-engines

posted 10mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $206K–$303K/year est. · staff plus

kubernetes-opsscheduling-orchestrationgo-langsoftware-engineerslurm-admin

posted 8mo ago · verified 3d ago

OpenAIfrontier lab

London, UK · hybrid · £194K–£280K/year · senior

ml-platformgo-langpython-langsoftware-engineercpp-lang

posted 10w ago · verified 3d ago

OpenAIfrontier lab

San Francisco · hybrid · $266K–$445K/year · senior

reliability-sresoftware-engineerinferenceinference-enginesml-platform

posted 4mo ago · verified 3d ago

OpenAIfrontier lab

San Francisco · hybrid · $380K–$500K/year · manager

eng-managertraining-data-infrapython-langsoftware-engineerstorage-checkpointing

posted 4mo ago · verified 3d ago