AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 2d ago

80 roles

ray-distributed ✕

Anyscaleai startup

San Francisco · $267K–$375K/year · manager

eng-managerray-distributedpython-langtraining-data-infradistributed-inference

posted 4d ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +5 more · staff plus

inferenceinference-enginesgpu-generickv-cache-systemsperformance-engineer

posted 10d ago · verified 3d ago

VAST Dataai startup

Remote - United States · hybrid · senior

solutions-architectcluster-datacentercudagpu-generickubernetes-ops

added 13d ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · Seattle, Washington, USA · onsite · staff plus

collectivescpp-langdistributed-inferencefine-tuninggpu-kernels

posted 18d ago · verified 3d ago

Novita AIinference provider

San Mateo · onsite · junior

inferencepython-langsolutions-architectkubernetes-opsray-distributed

posted 19d ago · verified 3d ago

Radiantneocloud

London · hybrid · senior

ml-platformfine-tuninggpu-genericinferencekubernetes-ops

posted 3w ago · verified 2d ago

Inferactinference provider

San Francisco · onsite · $200K–$400K/year · unknown

inferenceinference-enginesvllm-engineamdcuda

posted 4w ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · junior

software-engineerinferenceinference-enginespython-langobservability

posted 5w ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +2 more · remote · senior

distributed-inferenceinferenceinference-engineskv-cache-systemsperformance-engineer

posted 5w ago · verified 3d ago

IRENneocloud

San Francisco, California, United States · hybrid · staff plus

nvidiasolutions-architectcluster-datacenterinfiniband-opskubernetes-ops

posted 3mo ago · verified 3d ago

Nebiusneocloud

Remote - Europe · United Kingdom · remote · mid

inferenceinference-engineskubernetes-opsnvidiapython-lang

posted 6w ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · junior

amdcudagpu-kernelsinferenceinference-engines

posted 6w ago · verified 3d ago

DigitalOceanneocloud

Bangalore Metro · Bengaluru · senior

amdcudainferenceinference-engineskubernetes-ops

posted 4mo ago · verified 3d ago

Inceptionfrontier lab

San Mateo, United States · onsite · unknown

reinforcement-learningml-platformpost-trainingray-distributedsoftware-engineer

posted 7mo ago · verified 3d ago

Inceptionfrontier lab

San Mateo, United States · onsite · unknown

cudagpu-genericinferenceinference-engineskubernetes-ops

posted 7mo ago · verified 3d ago

Novita AIinference provider

San Mateo · onsite · unknown

kubernetes-opspython-langsolutions-architectinferenceinference-engines

posted 4mo ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo · hybrid · $200K–$230K/year · unknown

scheduling-orchestrationcpp-langnetwork-fabricpython-langstorage-checkpointing

posted 7w ago · verified 2d ago

Lila Sciencesai startup

Alewife, Cambridge, MA · Cambridge, MA USA +2 more · $180K–$298K · staff plus

evaluationpython-langfine-tuningdeepspeed-libmegatron-lm

posted 4mo ago · verified 3d ago

Lila Sciencesai startup

Cambridge, MA USA · One Charles Park, Cambridge, MA · $144K–$240K · unknown

go-langkubernetes-opspython-langray-distributedsoftware-engineer

posted 13mo ago · verified 3d ago

Echo Neurotechnologiesai startup

San Francisco · SF Office · senior

ml-platformpython-langpytorch-distsoftware-engineertraining-frameworks

posted 3mo ago · verified 3d ago