AI infrastructure roles, filterable by the stack you actually work on.
Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.
1538 open roles · 87 companies · last verified 3d ago
114 roles
Amazon (AWS)hyperscaler
Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · senior
trainiuminferenceinference-enginespost-trainingpytorch-dist
posted 5d ago · verified 3d ago
Amazon (AWS)hyperscaler
Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · mid
trainiuminferencepost-trainingreinforcement-learningsglang-engine
posted 5d ago · verified 3d ago
Lila Sciencesai startup
Alewife, Cambridge, MA · Cambridge, MA USA +2 more · $204K–$348K · manager
eng-managerinferenceinference-engineskv-cache-systemsquantization
posted 5d ago · verified 3d ago
Perplexityai startup
San Francisco · $220K–$405K/year · unknown
software-engineerevaluationkubernetes-opsml-platformpython-lang
posted 7d ago · verified 3d ago
Boson AIfrontier lab
Toronto · hybrid · CA$70K–CA$100K · junior
cudagpu-kernelsinferenceinference-enginesquantization
posted 8d ago · verified 3d ago
Amazon (AWS)hyperscaler
Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · mid
inferenceinference-enginespost-trainingreinforcement-learningtraining-frameworks
posted 9d ago · verified 3d ago
Amazon (AWS)hyperscaler
Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · senior
training-frameworkstrainiuminferenceinference-enginespost-training
posted 10d ago · verified 3d ago
Nebiusneocloud
Amsterdam, Netherlands · Berlin, Germany +5 more · staff plus
inferenceinference-enginesgpu-generickv-cache-systemsperformance-engineer
posted 10d ago · verified 3d ago
Anthropicfrontier lab
San Francisco, CA · Seattle, WA · $320K–$485K · staff plus
kubernetes-opspython-langcluster-datacenterobservabilitysoftware-engineer
posted 13d ago · verified 3d ago
SkyPilotai startup
San Mateo, United States · onsite · unknown
gpu-genericml-platformscheduling-orchestrationsoftware-engineercluster-datacenter
posted 3mo ago · verified 3d ago
Mirageai startup
Union Square, New York City · $175K–$300K/year · mid
cudagpu-genericgpu-kernelsquantizationresearch-engineer
posted 4w ago · verified 3d ago
Amazon (AWS)hyperscaler
Culver City, California, USA · New York, New York, USA · onsite · senior
gpu-genericinferencekubernetes-opsscheduling-orchestrationsoftware-engineer
posted 19d ago · verified 3d ago
Reflection AIfrontier lab
London · New York, NY +1 more · onsite · unknown
evaluationcpp-langml-platformpre-trainingpython-lang
posted 18d ago · verified 3d ago
CoreWeaveneocloud
Sunnyvale, CA · $182K–$242K/year est. · senior
python-langsolutions-architectfine-tuninggpu-genericinference
posted 19d ago · verified 3d ago
Nebiusneocloud
Remote - Europe · Zurich, Switzerland · senior
distributed-inferenceinferenceinference-engineskv-cache-systemspython-lang
posted 19d ago · verified 3d ago
Nebiusneocloud
London, United Kingdom · Remote - Europe · senior
distributed-inferenceinferenceinference-engineskv-cache-systemspython-lang
posted 19d ago · verified 3d ago
Nebiusneocloud
Berlin, Germany · Remote - Europe · senior
distributed-inferencegpu-genericinferenceinference-engineskv-cache-systems
posted 19d ago · verified 3d ago
Nebiusneocloud
Remote - United States · United States · $208K–$261K · staff plus
solutions-architectfine-tuninginferenceinference-engineskv-cache-systems
posted 3w ago · verified 3d ago
Luma AIai startup
Remote, EU · remote · unknown
fsdpgpu-genericinference-enginespost-trainingpytorch-dist
posted 3w ago · verified 3d ago
Luma AIai startup
London, UK · Remote, UK · hybrid · unknown
collectivesgpu-genericinferenceinference-enginespost-training
posted 3w ago · verified 3d ago
DigitalOceanneocloud
DigitalOcean Seattle Office · Seattle · $250K–$312K/year est. · staff plus
amdcpp-langcudacutlass-cutedistributed-inference
posted 3w ago · verified 3d ago
DoorDashenterprise
San Francisco, CA · Seattle, WA +1 more · $131K–$192K · unknown
fine-tuninggpu-genericinferenceinference-enginesml-platform
posted 3w ago · verified 3d ago
Mistral AIfrontier lab
Paris · unknown
evaluationkubernetes-opspython-langray-distributedresearch-engineer
posted 3w ago · verified 3d ago
Nebiusneocloud
Amsterdam, Netherlands · Berlin, Germany +6 more · senior
inferenceinference-enginesquantizationresearch-engineercuda
posted 4w ago · verified 3d ago
xAIfrontier lab
Palo Alto, CA · $180K–$440K/year est. · unknown
evaluationml-platformsoftware-engineerscheduling-orchestrationcluster-datacenter
posted 4w ago · verified 3d ago
Fireworks AIinference provider
New York · San Mateo · hybrid · $270K–$310K/year · manager
eng-managerevaluationfine-tuninginferencesglang-engine
posted 4w ago · verified 3d ago
Nebiusneocloud
Remote - Europe · Zurich, Switzerland · senior
inferenceinference-enginesperformance-engineerpython-langquantization
posted 5w ago · verified 3d ago
Together AIneocloud
San Francisco · junior
inferenceinference-enginespython-langresearch-engineercuda
posted 6w ago · verified 3d ago
Together AIneocloud
San Francisco · junior
distributed-inferenceinferenceinference-enginesresearch-engineercuda
posted 6w ago · verified 3d ago
Nebiusneocloud
Remote - Europe · United Kingdom · remote · mid
inferenceinference-engineskubernetes-opsnvidiapython-lang
posted 6w ago · verified 3d ago