AI infrastructure roles, filterable by the stack you actually work on.
Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.
1538 open roles · 87 companies · last verified 2d ago
130 roles
Amazon (AWS)hyperscaler
Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · senior
trainiuminferenceinference-enginespost-trainingpytorch-dist
posted 5d ago · verified 3d ago
Amazon (AWS)hyperscaler
Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · mid
trainiuminferencepost-trainingreinforcement-learningsglang-engine
posted 5d ago · verified 3d ago
Cerebraschip vendor
Sunnyvale, CA · Toronto, CAN · hybrid · senior
inferencepython-langsoftware-engineercpp-langdistributed-inference
posted 4d ago · verified 3d ago
SambaNovachip vendor
Austin, Texas, United States · Austin, TX +2 more · $131K–$197K · junior
inferenceinference-enginespython-langsoftware-engineerspeculative-decoding
posted 4d ago · verified 3d ago
SambaNovachip vendor
Austin, Texas, United States · Austin, TX +2 more · $131K–$197K · junior
kubernetes-opsobservabilityreliability-sresreml-platform
posted 4d ago · verified 3d ago
Amazon (AWS)hyperscaler
Santa Clara, California, USA · onsite · mid
cudainference-enginesgpu-kernelsinferencesglang-engine
posted 8d ago · verified 3d ago
Boson AIfrontier lab
Toronto · hybrid · CA$70K–CA$100K · junior
cudagpu-kernelsinferenceinference-enginesquantization
posted 8d ago · verified 3d ago
Amazon (AWS)hyperscaler
Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · mid
inferenceinference-enginespost-trainingreinforcement-learningtraining-frameworks
posted 9d ago · verified 3d ago
Reactorinference provider
San Francisco · onsite · unknown
distributed-inferenceinferencekubernetes-opsnvidiascheduling-orchestration
added 9d ago · verified 2d ago
Amazon (AWS)hyperscaler
Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · senior
training-frameworkstrainiuminferenceinference-enginespost-training
posted 10d ago · verified 3d ago
Nebiusneocloud
Amsterdam, Netherlands · Berlin, Germany +5 more · staff plus
inferenceinference-enginesgpu-generickv-cache-systemsperformance-engineer
posted 10d ago · verified 3d ago
SambaNovachip vendor
Austin, Texas, United States · Austin, TX +2 more · $131K–$197K · junior
inferenceperformance-engineercpp-langcudapython-lang
posted 11d ago · verified 3d ago
Together AIneocloud
San Francisco · junior
research-engineerspeculative-decodingfine-tuningfsdpgpu-generic
posted 15d ago · verified 3d ago
Together AIneocloud
San Francisco · junior
speculative-decodingfine-tuningfsdpgpu-genericmegatron-lm
posted 15d ago · verified 3d ago
Inferactinference provider
San Francisco · onsite · manager
eng-managerinferenceinference-enginesvllm-enginecuda
posted 17d ago · verified 3d ago
Prime Intellectneocloud
San Francisco · unknown
solutions-architectcudagpu-genericnvidiainference
posted 18d ago · verified 3d ago
Amazon (AWS)hyperscaler
Cupertino, California, USA · onsite · mid
distributed-inferencegpu-kernelssoftware-engineertrainiumcpp-lang
posted 19d ago · verified 3d ago
Novita AIinference provider
San Mateo · onsite · junior
inferencepython-langsolutions-architectkubernetes-opsray-distributed
posted 19d ago · verified 3d ago
Nebiusneocloud
Remote - Europe · Zurich, Switzerland · senior
distributed-inferenceinferenceinference-engineskv-cache-systemspython-lang
posted 19d ago · verified 3d ago
Nebiusneocloud
London, United Kingdom · Remote - Europe · senior
distributed-inferenceinferenceinference-engineskv-cache-systemspython-lang
posted 19d ago · verified 3d ago
Nebiusneocloud
Berlin, Germany · Remote - Europe · senior
distributed-inferencegpu-genericinferenceinference-engineskv-cache-systems
posted 19d ago · verified 3d ago
Nebiusneocloud
Remote - United States · United States · $208K–$261K · staff plus
solutions-architectfine-tuninginferenceinference-engineskv-cache-systems
posted 3w ago · verified 3d ago
Reactorinference provider
San Francisco · onsite · unknown
cpp-langgpu-genericinferenceinference-enginespython-lang
added 3w ago · verified 2d ago
Luma AIai startup
Remote, EU · remote · unknown
fsdpgpu-genericinference-enginespost-trainingpytorch-dist
posted 3w ago · verified 3d ago
Luma AIai startup
London, UK · Remote, UK · hybrid · unknown
distributed-inferenceinferenceinference-engineskubernetes-opspython-lang
posted 3w ago · verified 3d ago
Luma AIai startup
Remote, EU · remote · unknown
inferenceinference-engineskubernetes-opspython-langsoftware-engineer
posted 3w ago · verified 3d ago
Luma AIai startup
London, UK · Remote, UK · hybrid · unknown
collectivesgpu-genericinferenceinference-enginespost-training
posted 3w ago · verified 3d ago
DigitalOceanneocloud
DigitalOcean Seattle Office · Seattle · $250K–$312K/year est. · staff plus
amdcpp-langcudacutlass-cutedistributed-inference
posted 3w ago · verified 3d ago
DigitalOceanneocloud
DigitalOcean Seattle Office · Seattle · $250K–$312K/year est. · staff plus
distributed-inferenceinferenceinference-engineskv-cache-systemssglang-engine
posted 3w ago · verified 3d ago
DoorDashenterprise
San Francisco, CA · Seattle, WA +1 more · $131K–$192K · unknown
fine-tuninggpu-genericinferenceinference-enginesml-platform
posted 3w ago · verified 3d ago