AI infrastructure roles, filterable by the stack you actually work on.

Amazon (AWS)hyperscaler

Bellevue, Washington, USA · onsite · senior

cudagpu-kernelsinferenceinference-enginesml-platform

posted 4d ago · verified 3d ago

Together AIneocloud

San Francisco · $160K–$280K/year est. · unknown

reliability-sresregpu-genericinferenceinfiniband-ops

posted 4d ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · senior

trainiuminferenceinference-enginespost-trainingpytorch-dist

posted 5d ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · mid

trainiuminferencepost-trainingreinforcement-learningsglang-engine

posted 5d ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · senior

inferencepython-langsoftware-engineercpp-langdistributed-inference

posted 4d ago · verified 3d ago

Anyscaleai startup

San Francisco · $267K–$375K/year · manager

eng-managerray-distributedpython-langtraining-data-infradistributed-inference

posted 4d ago · verified 3d ago

Lila Sciencesai startup

Alewife, Cambridge, MA · Cambridge, MA USA +2 more · $204K–$348K · manager

eng-managerinferenceinference-engineskv-cache-systemsquantization

posted 5d ago · verified 3d ago

Amazon (AWS)hyperscaler

Santa Clara, California, USA · onsite · mid

cudainference-enginesgpu-kernelsinferencesglang-engine

posted 8d ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · mid

inferenceinference-enginespost-trainingreinforcement-learningtraining-frameworks

posted 9d ago · verified 3d ago

Reactorinference provider

San Francisco · onsite · unknown

distributed-inferenceinferencekubernetes-opsnvidiascheduling-orchestration

added 9d ago · verified 2d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · senior

training-frameworkstrainiuminferenceinference-enginespost-training

posted 10d ago · verified 3d ago

Relaceinference provider

San Francisco · onsite · senior

kubernetes-opsrust-langsoftware-engineerdistributed-inferenceinference

posted 10d ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +5 more · staff plus

inferenceinference-enginesgpu-generickv-cache-systemsperformance-engineer

posted 10d ago · verified 3d ago

Together AIneocloud

San Francisco · $250K–$320K/year est. · staff plus

gpu-genericreliability-srecluster-datacenterinferenceinfiniband-ops

posted 11d ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $131K–$197K · junior

inferenceperformance-engineercpp-langcudapython-lang

posted 11d ago · verified 3d ago

Waymoenterprise

Mountain View, California, United States · Mountain View (US-MTV-EMF680) +1 more · $251K–$310K · staff plus

model-parallelismperformance-engineerpython-langquantizationgpu-generic

posted 4mo ago · verified 2d ago

Waymoenterprise

Mountain View, CA, USA · Mountain View (US-MTV-EMF680) · $213K–$263K · senior

cpp-langinference-enginescudagpu-kernelsinference

posted 6mo ago · verified 2d ago

SkyPilotai startup

San Mateo, United States · onsite · unknown

gpu-genericml-platformscheduling-orchestrationsoftware-engineercluster-datacenter

posted 3mo ago · verified 2d ago

Prime Intellectneocloud

Remote · San Francisco · unknown

inferenceinference-enginesresearch-engineervllm-enginedistributed-inference

posted 15d ago · verified 3d ago

Together AIneocloud

Amsterdam · staff plus

ansiblecluster-datacentergpu-generickubernetes-opsnetwork-fabric

posted 16d ago · verified 3d ago

Amazon (AWS)hyperscaler

New York, New York, USA · onsite · senior

solutions-architectcollectivesefa-fabricgpu-genericnccl-lib

posted 17d ago · verified 3d ago

Anthropicfrontier lab

New York City, NY · San Francisco, CA +1 more · $290K–$435K · senior

gpu-genericinferenceinference-enginestputrainium

posted 17d ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · Seattle, Washington, USA · onsite · staff plus

collectivescpp-langdistributed-inferencefine-tuninggpu-kernels

posted 18d ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · senior

software-engineerinferenceinference-enginesgpu-generictpu

posted 18d ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · manager

eng-managerinferenceinference-enginesvllm-enginecuda

posted 17d ago · verified 3d ago

Amazon (AWS)hyperscaler

Culver City, California, USA · New York, New York, USA · onsite · senior

gpu-genericinferencekubernetes-opsscheduling-orchestrationsoftware-engineer

posted 19d ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · mid

distributed-inferencegpu-kernelssoftware-engineertrainiumcpp-lang

posted 19d ago · verified 3d ago

Reflection AIfrontier lab

London · New York, NY +1 more · onsite · unknown

evaluationcpp-langml-platformpre-trainingpython-lang

posted 18d ago · verified 3d ago

Anthropicfrontier lab

Dublin, IE · €235K–€295K · senior

inferenceinference-enginessoftware-engineerdistributed-inferencekubernetes-ops

posted 17mo ago · verified 3d ago

Nebiusneocloud

Remote - Europe · Zurich, Switzerland · senior

distributed-inferenceinferenceinference-engineskv-cache-systemspython-lang

posted 19d ago · verified 3d ago