AI infrastructure roles, filterable by the stack you actually work on.

Amazon (AWS)hyperscaler

Bellevue, Washington, USA · onsite · senior

cudagpu-kernelsinferenceinference-enginesml-platform

posted 4d ago · verified 3d ago

Together AIneocloud

San Francisco · $160K–$280K/year est. · unknown

reliability-sresregpu-genericinferenceinfiniband-ops

posted 4d ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · senior

trainiuminferenceinference-enginespost-trainingpytorch-dist

posted 5d ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · mid

trainiuminferencepost-trainingreinforcement-learningsglang-engine

posted 5d ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · senior

inferencepython-langsoftware-engineercpp-langdistributed-inference

posted 4d ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $131K–$197K · junior

inferenceinference-enginespython-langsoftware-engineerspeculative-decoding

posted 4d ago · verified 3d ago

Lila Sciencesai startup

Alewife, Cambridge, MA · Cambridge, MA USA +2 more · $204K–$348K · manager

eng-managerinferenceinference-engineskv-cache-systemsquantization

posted 5d ago · verified 3d ago

Amazon (AWS)hyperscaler

Santa Clara, California, USA · onsite · mid

cudainference-enginesgpu-kernelsinferencesglang-engine

posted 8d ago · verified 3d ago

Boson AIfrontier lab

Toronto · hybrid · CA$70K–CA$100K · junior

cudagpu-kernelsinferenceinference-enginesquantization

posted 8d ago · verified 3d ago

Amazon (AWS)hyperscaler

Bellevue, Washington, USA · onsite · unknown

software-engineercudagpu-kernelsinferenceinference-engines

posted 9d ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · mid

inferenceinference-enginespost-trainingreinforcement-learningtraining-frameworks

posted 9d ago · verified 3d ago

Reactorinference provider

San Francisco · onsite · unknown

distributed-inferenceinferencekubernetes-opsnvidiascheduling-orchestration

added 9d ago · verified 2d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · senior

training-frameworkstrainiuminferenceinference-enginespost-training

posted 10d ago · verified 3d ago

Relaceinference provider

San Francisco · onsite · senior

kubernetes-opsrust-langsoftware-engineerdistributed-inferenceinference

posted 10d ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +5 more · staff plus

inferenceinference-enginesgpu-generickv-cache-systemsperformance-engineer

posted 10d ago · verified 3d ago

Together AIneocloud

San Francisco · $250K–$320K/year est. · staff plus

gpu-genericreliability-srecluster-datacenterinferenceinfiniband-ops

posted 11d ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $131K–$197K · junior

inferenceperformance-engineercpp-langcudapython-lang

posted 11d ago · verified 3d ago

OpenAIfrontier lab

San Francisco · hybrid · $380K–$500K/year · unknown

inferencetpuinference-enginesperformance-engineergpu-kernels

posted 11d ago · verified 2d ago

Mistral AIfrontier lab

London · Paris · unknown

inferenceinference-enginespython-langquantizationresearch-engineer

posted 11d ago · verified 2d ago

Waymoenterprise

Mountain View, California, United States · Mountain View (US-MTV-EMF680) · $298K–$378K · manager

eng-managerdeepspeed-libjax-pallasperformance-engineerpytorch-dist

posted 7mo ago · verified 2d ago

Waymoenterprise

Mountain View, California, United States · Mountain View (US-MTV-EMF680) +1 more · $251K–$310K · staff plus

model-parallelismperformance-engineerpython-langquantizationgpu-generic

posted 4mo ago · verified 2d ago

Waymoenterprise

Mountain View, CA, USA · Mountain View (US-MTV-EMF680) · $213K–$263K · senior

cpp-langsoftware-engineerinferenceinference-enginesml-platform

posted 10mo ago · verified 2d ago

Waymoenterprise

Mountain View, CA, US · Mountain View (US-MTV-EMF690) +2 more · $213K–$263K · senior

cpp-langinferenceinference-enginessoftware-engineermlir-llvm

posted 3mo ago · verified 2d ago

Waymoenterprise

Mountain View, CA, USA · Mountain View (US-MTV-EMF680) · $213K–$263K · senior

cpp-langinference-enginescudagpu-kernelsinference

posted 6mo ago · verified 2d ago

Waymoenterprise

Mountain View, CA, USA · Mountain View (US-MTV-EMF680) · junior

performance-engineercudagpu-kernelstriton-langinference

posted 4w ago · verified 2d ago

SkyPilotai startup

San Mateo, United States · onsite · unknown

gpu-genericml-platformscheduling-orchestrationsoftware-engineercluster-datacenter

posted 3mo ago · verified 2d ago

Mirageai startup

Union Square, New York City · $175K–$300K/year · mid

cudagpu-genericgpu-kernelsquantizationresearch-engineer

posted 4w ago · verified 3d ago

Together AIneocloud

San Francisco · junior

research-engineerspeculative-decodingfine-tuningfsdpgpu-generic

posted 15d ago · verified 3d ago

Together AIneocloud

San Francisco · junior

speculative-decodingfine-tuningfsdpgpu-genericmegatron-lm

posted 15d ago · verified 3d ago

DeepInfrainference provider

Sofia, Bulgaria · onsite · junior

python-langsoftware-engineercudagpu-genericinference

posted 15d ago · verified 2d ago