AI infrastructure roles, filterable by the stack you actually work on.

Amazon (AWS)hyperscaler

Bellevue, Washington, USA · onsite · senior

cudagpu-kernelsinferenceinference-enginesml-platform

posted 4d ago · verified 3d ago

Together AIneocloud

San Francisco · $160K–$280K/year est. · unknown

reliability-sresregpu-genericinferenceinfiniband-ops

posted 4d ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · senior

trainiuminferenceinference-enginespost-trainingpytorch-dist

posted 5d ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · mid

trainiuminferencepost-trainingreinforcement-learningsglang-engine

posted 5d ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · senior

inferencepython-langsoftware-engineercpp-langdistributed-inference

posted 4d ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $131K–$197K · junior

inferenceinference-enginespython-langsoftware-engineerspeculative-decoding

posted 4d ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $131K–$197K · junior

software-engineercpp-langmlir-llvmpython-langgpu-kernels

posted 4d ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $131K–$197K · junior

kubernetes-opsobservabilityreliability-sresreml-platform

posted 4d ago · verified 3d ago

Mistral AIfrontier lab

New York · hybrid · senior

kubernetes-opsobservabilitypython-langreliability-sresre

posted 5d ago · verified 2d ago

Amazon (AWS)hyperscaler

Tel Aviv-Yafo, Tel Aviv, ISR · onsite · mid

cpp-langgpu-kernelsperformance-engineerpython-langtrainium

posted 6d ago · verified 3d ago

Lila Sciencesai startup

Alewife, Cambridge, MA · Cambridge, MA USA +2 more · $204K–$348K · manager

eng-managerinferenceinference-engineskv-cache-systemsquantization

posted 5d ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · senior

cudagpu-genericnvidiasoftware-engineercpp-lang

posted 6d ago · verified 3d ago

Amazon (AWS)hyperscaler

Santa Clara, California, USA · onsite · mid

cudainference-enginesgpu-kernelsinferencesglang-engine

posted 8d ago · verified 3d ago

Boson AIfrontier lab

Toronto · hybrid · CA$70K–CA$100K · junior

cudagpu-kernelsinferenceinference-enginesquantization

posted 8d ago · verified 3d ago

Amazon (AWS)hyperscaler

Bellevue, Washington, USA · onsite · unknown

software-engineercudagpu-kernelsinferenceinference-engines

posted 9d ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · mid

inferenceinference-enginespost-trainingreinforcement-learningtraining-frameworks

posted 9d ago · verified 3d ago

Reactorinference provider

San Francisco · onsite · unknown

distributed-inferenceinferencekubernetes-opsnvidiascheduling-orchestration

added 9d ago · verified 2d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · senior

training-frameworkstrainiuminferenceinference-enginespost-training

posted 10d ago · verified 3d ago

Relaceinference provider

San Francisco · onsite · senior

cpp-langgpu-genericgpu-kernelsinferenceperformance-engineer

posted 10d ago · verified 3d ago

Relaceinference provider

San Francisco · onsite · senior

kubernetes-opsrust-langsoftware-engineerdistributed-inferenceinference

posted 10d ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +5 more · staff plus

inferenceinference-enginesgpu-generickv-cache-systemsperformance-engineer

posted 10d ago · verified 3d ago

Together AIneocloud

San Francisco · $250K–$320K/year est. · staff plus

gpu-genericreliability-srecluster-datacenterinferenceinfiniband-ops

posted 11d ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $131K–$197K · junior

inferenceperformance-engineercpp-langcudapython-lang

posted 11d ago · verified 3d ago

OpenAIfrontier lab

San Francisco · hybrid · $380K–$500K/year · unknown

inferencetpuinference-enginesperformance-engineergpu-kernels

posted 11d ago · verified 2d ago

Mistral AIfrontier lab

London · Paris · unknown

inferenceinference-enginespython-langquantizationresearch-engineer

posted 11d ago · verified 2d ago

Waymoenterprise

Mountain View, CA, USA · Mountain View (US-MTV-EMF690) +2 more · $251K–$310K · staff plus

inferencertl-designperformance-engineerdatacenter-engineergpu-generic

posted 12d ago · verified 2d ago

Waymoenterprise

Mountain View, California, United States · Mountain View (US-MTV-EMF680) · $298K–$378K · manager

eng-managerdeepspeed-libjax-pallasperformance-engineerpytorch-dist

posted 7mo ago · verified 2d ago

Waymoenterprise

Mountain View, California, United States · Mountain View (US-MTV-EMF680) +1 more · $251K–$310K · staff plus

model-parallelismperformance-engineerpython-langquantizationgpu-generic

posted 4mo ago · verified 2d ago

Waymoenterprise

Mountain View, CA, USA · Mountain View (US-MTV-EMF680) · $213K–$263K · senior

cpp-langsoftware-engineerinferenceinference-enginesml-platform

posted 10mo ago · verified 2d ago

Waymoenterprise

Mountain View, CA, US · Mountain View (US-MTV-EMF690) +2 more · $213K–$263K · senior

cpp-langinferenceinference-enginessoftware-engineermlir-llvm

posted 3mo ago · verified 2d ago