AI infrastructure roles, filterable by the stack you actually work on.

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · senior

trainiuminferenceinference-enginespost-trainingpytorch-dist

posted 5d ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · mid

trainiuminferencepost-trainingreinforcement-learningsglang-engine

posted 5d ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · senior

inferencepython-langsoftware-engineercpp-langdistributed-inference

posted 4d ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $131K–$197K · junior

inferenceinference-enginespython-langsoftware-engineerspeculative-decoding

posted 4d ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $131K–$197K · junior

kubernetes-opsobservabilityreliability-sresreml-platform

posted 4d ago · verified 3d ago

Anyscaleai startup

San Francisco · $267K–$375K/year · manager

eng-managerray-distributedpython-langtraining-data-infradistributed-inference

posted 4d ago · verified 3d ago

Lila Sciencesai startup

Alewife, Cambridge, MA · Cambridge, MA USA +2 more · $204K–$348K · manager

eng-managerinferenceinference-engineskv-cache-systemsquantization

posted 5d ago · verified 3d ago

Amazon (AWS)hyperscaler

Santa Clara, California, USA · onsite · mid

cudainference-enginesgpu-kernelsinferencesglang-engine

posted 8d ago · verified 3d ago

Boson AIfrontier lab

Toronto · hybrid · CA$70K–CA$100K · junior

cudagpu-kernelsinferenceinference-enginesquantization

posted 8d ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · mid

inferenceinference-enginespost-trainingreinforcement-learningtraining-frameworks

posted 9d ago · verified 3d ago

Reactorinference provider

San Francisco · onsite · unknown

distributed-inferenceinferencekubernetes-opsnvidiascheduling-orchestration

added 9d ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · senior

training-frameworkstrainiuminferenceinference-enginespost-training

posted 10d ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +5 more · staff plus

inferenceinference-enginesgpu-generickv-cache-systemsperformance-engineer

posted 10d ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $131K–$197K · junior

inferenceperformance-engineercpp-langcudapython-lang

posted 11d ago · verified 3d ago

Mistral AIfrontier lab

London · Paris · unknown

inferenceinference-enginespython-langquantizationresearch-engineer

posted 11d ago · verified 3d ago

Prime Intellectneocloud

Remote · San Francisco · unknown

gpu-genericgpu-kernelsmodel-parallelismpytorch-distreinforcement-learning

posted 13d ago · verified 3d ago

SkyPilotai startup

San Mateo, United States · onsite · unknown

gpu-genericml-platformscheduling-orchestrationsoftware-engineercluster-datacenter

posted 3mo ago · verified 3d ago

Together AIneocloud

San Francisco · junior

research-engineerspeculative-decodingfine-tuningfsdpgpu-generic

posted 15d ago · verified 3d ago

Together AIneocloud

San Francisco · junior

speculative-decodingfine-tuningfsdpgpu-genericmegatron-lm

posted 15d ago · verified 3d ago

Prime Intellectneocloud

Remote · San Francisco · unknown

inferenceinference-enginesresearch-engineervllm-enginedistributed-inference

posted 15d ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · manager

eng-managerinferenceinference-enginesvllm-enginecuda

posted 17d ago · verified 3d ago

Prime Intellectneocloud

San Francisco · unknown

solutions-architectcudagpu-genericnvidiainference

posted 18d ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · mid

distributed-inferencegpu-kernelssoftware-engineertrainiumcpp-lang

posted 19d ago · verified 3d ago

Novita AIinference provider

San Mateo · onsite · junior

inferencepython-langsolutions-architectkubernetes-opsray-distributed

posted 19d ago · verified 3d ago

CoreWeaveneocloud

Sunnyvale, CA · $182K–$242K/year est. · senior

python-langsolutions-architectfine-tuninggpu-genericinference

posted 19d ago · verified 3d ago

Nebiusneocloud

Remote - Europe · Zurich, Switzerland · senior

distributed-inferenceinferenceinference-engineskv-cache-systemspython-lang

posted 19d ago · verified 3d ago

Nebiusneocloud

London, United Kingdom · Remote - Europe · senior

distributed-inferenceinferenceinference-engineskv-cache-systemspython-lang

posted 19d ago · verified 3d ago

Nebiusneocloud

Berlin, Germany · Remote - Europe · senior

distributed-inferencegpu-genericinferenceinference-engineskv-cache-systems

posted 19d ago · verified 3d ago

Nebiusneocloud

Remote - United States · remote · $210K–$262K · senior

tensorrt-stackvllm-engineinference-enginesinferencesolutions-architect

posted 20d ago · verified 3d ago

Amazon (AWS)hyperscaler

Santa Clara, California, USA · onsite · manager

eng-managerml-platformpost-trainingfine-tuningfsdp

posted 3w ago · verified 3d ago