AI infrastructure roles, filterable by the stack you actually work on.

Together AIneocloud

San Francisco · $160K–$280K/year est. · unknown

reliability-sresregpu-genericinferenceinfiniband-ops

posted 4d ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · senior

inferencepython-langsoftware-engineercpp-langdistributed-inference

posted 4d ago · verified 3d ago

Lila Sciencesai startup

Alewife, Cambridge, MA · Cambridge, MA USA +2 more · $204K–$348K · manager

eng-managerinferenceinference-engineskv-cache-systemsquantization

posted 5d ago · verified 3d ago

Boson AIfrontier lab

Toronto · hybrid · CA$70K–CA$100K · junior

cudagpu-kernelsinferenceinference-enginesquantization

posted 8d ago · verified 3d ago

Fireworks AIinference provider

San Mateo · hybrid · $175K–$220K/year · unknown

storage-checkpointingcpp-langkubernetes-opssoftware-engineergo-lang

posted 9d ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +5 more · staff plus

inferenceinference-enginesgpu-generickv-cache-systemsperformance-engineer

posted 10d ago · verified 3d ago

Together AIneocloud

San Francisco · $250K–$320K/year est. · staff plus

gpu-genericreliability-srecluster-datacenterinferenceinfiniband-ops

posted 11d ago · verified 3d ago

Waymoenterprise

Mountain View, CA, USA · Mountain View (US-MTV-EMF680) · $213K–$263K · senior

cpp-langinference-enginescudagpu-kernelsinference

posted 6mo ago · verified 3d ago

Prime Intellectneocloud

Remote · San Francisco · unknown

inferenceinference-enginesresearch-engineervllm-enginedistributed-inference

posted 15d ago · verified 3d ago

Nebiusneocloud

Remote - Europe · Zurich, Switzerland · senior

distributed-inferenceinferenceinference-engineskv-cache-systemspython-lang

posted 19d ago · verified 3d ago

Nebiusneocloud

London, United Kingdom · Remote - Europe · senior

distributed-inferenceinferenceinference-engineskv-cache-systemspython-lang

posted 19d ago · verified 3d ago

Nebiusneocloud

Berlin, Germany · Remote - Europe · senior

distributed-inferencegpu-genericinferenceinference-engineskv-cache-systems

posted 19d ago · verified 3d ago

Nebiusneocloud

Remote - United States · United States · $208K–$261K · staff plus

solutions-architectfine-tuninginferenceinference-engineskv-cache-systems

posted 3w ago · verified 3d ago

Cerebraschip vendor

Bengaluru, IND · hybrid · unknown

cpp-langinferencemlir-llvmpython-langinference-engines

posted 3w ago · verified 3d ago

DigitalOceanneocloud

DigitalOcean Seattle Office · Seattle · $250K–$312K/year est. · staff plus

gpu-genericnccl-libnetwork-fabricnvidianvlink-topology

posted 3w ago · verified 3d ago

DigitalOceanneocloud

DigitalOcean Seattle Office · Seattle · $250K–$312K/year est. · staff plus

distributed-inferenceinferenceinference-engineskv-cache-systemssglang-engine

posted 3w ago · verified 3d ago

DoorDashenterprise

San Francisco, CA · Seattle, WA +1 more · $131K–$192K · unknown

fine-tuninggpu-genericinferenceinference-enginesml-platform

posted 3w ago · verified 3d ago

River AIfrontier lab

HQ · Palo Alto, CA · $200K–$420K/year est. · unknown

cpp-langinferenceinference-enginespython-langsoftware-engineer

posted 7w ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $240K–$270K/year · manager

eng-managerinference-enginesgpu-genericgpu-kernelsinference

posted 3w ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · mid

software-engineertrainiummodel-parallelismpost-trainingpre-training

posted 3w ago · verified 3d ago

Mistral AIfrontier lab

London · Munich +1 more · hybrid · unknown

inferenceinference-enginescudadistributed-inferencegpu-generic

posted 3w ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · mid

inferenceinference-enginessglang-enginesoftware-engineertrainium

posted 3w ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $180K–$360K/year · unknown

inferenceml-platformsoftware-engineerdistributed-inferencegpu-generic

posted 3w ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $180K–$360K/year · unknown

inferenceinference-enginesperformance-engineerquantizationspeculative-decoding

posted 3w ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +6 more · senior

inferenceinference-enginesquantizationresearch-engineercuda

posted 4w ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · hybrid · unknown

performance-engineerpython-langcpp-langgpu-kernelsmodel-parallelism

posted 4w ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · unknown

cpp-langgpu-kernelspython-langsoftware-engineercuda

posted 4w ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +2 more · remote · senior

distributed-inferenceinferenceinference-engineskv-cache-systemsperformance-engineer

posted 5w ago · verified 3d ago

Nebiusneocloud

Remote - Europe · Zurich, Switzerland · senior

inferenceinference-enginesperformance-engineerpython-langquantization

posted 5w ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · mid

software-engineertrainiumcollectivescpp-langfine-tuning

posted 5w ago · verified 3d ago