AI infrastructure roles, filterable by the stack you actually work on.

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · mid

trainiuminferencepost-trainingreinforcement-learningsglang-engine

posted 5d ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $131K–$197K · junior

inferenceinference-enginespython-langsoftware-engineerspeculative-decoding

posted 4d ago · verified 3d ago

Lila Sciencesai startup

Alewife, Cambridge, MA · Cambridge, MA USA +2 more · $204K–$348K · manager

eng-managerinferenceinference-engineskv-cache-systemsquantization

posted 5d ago · verified 3d ago

Amazon (AWS)hyperscaler

Santa Clara, California, USA · onsite · mid

cudainference-enginesgpu-kernelsinferencesglang-engine

posted 8d ago · verified 3d ago

Boson AIfrontier lab

Toronto · hybrid · CA$70K–CA$100K · junior

cudagpu-kernelsinferenceinference-enginesquantization

posted 8d ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Boston, Massachusetts, USA +3 more · onsite · mid

inferenceinference-enginespost-trainingreinforcement-learningtraining-frameworks

posted 9d ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +5 more · staff plus

inferenceinference-enginesgpu-generickv-cache-systemsperformance-engineer

posted 10d ago · verified 3d ago

Mistral AIfrontier lab

London · Paris · unknown

inferenceinference-enginespython-langquantizationresearch-engineer

posted 11d ago · verified 2d ago

Together AIneocloud

San Francisco · junior

research-engineerspeculative-decodingfine-tuningfsdpgpu-generic

posted 15d ago · verified 3d ago

Together AIneocloud

San Francisco · junior

speculative-decodingfine-tuningfsdpgpu-genericmegatron-lm

posted 15d ago · verified 3d ago

Anthropicfrontier lab

New York City, NY · San Francisco, CA +1 more · $290K–$435K · senior

gpu-genericinferenceinference-enginestputrainium

posted 17d ago · verified 3d ago

Nebiusneocloud

Remote - Europe · Zurich, Switzerland · senior

distributed-inferenceinferenceinference-engineskv-cache-systemspython-lang

posted 19d ago · verified 3d ago

Nebiusneocloud

London, United Kingdom · Remote - Europe · senior

distributed-inferenceinferenceinference-engineskv-cache-systemspython-lang

posted 19d ago · verified 3d ago

Nebiusneocloud

Berlin, Germany · Remote - Europe · senior

distributed-inferencegpu-genericinferenceinference-engineskv-cache-systems

posted 19d ago · verified 3d ago

Nebiusneocloud

Remote - United States · United States · $208K–$261K · staff plus

solutions-architectfine-tuninginferenceinference-engineskv-cache-systems

posted 3w ago · verified 3d ago

Cerebraschip vendor

Bengaluru, IND · hybrid · unknown

cpp-langinferencemlir-llvmpython-langinference-engines

posted 3w ago · verified 3d ago

DigitalOceanneocloud

DigitalOcean Seattle Office · Seattle · $250K–$312K/year est. · staff plus

amdcpp-langcudacutlass-cutedistributed-inference

posted 3w ago · verified 3d ago

River AIfrontier lab

HQ · Palo Alto, CA · $200K–$420K/year est. · unknown

cpp-langinferenceinference-enginespython-langsoftware-engineer

posted 7w ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $240K–$270K/year · manager

eng-managerinference-enginesgpu-genericgpu-kernelsinference

posted 3w ago · verified 2d ago

Mistral AIfrontier lab

London · Munich +1 more · hybrid · unknown

inferenceinference-enginescudadistributed-inferencegpu-generic

posted 3w ago · verified 2d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $180K–$360K/year · unknown

inferenceinference-enginesperformance-engineerquantizationspeculative-decoding

posted 3w ago · verified 2d ago

Sierraai startup

San Francisco, CA · onsite · $230K–$390K/year · unknown

inferenceinference-enginesdistributed-inferencegpu-genericsoftware-engineer

posted 3w ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +6 more · senior

inferenceinference-enginesquantizationresearch-engineercuda

posted 4w ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · hybrid · unknown

performance-engineerpython-langcpp-langgpu-kernelsmodel-parallelism

posted 4w ago · verified 3d ago

Runpodneocloud

Remote - USA · remote · senior

inference-enginesgpu-genericinferenceperformance-engineerpython-lang

posted 4w ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +2 more · remote · senior

distributed-inferenceinferenceinference-engineskv-cache-systemsperformance-engineer

posted 5w ago · verified 3d ago

Nebiusneocloud

Remote - Europe · Zurich, Switzerland · senior

inferenceinference-enginesperformance-engineerpython-langquantization

posted 5w ago · verified 3d ago

Together AIneocloud

San Francisco · junior

inferenceinference-enginespython-langresearch-engineercuda

posted 6w ago · verified 3d ago

Together AIneocloud

San Francisco · junior

distributed-inferenceinferenceinference-enginesresearch-engineercuda

posted 6w ago · verified 3d ago

Modalinference provider

San Francisco · onsite · $300K–$350K/year · manager

eng-managerinferenceinference-enginesgpu-genericlinux-kernel

posted 6w ago · verified 2d ago