AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

130 roles

sglang-engine ✕

Hedraai startup

San Francisco · unknown

cudatriton-langgpu-kernelsinferencegpu-generic

posted 3w ago · verified 3d ago

River AIfrontier lab

HQ · Palo Alto, CA · $200K–$420K/year est. · unknown

cpp-langinferenceinference-enginespython-langsoftware-engineer

posted 7w ago · verified 3d ago

River AIfrontier lab

HQ · Palo Alto, CA · $200K–$420K/year est. · unknown

cpp-langcudacutlass-cutefine-tuninggpu-kernels

posted 7w ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $240K–$270K/year · manager

eng-managerinference-enginesgpu-genericgpu-kernelsinference

posted 3w ago · verified 3d ago

Baseteninference provider

London · Remote · hybrid · $145K–$290K/year · unknown

solutions-architectinferencesglang-enginetensorrt-stackvllm-engine

posted 5d ago · verified 3d ago

Mistral AIfrontier lab

London · Munich +1 more · hybrid · unknown

inferenceinference-enginescudadistributed-inferencegpu-generic

posted 3w ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $180K–$360K/year · unknown

inferenceml-platformsoftware-engineerdistributed-inferencegpu-generic

posted 3w ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $180K–$360K/year · unknown

inferenceinference-enginesperformance-engineerquantizationspeculative-decoding

posted 3w ago · verified 3d ago

Sierraai startup

San Francisco, CA · onsite · $230K–$390K/year · unknown

inferenceinference-enginesdistributed-inferencegpu-genericsoftware-engineer

posted 3w ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +6 more · senior

inferenceinference-enginesquantizationresearch-engineercuda

posted 4w ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · $200K–$400K/year · unknown

inferenceinference-enginesvllm-engineamdcuda

posted 4w ago · verified 3d ago

Parasailinference provider

Europe · Remote · manager

eng-managerreliability-sresregpu-genericinference

posted 4w ago · verified 3d ago

Parasailinference provider

Europe · Remote · senior

kubernetes-opsreliability-sresrecluster-datacentergpu-generic

posted 4w ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo · hybrid · $270K–$310K/year · manager

eng-managerevaluationfine-tuninginferencesglang-engine

posted 4w ago · verified 3d ago

Parasailinference provider

Remote · San Mateo · senior

gpu-generickubernetes-opsreliability-sresrecluster-datacenter

posted 5w ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +2 more · remote · senior

distributed-inferenceinferenceinference-engineskv-cache-systemsperformance-engineer

posted 5w ago · verified 3d ago

Crusoeneocloud

San Francisco, CA - US · onsite · manager

eng-managerinferenceinference-enginessglang-enginevllm-engine

posted 5w ago · verified 3d ago

Crusoeneocloud

San Francisco, CA - US · onsite · staff plus

inferenceinference-enginesperformance-engineercudadistributed-inference

posted 5w ago · verified 3d ago

Nebiusneocloud

Remote - Europe · United Kingdom · remote · mid

inferenceinference-engineskubernetes-opsnvidiapython-lang

posted 6w ago · verified 3d ago

Nscaleneocloud

Houston · New York +2 more · $220K–$330K · staff plus

inferenceinference-engineskv-cache-systemspost-trainingpython-lang

posted 6w ago · verified 3d ago

SambaNovachip vendor

Tokyo, Japan · Tokyo Prefecture, Japan · 105K–130K JPY · senior

inferencepython-langsolutions-architectperformance-engineerevaluation

posted 6w ago · verified 3d ago