AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

190 roles

vllm-engine ✕

Inceptionfrontier lab

San Mateo, United States · onsite · unknown

cudagpu-genericinferenceinference-engineskubernetes-ops

posted 7mo ago · verified 3d ago

Novita AIinference provider

San Mateo · onsite · unknown

kubernetes-opspython-langsolutions-architectinferenceinference-engines

posted 4mo ago · verified 3d ago

Crusoeneocloud

San Francisco, CA - US · onsite · staff plus

inferenceinference-enginesperformance-engineersglang-enginevllm-engine

posted 7w ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo · hybrid · $200K–$230K/year · unknown

scheduling-orchestrationcpp-langnetwork-fabricpython-langstorage-checkpointing

posted 7w ago · verified 3d ago

Together AIneocloud

San Francisco · $270K–$300K/year est. · senior

inference-engineskv-cache-systemspython-langspeculative-decodinginference

posted 5mo ago · verified 3d ago

Abridgeai startup

SF Office · hybrid · $221K–$260K/year · senior

inference-engineskubernetes-opsml-platformgpu-genericscheduling-orchestration

posted 14mo ago · verified 3d ago

Luma AIai startup

New York, NY · Redwood City, CA +2 more · hybrid · $195K–$345K/year · unknown

inferenceinference-engineskubernetes-opspython-langreliability-sre

posted 3w ago · verified 3d ago

Luma AIai startup

New York, NY · Redwood City, CA +2 more · hybrid · $195K–$395K/year · unknown

post-trainingreinforcement-learningresearch-engineerdistributed-inferencefsdp

posted 3mo ago · verified 3d ago

Sesameai startup

Bellevue · New York +1 more · onsite · $175K–$280K/year · senior

inferenceinference-enginesperformance-engineersglang-enginevllm-engine

posted 19mo ago · verified 3d ago

Cartesiaai startup

*HQ - San Francisco, CA · onsite · $180K–$250K/year · unknown

inferenceinference-enginessoftware-engineerml-platformdistributed-inference

posted 22mo ago · verified 3d ago

ElevenLabsai startup

Bulgaria · Poland +2 more · remote · unknown

inferenceinference-enginesresearch-engineercudagpu-generic

posted 9w ago · verified 3d ago

Figureai startup

HQ · San Jose, CA · $200K–$400K/year est. · senior

gpu-kernelsperformance-engineercudapython-langtraining-frameworks

posted 11w ago · verified 3d ago

Etchedchip vendor

San Jose · onsite · junior

collectivescpp-langinference-enginespython-langdistributed-inference

posted 10mo ago · verified 3d ago

Coherefrontier lab

London · Montreal +3 more · remote · senior

python-langtraining-data-infradistributed-inferencegpu-genericinference-engines

posted 11mo ago · verified 3d ago

Coherefrontier lab

Montreal · New York +2 more · remote · unknown

cpp-langgpu-genericinferenceinference-enginesperformance-engineer

posted 11mo ago · verified 3d ago

Coherefrontier lab

Montreal · New York +2 more · remote · senior

cpp-langgpu-genericinferenceinference-enginesperformance-engineer

posted 11mo ago · verified 3d ago

Inferactinference provider

Remote · remote · unknown

inferenceinference-enginesvllm-enginepython-langsoftware-engineer

posted 8w ago · verified 3d ago

Inferactinference provider

Remote · remote · $200K–$400K/year · unknown

go-langkubernetes-opspython-langrust-langterraform-iac

posted 9w ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · $200K–$400K/year · unknown

reliability-sresreinferenceobservabilityvllm-engine

posted 5w ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · $200K–$400K/year · unknown

amdgpu-kernelsinferenceperformance-engineerrocm-hip

posted 4mo ago · verified 3d ago

Inferactinference provider

Singapore · onsite · 200K–400K SGD/year · unknown

tpuinferenceinference-enginesjax-pallasperformance-engineer

posted 4mo ago · verified 3d ago

Inferactinference provider

Singapore · onsite · 200K–400K SGD/year · unknown

amdgpu-kernelsinferenceinference-enginesperformance-engineer

posted 4mo ago · verified 3d ago

Inferactinference provider

Singapore · onsite · 200K–400K SGD/year · unknown

software-engineerdistributed-inferenceinference-enginesinfiniband-opsnvlink-topology

posted 4mo ago · verified 3d ago

Inferactinference provider

Singapore · onsite · 200K–400K SGD/year · unknown

vllm-engineinferenceinference-engineskv-cache-systemspython-lang

posted 4mo ago · verified 3d ago

Inferactinference provider

Singapore · onsite · 200K–400K SGD/year · unknown

cluster-datacentergo-langgpu-genericinferencekubernetes-ops

posted 4mo ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · $200K–$400K/year · unknown

inferenceinference-enginespython-langvllm-enginesoftware-engineer

posted 4mo ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · $200K–$400K/year · unknown

tpuinference-enginesjax-pallasperformance-engineerxla-compiler

posted 4mo ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · $200K–$400K/year · unknown

kubernetes-opssoftware-engineercluster-datacentergo-langinference

posted 9mo ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · $200K–$400K/year · unknown

distributed-inferenceinference-enginesvllm-enginecpp-langgo-lang

posted 9mo ago · verified 3d ago