AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

130 roles

sglang-engine ✕

Inferactinference provider

San Francisco · onsite · junior

amdcudagpu-kernelsinferenceinference-engines

posted 6w ago · verified 3d ago

Mistral AIfrontier lab

Montréal · New York +1 more · remote · senior

solutions-architectgpu-genericscheduling-orchestrationcluster-datacenterinference

posted 7w ago · verified 3d ago

DigitalOceanneocloud

Bangalore Metro · Bengaluru · senior

amdcudainferenceinference-engineskubernetes-ops

posted 4mo ago · verified 3d ago

DigitalOceanneocloud

DigitalOcean Seattle Office · Seattle · $201K–$251K/year est. · manager

eng-managerkubernetes-opsscheduling-orchestrationdistributed-inferenceinference

posted 4mo ago · verified 3d ago

DeepInfrainference provider

Palo Alto, United States · onsite · unknown

inferenceinference-enginesnvidiapython-langsolutions-architect

posted 11w ago · verified 3d ago

Fish Audio (39 AI)ai startup

Location not specified · unknown

cpp-langinference-enginespython-langinferencemegatron-lm

added 7w ago · verified 3d ago

Inceptionfrontier lab

San Mateo, United States · onsite · unknown

cudagpu-genericinferenceinference-engineskubernetes-ops

posted 7mo ago · verified 3d ago

Novita AIinference provider

San Mateo · onsite · unknown

kubernetes-opspython-langsolutions-architectinferenceinference-engines

posted 4mo ago · verified 3d ago

Crusoeneocloud

San Francisco, CA - US · onsite · staff plus

inferenceinference-enginesperformance-engineersglang-enginevllm-engine

posted 7w ago · verified 3d ago

Together AIneocloud

San Francisco · $270K–$300K/year est. · senior

inference-engineskv-cache-systemspython-langspeculative-decodinginference

posted 5mo ago · verified 3d ago

Luma AIai startup

New York, NY · Redwood City, CA +2 more · hybrid · $195K–$345K/year · unknown

inferenceinference-engineskubernetes-opspython-langreliability-sre

posted 3w ago · verified 3d ago

Luma AIai startup

New York, NY · Redwood City, CA +2 more · hybrid · $195K–$395K/year · unknown

post-trainingreinforcement-learningresearch-engineerdistributed-inferencefsdp

posted 3mo ago · verified 3d ago

Sesameai startup

Bellevue · New York +1 more · onsite · $175K–$280K/year · senior

inferenceinference-enginesperformance-engineersglang-enginevllm-engine

posted 19mo ago · verified 3d ago

Cartesiaai startup

*HQ - San Francisco, CA · onsite · $180K–$250K/year · unknown

inferenceinference-enginessoftware-engineerml-platformdistributed-inference

posted 22mo ago · verified 3d ago

ElevenLabsai startup

Bulgaria · Poland +2 more · remote · unknown

inferenceinference-enginesresearch-engineercudagpu-generic

posted 9w ago · verified 3d ago

Etchedchip vendor

San Jose · onsite · junior

collectivescpp-langinference-enginespython-langdistributed-inference

posted 10mo ago · verified 3d ago

Coherefrontier lab

Montreal · New York +2 more · remote · unknown

cpp-langgpu-genericinferenceinference-enginesperformance-engineer

posted 11mo ago · verified 3d ago

Coherefrontier lab

Montreal · New York +2 more · remote · senior

cpp-langgpu-genericinferenceinference-enginesperformance-engineer

posted 11mo ago · verified 3d ago

Inferactinference provider

Remote · remote · unknown

inferenceinference-enginesvllm-enginepython-langsoftware-engineer

posted 8w ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · $200K–$400K/year · unknown

amdgpu-kernelsinferenceperformance-engineerrocm-hip

posted 4mo ago · verified 3d ago

Inferactinference provider

Singapore · onsite · 200K–400K SGD/year · unknown

tpuinferenceinference-enginesjax-pallasperformance-engineer

posted 4mo ago · verified 3d ago

Inferactinference provider

Singapore · onsite · 200K–400K SGD/year · unknown

amdgpu-kernelsinferenceinference-enginesperformance-engineer

posted 4mo ago · verified 3d ago

Inferactinference provider

Singapore · onsite · 200K–400K SGD/year · unknown

vllm-engineinferenceinference-engineskv-cache-systemspython-lang

posted 4mo ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · $200K–$400K/year · unknown

inferenceinference-enginespython-langvllm-enginesoftware-engineer

posted 4mo ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · $200K–$400K/year · unknown

tpuinference-enginesjax-pallasperformance-engineerxla-compiler

posted 4mo ago · verified 3d ago

Periodic Labsfrontier lab

Menlo Park, CA · onsite · unknown

collectivescudacutlass-cutedistributed-inferencefsdp

posted 6mo ago · verified 3d ago