AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

Waferinference provider

San Francisco · onsite · $200K–$300K/year · unknown

gpu-kernelsinferenceinference-enginescluster-datacenterperformance-engineer

posted 3mo ago · verified 3d ago

Inceptionfrontier lab

San Mateo, United States · onsite · unknown

cudagpu-genericinferenceinference-engineskubernetes-ops

posted 7mo ago · verified 3d ago

Novita AIinference provider

San Mateo · onsite · unknown

kubernetes-opspython-langsolutions-architectinferenceinference-engines

posted 4mo ago · verified 3d ago

Crusoeneocloud

San Francisco, CA - US · onsite · staff plus

inferenceinference-enginesperformance-engineersglang-enginevllm-engine

posted 7w ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo · hybrid · $200K–$230K/year · unknown

scheduling-orchestrationcpp-langnetwork-fabricpython-langstorage-checkpointing

posted 7w ago · verified 3d ago

Together AIneocloud

San Francisco · $270K–$300K/year est. · senior

inference-engineskv-cache-systemspython-langspeculative-decodinginference

posted 5mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · senior

distributed-inferenceinferenceinference-enginespython-langpytorch-dist

posted 7w ago · verified 3d ago

Lila Sciencesai startup

San Francisco, CA · San Francisco, CA USA · $268K–$384K · staff plus

ml-platformgpu-genericsoftware-engineertraining-frameworksinference-engines

posted 6mo ago · verified 3d ago

Echo Neurotechnologiesai startup

San Francisco · SF Office · senior

ml-platformpython-langpytorch-distsoftware-engineertraining-frameworks

posted 3mo ago · verified 3d ago

Luma AIai startup

New York, NY · Redwood City, CA +2 more · hybrid · $195K–$395K/year · unknown

post-trainingreinforcement-learningresearch-engineerdistributed-inferencefsdp

posted 3mo ago · verified 3d ago

Cartesiaai startup

*HQ - San Francisco, CA · onsite · $180K–$250K/year · unknown

inferenceinference-enginessoftware-engineerml-platformdistributed-inference

posted 22mo ago · verified 3d ago

Tenstorrentchip vendor

Austin, Texas, United States · Santa Clara +2 more · $100K–$500K/year est. · unknown

network-fabricsoftware-engineercollectivescpp-langdistributed-inference

posted 19mo ago · verified 3d ago

Generalistai startup

San Francisco Bay Area (San Mateo) or Boston (Somerville) · onsite · $260K–$350K/year · unknown

gpu-genericnvidiasoftware-engineerinferencekubernetes-ops

posted 8mo ago · verified 3d ago

1Xai startup

San Carlos, CA · onsite · $250K–$350K/year · unknown

gpu-genericpre-trainingpython-langresearch-engineertraining-data-infra

posted 4mo ago · verified 3d ago

Lightning AIai startup

New York, New York, United States · San Francisco, California +3 more · $115K–$140K · unknown

cudagpu-generickubernetes-opsnccl-libobservability

posted 5mo ago · verified 3d ago

Lightning AIai startup

London, England, United Kingdom · London, UK · £75K–£95K · mid

gpu-generickubernetes-opscudaml-platformnccl-lib

posted 5mo ago · verified 3d ago

Lightning AIai startup

Philippines · Remote +1 more · unknown

cudagpu-generickubernetes-opsnccl-libobservability

posted 5mo ago · verified 3d ago

Etchedchip vendor

San Jose · onsite · $200K–$400K/year · manager

observabilitycpp-langdistributed-inferenceperformance-engineercluster-datacenter

posted 8mo ago · verified 3d ago

Etchedchip vendor

San Jose · onsite · junior

collectivescpp-langinference-enginespython-langdistributed-inference

posted 10mo ago · verified 3d ago

Etchedchip vendor

San Jose · onsite · $175K–$400K/year · unknown

cpp-langinferencesoftware-engineercollectivesdistributed-inference

posted 16mo ago · verified 3d ago

Etchedchip vendor

San Jose · onsite · $150K–$400K/year · unknown

cpp-langperformance-engineerrust-langinferenceinference-engines

posted 9mo ago · verified 3d ago

Coherefrontier lab

Montreal · New York +2 more · hybrid · staff plus

software-engineerinferenceinference-engineskubernetes-opscpp-lang

posted 9mo ago · verified 3d ago

Coherefrontier lab

London · Montreal +3 more · remote · senior

python-langtraining-data-infradistributed-inferencegpu-genericinference-engines

posted 11mo ago · verified 3d ago

Coherefrontier lab

London · Montreal +4 more · remote · senior

training-frameworksdistributed-inferencepre-trainingcudakubernetes-ops

posted 11mo ago · verified 3d ago

Coherefrontier lab

Montreal · New York +2 more · remote · unknown

cpp-langgpu-genericinferenceinference-enginesperformance-engineer

posted 11mo ago · verified 3d ago

falinference provider

San Francisco · $180K–$250K/year · senior

software-engineerpython-langrust-langscheduling-orchestrationcluster-datacenter

posted 15mo ago · verified 3d ago

Parasailinference provider

San Mateo · senior

inferencereliability-sresreobservabilitykubernetes-ops

posted 5w ago · verified 3d ago

Inferactinference provider

Remote · remote · unknown

inferenceinference-enginesvllm-enginepython-langsoftware-engineer

posted 8w ago · verified 3d ago