AI infrastructure roles, filterable by the stack you actually work on.
Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.
1538 open roles · 87 companies · last verified 3d ago
301 roles
DeepInfrainference provider
Palo Alto, United States · onsite · mid
cudainferencepython-langsoftware-engineercpp-lang
posted 7mo ago · verified 3d ago
DeepInfrainference provider
Palo Alto, United States · onsite · $140K–$150K/year est. · junior
inference-enginessoftware-engineercpp-langcudaml-platform
posted 9mo ago · verified 3d ago
DeepInfrainference provider
Bulgaria - Remote · remote · junior
cudanccl-libpython-langsoftware-engineercpp-lang
posted 12mo ago · verified 3d ago
DeepInfrainference provider
Palo Alto, United States · onsite · junior
cpp-langcudanccl-libpython-langsoftware-engineer
posted 12mo ago · verified 3d ago
Sakana AIfrontier lab
Tokyo · unknown
reliability-srenvidiainferencesregpu-generic
added 7w ago · verified 3d ago
Fish Audio (39 AI)ai startup
Location not specified · senior
cluster-datacentergpu-genericreliability-sresrekubernetes-ops
added 7w ago · verified 3d ago
Fish Audio (39 AI)ai startup
Location not specified · unknown
cpp-langinference-enginespython-langinferencemegatron-lm
added 7w ago · verified 3d ago
Interfazeinference provider
San Francisco, CA · senior
fine-tuninginferenceinference-enginespython-langquantization
added 7w ago · verified 11d ago
Waferinference provider
San Francisco · onsite · $200K–$300K/year · unknown
gpu-kernelsinferenceinference-enginescluster-datacenterperformance-engineer
posted 3mo ago · verified 3d ago
Runwareinference provider
United Kingdom · remote · senior
gpu-genericinferencenvidiareliability-sresre
posted 6mo ago · verified 3d ago
Relaceinference provider
San Francisco · onsite · mid
software-engineercluster-datacenterscheduling-orchestrationinferenceml-platform
posted 12mo ago · verified 10d ago
Inceptionfrontier lab
San Mateo, United States · onsite · unknown
cudagpu-genericinferenceinference-engineskubernetes-ops
posted 7mo ago · verified 3d ago
Novita AIinference provider
San Mateo · onsite · unknown
kubernetes-opspython-langsolutions-architectinferenceinference-engines
posted 4mo ago · verified 3d ago
Crusoeneocloud
San Francisco, CA - US · onsite · staff plus
inferenceinference-enginesperformance-engineersglang-enginevllm-engine
posted 7w ago · verified 3d ago
Xaira Therapeuticsai startup
Seattle, WA · Seattle, Washington, United States +1 more · $205K–$305K/year est. · senior
gpu-kernelsresearch-engineergpu-genericperformance-engineerinference
posted 12mo ago · verified 3d ago
Fireworks AIinference provider
New York · San Mateo · hybrid · $200K–$230K/year · unknown
scheduling-orchestrationcpp-langnetwork-fabricpython-langstorage-checkpointing
posted 7w ago · verified 3d ago
Together AIneocloud
San Francisco · $270K–$300K/year est. · senior
inference-engineskv-cache-systemspython-langspeculative-decodinginference
posted 5mo ago · verified 3d ago
Amazon (AWS)hyperscaler
Seattle, Washington, USA · onsite · senior
distributed-inferenceinferenceinference-enginespython-langpytorch-dist
posted 7w ago · verified 3d ago
Lila Sciencesai startup
San Francisco, CA · San Francisco, CA USA · $268K–$384K · staff plus
ml-platformgpu-genericsoftware-engineertraining-frameworksinference-engines
posted 6mo ago · verified 3d ago
Abridgeai startup
SF Office · hybrid · $221K–$260K/year · senior
inference-engineskubernetes-opsml-platformgpu-genericscheduling-orchestration
posted 14mo ago · verified 3d ago
Genesis Molecular AIai startup
New York, NY · San Mateo, CA · hybrid · senior
research-engineergpu-genericpre-trainingpython-langcuda
posted 15mo ago · verified 3d ago
Sunoai startup
Boston · onsite · $229K–$364K/year · senior
software-engineerkubernetes-opsml-platforminference-enginesobservability
posted 30mo ago · verified 3d ago
Luma AIai startup
New York, NY · Redwood City, CA +2 more · hybrid · $195K–$345K/year · unknown
inferenceinference-engineskubernetes-opspython-langreliability-sre
posted 3w ago · verified 3d ago
Luma AIai startup
New York, NY · Redwood City, CA +2 more · hybrid · $195K–$395K/year · unknown
post-trainingreinforcement-learningresearch-engineerdistributed-inferencefsdp
posted 3mo ago · verified 3d ago
Hedraai startup
San Francisco · $175K–$275K/year · staff plus
software-engineerml-platforminference-enginesinferencescheduling-orchestration
posted 5mo ago · verified 3d ago
Sesameai startup
Bellevue · New York +1 more · onsite · $175K–$280K/year · senior
inferenceinference-enginesperformance-engineersglang-enginevllm-engine
posted 19mo ago · verified 3d ago
Cartesiaai startup
*HQ - San Francisco, CA · onsite · $180K–$250K/year · unknown
inferenceinference-enginessoftware-engineerml-platformdistributed-inference
posted 22mo ago · verified 3d ago
ElevenLabsai startup
Bulgaria · Poland +2 more · remote · unknown
inferenceinference-enginesresearch-engineercudagpu-generic
posted 9w ago · verified 3d ago
Harveyai startup
San Francisco · hybrid · $260K–$350K/year · manager
eng-managerinferenceml-platformobservabilityreliability-sre
posted 3mo ago · verified 3d ago
Nimble Roboticsai startup
San Francisco, CA · SFHQ · senior
cudagpu-genericgpu-kernelssoftware-engineercpp-lang
posted 10w ago · verified 3d ago