AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

659 roles

software-engineer ✕

Fish Audio (39 AI)ai startup

Location not specified · unknown

cpp-langinference-enginespython-langinferencemegatron-lm

added 7w ago · verified 3d ago

Interfazeinference provider

San Francisco, CA · senior

fine-tuninginferenceinference-enginespython-langquantization

added 7w ago · verified 11d ago

Waferinference provider

San Francisco · onsite · $200K–$300K/year · unknown

gpu-kernelsinferenceinference-enginescluster-datacenterperformance-engineer

posted 3mo ago · verified 3d ago

Runwareinference provider

France · Germany +3 more · remote · senior

software-engineergo-langml-platformobservabilityscheduling-orchestration

posted 6d ago · verified 3d ago

Relaceinference provider

San Francisco · onsite · mid

cudagpu-kernelsperformance-engineersoftware-engineercpp-lang

posted 12mo ago · verified 11d ago

Relaceinference provider

San Francisco · onsite · mid

software-engineercluster-datacenterscheduling-orchestrationinferenceml-platform

posted 12mo ago · verified 11d ago

Inceptionfrontier lab

San Mateo, United States · onsite · unknown

reinforcement-learningml-platformpost-trainingray-distributedsoftware-engineer

posted 7mo ago · verified 3d ago

Inceptionfrontier lab

San Mateo, United States · onsite · unknown

python-langsoftware-engineertraining-frameworksgpu-genericpytorch-dist

posted 7mo ago · verified 3d ago

Inceptionfrontier lab

San Mateo, United States · onsite · unknown

cudagpu-genericinferenceinference-engineskubernetes-ops

posted 7mo ago · verified 3d ago

Baseteninference provider

San Francisco · hybrid · $170K–$230K/year · manager

gpu-generickubernetes-opsnvidiacluster-datacentergo-lang

posted 7w ago · verified 3d ago

Crusoeneocloud

San Francisco, CA - US · onsite · staff plus

inferenceinference-enginesperformance-engineersglang-enginevllm-engine

posted 7w ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo · hybrid · $200K–$230K/year · unknown

scheduling-orchestrationcpp-langnetwork-fabricpython-langstorage-checkpointing

posted 7w ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · mid

custom-asicpython-langtrainiumdatacenter-engineerrtl-design

posted 7w ago · verified 3d ago

Nscaleneocloud

Houston · New York +2 more · $130K–$200K/year est. · mid

reliability-sresrego-langobservabilitypython-lang

posted 7w ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · senior

distributed-inferenceinferenceinference-enginespython-langpytorch-dist

posted 7w ago · verified 3d ago

Lila Sciencesai startup

Alewife, Cambridge, MA · Cambridge, MA USA +2 more · $180K–$298K · staff plus

evaluationpython-langfine-tuningdeepspeed-libmegatron-lm

posted 4mo ago · verified 3d ago

Lila Sciencesai startup

Cambridge, MA USA · One Charles Park, Cambridge, MA · $144K–$240K · unknown

go-langkubernetes-opspython-langray-distributedsoftware-engineer

posted 13mo ago · verified 3d ago

Lila Sciencesai startup

San Francisco, CA · San Francisco, CA USA · $268K–$384K · staff plus

ml-platformgpu-genericsoftware-engineertraining-frameworksinference-engines

posted 6mo ago · verified 3d ago

Xaira Therapeuticsai startup

Seattle, WA · Seattle, Washington, United States · $205K–$275K/year est. · senior

gpu-genericml-platformpython-langsoftware-engineeransible

posted 4mo ago · verified 3d ago

Echo Neurotechnologiesai startup

San Francisco · SF Office · senior

ml-platformpython-langpytorch-distsoftware-engineertraining-frameworks

posted 3mo ago · verified 3d ago

Prior Labsai startup

Berlin · Freiburg +1 more · onsite · unknown

cluster-datacentergpu-genericpython-langpytorch-distscheduling-orchestration

posted 12w ago · verified 3d ago

Abridgeai startup

SF Office · hybrid · $221K–$260K/year · senior

inference-engineskubernetes-opsml-platformgpu-genericscheduling-orchestration

posted 14mo ago · verified 3d ago

Sunoai startup

Boston · onsite · $229K–$364K/year · senior

software-engineerkubernetes-opsml-platforminference-enginesobservability

posted 30mo ago · verified 3d ago

Luma AIai startup

London, UK · New York, NY +6 more · hybrid · $195K–$395K/year · senior

fsdpgpu-genericpytorch-disttraining-frameworkscollectives

posted 3w ago · verified 3d ago

Hedraai startup

San Francisco · $175K–$275K/year · staff plus

software-engineerml-platforminference-enginesinferencescheduling-orchestration

posted 5mo ago · verified 3d ago

Sesameai startup

Bellevue · New York +1 more · onsite · $175K–$280K/year · senior

inferenceinference-enginesperformance-engineersglang-enginevllm-engine

posted 19mo ago · verified 3d ago

Cartesiaai startup

*HQ - San Francisco, CA · onsite · $180K–$250K/year · unknown

inferenceinference-enginessoftware-engineerml-platformdistributed-inference

posted 22mo ago · verified 3d ago