AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

421 roles

ml-platform ✕

DigitalOceanneocloud

Bay Area Metro · New York · $150K–$186K/year est. · senior

solutions-architectkubernetes-opscudafine-tuninggpu-generic

posted 6mo ago · verified 3d ago

DigitalOceanneocloud

Bangalore Metro · Bengaluru · senior

amdcudainferenceinference-engineskubernetes-ops

posted 4mo ago · verified 3d ago

DigitalOceanneocloud

DigitalOcean Seattle Office · Seattle · $201K–$251K/year est. · manager

eng-managerkubernetes-opsscheduling-orchestrationdistributed-inferenceinference

posted 4mo ago · verified 3d ago

DeepInfrainference provider

Palo Alto, United States · onsite · mid

cudainferencepython-langsoftware-engineercpp-lang

posted 7mo ago · verified 3d ago

DeepInfrainference provider

Palo Alto, United States · onsite · $140K–$150K/year est. · junior

inference-enginessoftware-engineercpp-langcudaml-platform

posted 9mo ago · verified 3d ago

Fish Audio (39 AI)ai startup

Location not specified · senior

cluster-datacentergpu-genericreliability-sresrekubernetes-ops

added 7w ago · verified 3d ago

Interfazeinference provider

San Francisco, CA · senior

fine-tuninginferenceinference-enginespython-langquantization

added 7w ago · verified 11d ago

Runwareinference provider

France · Germany +3 more · remote · senior

software-engineergo-langml-platformobservabilityscheduling-orchestration

posted 6d ago · verified 3d ago

Runwareinference provider

Remote · remote · senior

observabilityreliability-sresrego-langkubernetes-ops

posted 3mo ago · verified 3d ago

Runwareinference provider

United Kingdom · remote · senior

gpu-genericinferencenvidiareliability-sresre

posted 6mo ago · verified 3d ago

Relaceinference provider

San Francisco · onsite · mid

software-engineercluster-datacenterscheduling-orchestrationinferenceml-platform

posted 12mo ago · verified 10d ago

Inceptionfrontier lab

San Mateo, United States · onsite · unknown

reinforcement-learningml-platformpost-trainingray-distributedsoftware-engineer

posted 7mo ago · verified 3d ago

Inceptionfrontier lab

San Mateo, United States · onsite · unknown

python-langsoftware-engineertraining-frameworksgpu-genericpytorch-dist

posted 7mo ago · verified 3d ago

Inceptionfrontier lab

San Mateo, United States · onsite · unknown

cudagpu-genericinferenceinference-engineskubernetes-ops

posted 7mo ago · verified 3d ago

Novita AIinference provider

San Mateo · onsite · unknown

kubernetes-opspython-langsolutions-architectinferenceinference-engines

posted 4mo ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo · hybrid · $200K–$230K/year · unknown

scheduling-orchestrationcpp-langnetwork-fabricpython-langstorage-checkpointing

posted 7w ago · verified 3d ago

Nscaleneocloud

Houston · San Francisco +1 more · $170K–$265K · senior

kubernetes-opsreliability-sresrego-langgpu-generic

posted 7mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Denver, Colorado, USA +1 more · onsite · senior

kubernetes-opssolutions-architectgpu-genericnvidiascheduling-orchestration

posted 7w ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · senior

distributed-inferenceinferenceinference-enginespython-langpytorch-dist

posted 7w ago · verified 3d ago

Lila Sciencesai startup

Cambridge, MA USA · One Charles Park, Cambridge, MA · $144K–$240K · unknown

go-langkubernetes-opspython-langray-distributedsoftware-engineer

posted 13mo ago · verified 3d ago

Lila Sciencesai startup

San Francisco, CA · San Francisco, CA USA · $268K–$384K · staff plus

ml-platformgpu-genericsoftware-engineertraining-frameworksinference-engines

posted 6mo ago · verified 3d ago

Xaira Therapeuticsai startup

Seattle, WA · Seattle, Washington, United States · $205K–$275K/year est. · senior

gpu-genericml-platformpython-langsoftware-engineeransible

posted 4mo ago · verified 3d ago

Echo Neurotechnologiesai startup

San Francisco · SF Office · senior

ml-platformpython-langpytorch-distsoftware-engineertraining-frameworks

posted 3mo ago · verified 3d ago

Prior Labsai startup

Berlin · Freiburg +1 more · onsite · unknown

cluster-datacentergpu-genericpython-langpytorch-distscheduling-orchestration

posted 12w ago · verified 3d ago

Abridgeai startup

SF Office · hybrid · $221K–$260K/year · senior

inference-engineskubernetes-opsml-platformgpu-genericscheduling-orchestration

posted 14mo ago · verified 3d ago

Sunoai startup

Boston · onsite · $229K–$364K/year · senior

software-engineerkubernetes-opsml-platforminference-enginesobservability

posted 30mo ago · verified 3d ago