AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1297 open roles · 85 companies · last verified today

409 roles

ml-platform

DeepInfrainference provider

Palo Alto, United States · onsite · mid

cudainferencepython-langsoftware-engineercpp-lang

posted 5mo ago · verified today

DeepInfrainference provider

Bulgaria - Remote · remote · junior

cpp-langcudainferencepython-langsoftware-engineer

posted 7mo ago · verified today

DeepInfrainference provider

Palo Alto, United States · onsite · $140K–$150K/year est. · junior

inference-enginessoftware-engineercpp-langcudaml-platform

posted 8mo ago · verified today

Fish Audio (39 AI)ai startup

Location not specified · senior

cluster-datacentergpu-genericreliability-sresrekubernetes-ops

added 7d ago · verified today

Interfazeinference provider

San Francisco, CA · senior

fine-tuninginferenceinference-enginespython-langquantization

added 7d ago · verified today

Runwareinference provider

France · Germany +3 more · remote · senior

software-engineergo-langscheduling-orchestrationinferenceml-platform

posted 20d ago · verified today

Runwareinference provider

United Kingdom · remote · senior

gpu-genericinferencenvidiareliability-sresre

posted 4mo ago · verified today

Relaceinference provider

San Francisco · onsite · mid

software-engineercluster-datacenterscheduling-orchestrationinferenceml-platform

posted 10mo ago · verified today

Exaai startup

Singapore · onsite · 90K–300K SGD/year · unknown

cluster-datacenterkubernetes-opsscheduling-orchestrationsoftware-engineerdistributed-inference

posted 6mo ago · verified today

Exaai startup

San Francisco, California · onsite · $180K–$350K/year · unknown

software-engineergpu-generickubernetes-opsml-platformray-distributed

posted 12mo ago · verified today

Inceptionfrontier lab

San Mateo, United States · onsite · senior

inferenceinference-enginespython-langsoftware-engineergpu-generic

posted 6mo ago · verified today

Inceptionfrontier lab

San Mateo, United States · onsite · unknown

reinforcement-learningml-platformpost-trainingray-distributedsoftware-engineer

posted 6mo ago · verified today

Inceptionfrontier lab

San Mateo, United States · onsite · unknown

python-langsoftware-engineertraining-frameworksgpu-genericpytorch-dist

posted 6mo ago · verified today

Inceptionfrontier lab

San Mateo, United States · onsite · unknown

cudagpu-genericinferenceinference-engineskubernetes-ops

posted 6mo ago · verified today

Novita AIinference provider

San Mateo · onsite · unknown

kubernetes-opspython-langsolutions-architectinferenceinference-engines

posted 11w ago · verified today

Arcee AIfrontier lab

San Francisco, CA · SF, CA · unknown

cluster-datacentergpu-generickubernetes-opsreliability-sresre

posted 3mo ago · verified today

Black Forest Labsfrontier lab

San Francisco (United States) · onsite · unknown

cudagpu-genericinferenceinference-enginesperformance-engineer

posted 24mo ago · verified today

Fireworks AIinference provider

New York · San Mateo · hybrid · $200K–$230K/year · unknown

scheduling-orchestrationcpp-langnetwork-fabricpython-langstorage-checkpointing

posted 8d ago · verified today

Nscaleneocloud

Houston · San Francisco +1 more · $170K–$265K · senior

reliability-sresrego-langkubernetes-opsobservability

posted 5mo ago · verified today

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · senior

distributed-inferenceinferenceinference-enginespython-langpytorch-dist

posted 9d ago · verified today

Harveyai startup

San Francisco · hybrid · $231K–$340K/year · staff plus

inferenceinference-enginessoftware-engineerml-platformobservability

posted 9d ago · verified today

Lila Sciencesai startup

Alewife, Cambridge, MA · Cambridge, MA USA +4 more · $224K–$294K · staff plus

gpu-generickubernetes-opsml-platformpython-langray-distributed

posted 6w ago · verified today

Lila Sciencesai startup

Alewife, Cambridge, MA · Cambridge, MA USA · $192K–$272K · staff plus

inferenceinference-engineskubernetes-opsml-platformnvidia

posted 7w ago · verified today

Lila Sciencesai startup

Cambridge, MA USA · One Charles Park, Cambridge, MA · $148K–$210K · senior

go-langkubernetes-opspython-langsoftware-engineerray-distributed

posted 11mo ago · verified today

Lila Sciencesai startup

San Francisco, CA · San Francisco, CA USA · $268K–$384K · staff plus

ml-platformgpu-genericsoftware-engineertraining-frameworksinference-engines

posted 4mo ago · verified today

Lila Sciencesai startup

Cambridge, MA USA · One Charles Park, Cambridge, MA +1 more · $189K–$289K · unknown

post-trainingpython-langresearch-engineerreinforcement-learningtraining-frameworks

posted 11mo ago · verified today