AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

301 roles

inference-engines ✕

DeepInfrainference provider

Palo Alto, United States · onsite · mid

cudainferencepython-langsoftware-engineercpp-lang

posted 7mo ago · verified 3d ago

DeepInfrainference provider

Palo Alto, United States · onsite · $140K–$150K/year est. · junior

inference-enginessoftware-engineercpp-langcudaml-platform

posted 9mo ago · verified 3d ago

DeepInfrainference provider

Bulgaria - Remote · remote · junior

cudanccl-libpython-langsoftware-engineercpp-lang

posted 12mo ago · verified 3d ago

DeepInfrainference provider

Palo Alto, United States · onsite · junior

cpp-langcudanccl-libpython-langsoftware-engineer

posted 12mo ago · verified 3d ago

Fish Audio (39 AI)ai startup

Location not specified · senior

cluster-datacentergpu-genericreliability-sresrekubernetes-ops

added 7w ago · verified 3d ago

Fish Audio (39 AI)ai startup

Location not specified · unknown

cpp-langinference-enginespython-langinferencemegatron-lm

added 7w ago · verified 3d ago

Interfazeinference provider

San Francisco, CA · senior

fine-tuninginferenceinference-enginespython-langquantization

added 7w ago · verified 11d ago

Waferinference provider

San Francisco · onsite · $200K–$300K/year · unknown

gpu-kernelsinferenceinference-enginescluster-datacenterperformance-engineer

posted 3mo ago · verified 3d ago

Runwareinference provider

United Kingdom · remote · senior

gpu-genericinferencenvidiareliability-sresre

posted 6mo ago · verified 3d ago

Relaceinference provider

San Francisco · onsite · mid

software-engineercluster-datacenterscheduling-orchestrationinferenceml-platform

posted 12mo ago · verified 10d ago

Inceptionfrontier lab

San Mateo, United States · onsite · unknown

cudagpu-genericinferenceinference-engineskubernetes-ops

posted 7mo ago · verified 3d ago

Novita AIinference provider

San Mateo · onsite · unknown

kubernetes-opspython-langsolutions-architectinferenceinference-engines

posted 4mo ago · verified 3d ago

Crusoeneocloud

San Francisco, CA - US · onsite · staff plus

inferenceinference-enginesperformance-engineersglang-enginevllm-engine

posted 7w ago · verified 3d ago

Xaira Therapeuticsai startup

Seattle, WA · Seattle, Washington, United States +1 more · $205K–$305K/year est. · senior

gpu-kernelsresearch-engineergpu-genericperformance-engineerinference

posted 12mo ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo · hybrid · $200K–$230K/year · unknown

scheduling-orchestrationcpp-langnetwork-fabricpython-langstorage-checkpointing

posted 7w ago · verified 3d ago

Together AIneocloud

San Francisco · $270K–$300K/year est. · senior

inference-engineskv-cache-systemspython-langspeculative-decodinginference

posted 5mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · senior

distributed-inferenceinferenceinference-enginespython-langpytorch-dist

posted 7w ago · verified 3d ago

Lila Sciencesai startup

San Francisco, CA · San Francisco, CA USA · $268K–$384K · staff plus

ml-platformgpu-genericsoftware-engineertraining-frameworksinference-engines

posted 6mo ago · verified 3d ago

Abridgeai startup

SF Office · hybrid · $221K–$260K/year · senior

inference-engineskubernetes-opsml-platformgpu-genericscheduling-orchestration

posted 14mo ago · verified 3d ago

Sunoai startup

Boston · onsite · $229K–$364K/year · senior

software-engineerkubernetes-opsml-platforminference-enginesobservability

posted 30mo ago · verified 3d ago

Luma AIai startup

New York, NY · Redwood City, CA +2 more · hybrid · $195K–$345K/year · unknown

inferenceinference-engineskubernetes-opspython-langreliability-sre

posted 3w ago · verified 3d ago

Luma AIai startup

New York, NY · Redwood City, CA +2 more · hybrid · $195K–$395K/year · unknown

post-trainingreinforcement-learningresearch-engineerdistributed-inferencefsdp

posted 3mo ago · verified 3d ago

Hedraai startup

San Francisco · $175K–$275K/year · staff plus

software-engineerml-platforminference-enginesinferencescheduling-orchestration

posted 5mo ago · verified 3d ago

Sesameai startup

Bellevue · New York +1 more · onsite · $175K–$280K/year · senior

inferenceinference-enginesperformance-engineersglang-enginevllm-engine

posted 19mo ago · verified 3d ago

Cartesiaai startup

*HQ - San Francisco, CA · onsite · $180K–$250K/year · unknown

inferenceinference-enginessoftware-engineerml-platformdistributed-inference

posted 22mo ago · verified 3d ago

ElevenLabsai startup

Bulgaria · Poland +2 more · remote · unknown

inferenceinference-enginesresearch-engineercudagpu-generic

posted 9w ago · verified 3d ago

Harveyai startup

San Francisco · hybrid · $260K–$350K/year · manager

eng-managerinferenceml-platformobservabilityreliability-sre

posted 3mo ago · verified 3d ago

Nimble Roboticsai startup

San Francisco, CA · SFHQ · senior

cudagpu-genericgpu-kernelssoftware-engineercpp-lang

posted 10w ago · verified 3d ago