AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

412 roles

inference ✕

Fireworks AIinference provider

New York · San Mateo · hybrid · $200K–$230K/year · unknown

scheduling-orchestrationcpp-langnetwork-fabricpython-langstorage-checkpointing

posted 7w ago · verified 3d ago

Together AIneocloud

San Francisco · $270K–$300K/year est. · senior

inference-engineskv-cache-systemspython-langspeculative-decodinginference

posted 5mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · senior

distributed-inferenceinferenceinference-enginespython-langpytorch-dist

posted 7w ago · verified 3d ago

Luma AIai startup

New York, NY · Redwood City, CA +2 more · hybrid · $195K–$345K/year · unknown

inferenceinference-engineskubernetes-opspython-langreliability-sre

posted 3w ago · verified 3d ago

Luma AIai startup

London, UK · New York, NY +4 more · hybrid · $195K–$395K/year · unknown

cudagpu-kernelstriton-langperformance-engineernvidia

posted 3w ago · verified 3d ago

Hedraai startup

San Francisco · $175K–$275K/year · staff plus

software-engineerml-platforminference-enginesinferencescheduling-orchestration

posted 5mo ago · verified 3d ago

Sesameai startup

Bellevue · New York +1 more · onsite · $175K–$280K/year · senior

inferenceinference-enginesperformance-engineersglang-enginevllm-engine

posted 19mo ago · verified 3d ago

Cartesiaai startup

*HQ - San Francisco, CA · onsite · $180K–$250K/year · unknown

inferenceinference-enginessoftware-engineerml-platformdistributed-inference

posted 22mo ago · verified 3d ago

ElevenLabsai startup

Bulgaria · Poland +2 more · remote · unknown

inferenceinference-enginesresearch-engineercudagpu-generic

posted 9w ago · verified 3d ago

Harveyai startup

San Francisco · hybrid · $260K–$350K/year · manager

eng-managerinferenceml-platformobservabilityreliability-sre

posted 3mo ago · verified 3d ago

Nimble Roboticsai startup

San Francisco, CA · SFHQ · senior

cudagpu-genericgpu-kernelssoftware-engineercpp-lang

posted 10w ago · verified 3d ago

Figureai startup

HQ · San Jose, CA · $180K–$275K/year est. · staff plus

cpp-langinferenceinference-enginesperformance-engineerpython-lang

posted 4mo ago · verified 3d ago

Tenstorrentchip vendor

Tokyo · Tokyo, Japan · unknown

performance-engineerpython-langfine-tuninginferencepre-training

posted 11mo ago · verified 3d ago

Generalistai startup

San Francisco Bay Area (San Mateo) or Boston (Somerville) · onsite · $260K–$350K/year · unknown

cudagpu-kernelspython-langgpu-genericnvlink-topology

posted 8mo ago · verified 3d ago

Generalistai startup

San Francisco Bay Area (San Mateo) or Boston (Somerville) · onsite · $260K–$350K/year · unknown

gpu-genericnvidiasoftware-engineerinferencekubernetes-ops

posted 8mo ago · verified 3d ago

1Xai startup

San Carlos, CA · onsite · $250K–$350K/year · unknown

gpu-genericpre-trainingpython-langresearch-engineertraining-data-infra

posted 4mo ago · verified 3d ago

Lightning AIai startup

New York, New York, United States · San Francisco, California +3 more · $115K–$140K · unknown

cudagpu-generickubernetes-opsnccl-libobservability

posted 5mo ago · verified 3d ago

Lightning AIai startup

London, England, United Kingdom · London, UK · £75K–£95K · mid

gpu-generickubernetes-opscudaml-platformnccl-lib

posted 5mo ago · verified 3d ago

Lightning AIai startup

Philippines · Remote +1 more · unknown

cudagpu-generickubernetes-opsnccl-libobservability

posted 5mo ago · verified 3d ago

Etchedchip vendor

San Jose · onsite · unknown

cpp-langcustom-asicsoftware-engineerinferenceinference-engines

posted 5mo ago · verified 3d ago

Etchedchip vendor

San Jose · onsite · $200K–$400K/year · manager

observabilitycpp-langdistributed-inferenceperformance-engineercluster-datacenter

posted 8mo ago · verified 3d ago

Etchedchip vendor

San Jose · onsite · $175K–$370K/year · unknown

performance-engineercustom-asicinferencecudagpu-generic

posted 6mo ago · verified 3d ago

Etchedchip vendor

San Jose · onsite · junior

collectivescpp-langinference-enginespython-langdistributed-inference

posted 10mo ago · verified 3d ago

Etchedchip vendor

San Jose · onsite · $200K–$400K/year · unknown

cpp-langcustom-asicpython-langrust-langinference

posted 15mo ago · verified 3d ago

Etchedchip vendor

San Jose · onsite · $175K–$400K/year · unknown

cpp-langinferencesoftware-engineercollectivesdistributed-inference

posted 16mo ago · verified 3d ago

Etchedchip vendor

San Jose · onsite · $150K–$400K/year · unknown

cpp-langperformance-engineerrust-langinferenceinference-engines

posted 9mo ago · verified 3d ago