AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1295 open roles · 85 companies · last verified today

379 roles

inference

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $180K–$255K · senior

inferenceperformance-engineercpp-langdistributed-inferenceinference-engines

posted 9mo ago · verified today

SambaNovachip vendor

Bengaluru, India · Bengaluru, Karnataka, India · 3324K–4062K INR · unknown

python-langsolutions-architectinferencefine-tuningkubernetes-ops

posted 9w ago · verified today

Scale AIai startup

New York, NY · San Francisco, CA · $290K–$363K · manager

cudaeng-managerpost-trainingtraining-frameworksflash-attention

posted 11mo ago · verified today

Scale AIai startup

New York, NY · San Francisco, CA +2 more · unknown

inferenceinference-enginessoftware-engineerkubernetes-opsnetwork-fabric

posted 31mo ago · verified today

Anyscaleai startup

Palo Alto · San Francisco · hybrid · $170K–$245K/year · unknown

distributed-inferenceinferenceinference-enginessoftware-engineervllm-engine

posted 3mo ago · verified today

Modalinference provider

New York · San Francisco · $150K–$350K/year · unknown

inferenceinference-engineskv-cache-systemsquantizationresearch-engineer

posted 10w ago · verified today

Modalinference provider

London · New York +2 more · onsite · $200K–$280K/year · senior

solutions-architectkubernetes-opsml-platformpython-langterraform-iac

posted 6mo ago · verified today

Modalinference provider

London · New York +2 more · $150K–$220K/year · unknown

solutions-architectgpu-genericsoftware-engineerml-platforminference

posted 11mo ago · verified today

Modalinference provider

New York · San Francisco · $200K–$350K/year · senior

performance-engineercudagpu-kernelsinference-enginesnvidia

posted 4mo ago · verified today

Modalinference provider

New York · San Francisco · $180K–$250K/year · unknown

solutions-architectsglang-enginevllm-engineperformance-engineerinference

posted 6mo ago · verified today

Modalinference provider

New York · San Francisco · onsite · $220K–$300K/year · senior

ml-platformsoftware-engineerlinux-kernelscheduling-orchestrationreliability-sre

posted 23mo ago · verified today

Fireworks AIinference provider

New York · San Mateo · hybrid · $200K–$260K/year · unknown

fine-tuningpython-langsglang-enginesolutions-architectvllm-engine

posted 3mo ago · verified today

Fireworks AIinference provider

London · senior

fine-tuninginferenceinference-enginespython-langsglang-engine

posted 8w ago · verified today

Fireworks AIinference provider

Singapore · 200K–350K SGD/year · senior

fine-tuninginferenceinference-enginespython-langsglang-engine

posted 8w ago · verified today

Fireworks AIinference provider

San Mateo · hybrid · $175K–$220K/year · unknown

ml-platformpython-langsoftware-engineerinferenceinference-engines

posted 10mo ago · verified today

Fireworks AIinference provider

San Mateo · hybrid · $210K–$320K/year · mid

evaluationpost-trainingfine-tuningml-platforminference

posted 10mo ago · verified today

Fireworks AIinference provider

New York · San Mateo · hybrid · $175K–$220K/year · senior

software-engineerkubernetes-opsml-platformpython-langobservability

posted 15mo ago · verified today

Fireworks AIinference provider

San Mateo · hybrid · $175K–$220K/year · unknown

gpu-kernelsperformance-engineercudagpu-genericsoftware-engineer

posted 16mo ago · verified today

xAIfrontier lab

Palo Alto, CA · $180K–$440K/year est. · unknown

cpp-langgpu-genericgpu-kernelsinferenceinference-engines

posted 23mo ago · verified today

xAIfrontier lab

Palo Alto, CA · $180K–$440K/year est. · mid

gpu-genericml-platformpython-langsoftware-engineercpp-lang

posted 8w ago · verified today

xAIfrontier lab

Palo Alto, CA · $180K–$440K/year est. · unknown

cpp-langcudadistributed-inferenceinferenceinference-engines

posted 10w ago · verified today

xAIfrontier lab

Palo Alto, CA · $180K–$440K/year est. · unknown

gpu-genericpost-trainingpre-trainingpython-langresearch-engineer

posted 5mo ago · verified today

xAIfrontier lab

London · London, England, United Kingdom · £107K–£262K/year est. · unknown

cpp-langinferenceinference-enginesml-platformobservability

posted 4mo ago · verified today

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $188K–$275K/year est. · staff plus

inferenceinference-enginesdistributed-inferencegpu-generickubernetes-ops

posted 4mo ago · verified today

CoreWeaveneocloud

Bellevue, WA · Bellevue, WA - US +5 more · $188K–$303K/year est. · manager

eng-managerinferenceinference-engineskubernetes-opsreliability-sre

posted 9mo ago · verified today

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $92K–$135K/year est. · junior

inferencepython-langsoftware-engineergo-langinference-engines

posted 10mo ago · verified today

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $152K–$204K/year est. · senior

cudadistributed-inferencego-langgpu-genericgpu-kernels

posted 11mo ago · verified today