AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

Perplexityai startup

New York City · Remote (United States) +3 more · $250K–$485K/year · unknown

kubernetes-opssoftware-engineerml-platformnvidiascheduling-orchestration

posted 4d ago · verified 3d ago

Perplexityai startup

Palo Alto · San Francisco · $220K–$405K/year · unknown

cluster-datacentercpp-langgpu-genericinferencekubernetes-ops

posted 6mo ago · verified 3d ago

Perplexityai startup

New York City · Palo Alto +1 more · $220K–$485K/year · mid

cudagpu-kernelsinferenceinference-enginescutlass-cute

posted 6mo ago · verified 3d ago

Cerebraschip vendor

Bengaluru, IND · Sunnyvale, CA +1 more · hybrid · senior

cluster-datacentergo-langpython-langreliability-sresoftware-engineer

posted 11w ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · staff plus

inferenceinference-engineskv-cache-systemsperformance-engineerrocm-hip

posted 11d ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · onsite · mid

cpp-langgo-langinferencekubernetes-opsml-platform

posted 4mo ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · onsite · senior

ansibleinferenceinference-engineskubernetes-opsml-platform

posted 5mo ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · onsite · senior

amdcpp-langinferenceinference-enginespython-lang

posted 11mo ago · verified 3d ago

Cerebraschip vendor

Canada · United States · senior

cpp-langsoftware-engineerml-platforminferencepython-lang

posted 12mo ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · onsite · senior

kubernetes-opssoftware-engineerml-platformterraform-iacgo-lang

posted 28mo ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · onsite · staff plus

inferencekubernetes-opssoftware-engineergo-langml-platform

posted 4mo ago · verified 3d ago

Baseteninference provider

San Francisco · hybrid · $200K–$275K/year · unknown

gpu-genericmodel-parallelismpost-trainingpytorch-distresearch-engineer

posted 7mo ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $165K–$330K/year · senior

fine-tuningml-platformpost-trainingsoftware-engineerkubernetes-ops

posted 9mo ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $165K–$330K/year · senior

go-langkubernetes-opsml-platformobservabilityscheduling-orchestration

posted 14mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +4 more · hybrid · $165K–$330K/year · mid

inferenceinference-engineskubernetes-opsml-platformpython-lang

posted 20mo ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $245K–$325K · manager

eng-managerinferenceinference-enginespython-langml-platform

posted 5mo ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $245K–$325K · staff plus

inferenceinference-enginespython-langsoftware-engineerkubernetes-ops

posted 5mo ago · verified 3d ago

Anyscaleai startup

San Francisco · hybrid · $200K–$240K/year · mid

reliability-sresrego-langkubernetes-opspython-lang

posted 9w ago · verified 3d ago

Anyscaleai startup

San Francisco · hybrid · $215K–$265K/year · staff plus

go-langkubernetes-opspython-langsoftware-engineerray-distributed

posted 5w ago · verified 3d ago

Anyscaleai startup

San Francisco · hybrid · $200K–$240K/year · mid

kubernetes-opsray-distributedsoftware-engineergo-langml-platform

posted 10w ago · verified 3d ago

Anyscaleai startup

Bengaluru, Karnataka · unknown

ray-distributedsoftware-engineercpp-langscheduling-orchestrationml-platform

posted 3mo ago · verified 3d ago

Modalinference provider

New York · San Francisco · $150K–$350K/year · unknown

inferencespeculative-decodingkv-cache-systemsquantizationresearch-engineer

posted 3mo ago · verified 3d ago

Modalinference provider

New York · $275K–$330K/year · manager

eng-managercpp-langrust-langml-platformgpu-generic

posted 9mo ago · verified 3d ago

Modalinference provider

New York · San Francisco · onsite · $180K–$240K/year · mid

kubernetes-opssolutions-architectterraform-iacscheduling-orchestrationgpu-generic

posted 13mo ago · verified 3d ago

Fireworks AIinference provider

Greater Seattle Area · New York +1 more · hybrid · $175K–$220K/year · unknown

python-langsoftware-engineergo-langinferenceinference-engines

posted 12mo ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo · hybrid · $175K–$220K/year · senior

software-engineerkubernetes-opsml-platformpython-langobservability

posted 16mo ago · verified 3d ago

Fireworks AIinference provider

Greater Seattle Area · New York +2 more · hybrid · $210K–$320K/year · unknown

fsdpkubernetes-opsmodel-parallelismsoftware-engineertraining-frameworks

posted 3mo ago · verified 3d ago