AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

713 roles

python-lang ✕

Cerebraschip vendor

Toronto, CAN · hybrid · mid

cpp-langinference-enginesmlir-llvmpython-langsoftware-engineer

posted 15mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

go-langml-platformpython-langsoftware-engineerkubernetes-ops

posted 11w ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

inferenceinference-enginessoftware-engineergpu-genericperformance-engineer

posted 6mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

collectivescpp-langdistributed-inferenceinferenceinfiniband-ops

posted 8mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · mid

performance-engineerinferenceinference-enginesnvidiaobservability

posted 9mo ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $165K–$330K/year · senior

go-langkubernetes-opsml-platformobservabilityscheduling-orchestration

posted 14mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +4 more · hybrid · $165K–$330K/year · mid

inferenceinference-engineskubernetes-opsml-platformpython-lang

posted 20mo ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $245K–$325K · manager

eng-managerinferenceinference-enginespython-langml-platform

posted 5mo ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $245K–$325K · staff plus

inferenceinference-enginespython-langsoftware-engineerkubernetes-ops

posted 5mo ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $200K–$275K · senior

inferenceinference-enginespython-langvllm-enginesoftware-engineer

posted 5mo ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $180K–$255K · senior

inferenceperformance-engineercpp-langdistributed-inferenceinference-engines

posted 11mo ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $150K–$190K · unknown

datacenter-engineercluster-datacentergo-langpython-langnetwork-fabric

posted 3mo ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $180K–$255K · staff plus

cpp-langlinux-kernelnetwork-fabricrdma-verbssoftware-engineer

posted 6mo ago · verified 3d ago

SambaNovachip vendor

Bengaluru, India · Bengaluru, Karnataka, India · 3324K–4062K INR · unknown

python-langsolutions-architectinferencefine-tuningkubernetes-ops

posted 3mo ago · verified 3d ago

SambaNovachip vendor

Bengaluru, India · Bengaluru, Karnataka, India · 8900K–10800K INR · staff plus

ansiblego-langinferenceinference-engineskubernetes-ops

posted 4mo ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +3 more · remote · $250K–$350K · staff plus

network-fabriccustom-asicnetwork-engineercpp-langpython-lang

posted 3mo ago · verified 3d ago

Anyscaleai startup

San Francisco · hybrid · $200K–$240K/year · mid

reliability-sresrego-langkubernetes-opspython-lang

posted 9w ago · verified 3d ago

Anyscaleai startup

San Francisco · hybrid · $215K–$265K/year · staff plus

go-langkubernetes-opspython-langsoftware-engineerray-distributed

posted 5w ago · verified 3d ago

Anyscaleai startup

San Francisco · hybrid · $200K–$240K/year · mid

kubernetes-opsray-distributedsoftware-engineergo-langml-platform

posted 10w ago · verified 3d ago

Modalinference provider

London · New York +2 more · onsite · $200K–$280K/year · unknown

solutions-architectkubernetes-opspython-langterraform-iac

posted 8mo ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo · hybrid · $200K–$260K/year · unknown

fine-tuningpython-langsglang-enginesolutions-architectvllm-engine

posted 4mo ago · verified 3d ago

Fireworks AIinference provider

London · hybrid · unknown

fine-tuninginferencepost-trainingpython-langgpu-generic

posted 8w ago · verified 3d ago

Fireworks AIinference provider

London · hybrid · senior

fine-tuninginferenceinference-enginespython-langsglang-engine

posted 3mo ago · verified 3d ago

Fireworks AIinference provider

Singapore · 200K–280K SGD/year · senior

solutions-architectfine-tuninginferenceinference-enginespython-lang

posted 3mo ago · verified 3d ago

Fireworks AIinference provider

Greater Seattle Area · New York +1 more · hybrid · $175K–$220K/year · unknown

python-langsoftware-engineergo-langinferenceinference-engines

posted 12mo ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo · hybrid · $175K–$220K/year · senior

software-engineerkubernetes-opsml-platformpython-langobservability

posted 16mo ago · verified 3d ago

xAIfrontier lab

Memphis, TN · Southaven, MS · manager

cluster-datacenterdatacenter-engineereng-managernetwork-fabricpython-lang

posted 12w ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · $150K–$450K/year est. · unknown

jax-pallaskubernetes-opspytorch-distsoftware-engineerevaluation

posted 7mo ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · $180K–$440K/year est. · unknown

gpu-genericpython-langsoftware-engineernvidiacluster-datacenter

posted 3mo ago · verified 3d ago