AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

488 roles

kubernetes-ops ✕

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · onsite · senior

amdcpp-langinferenceinference-enginespython-lang

posted 11mo ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · onsite · senior

kubernetes-opssoftware-engineerml-platformterraform-iacgo-lang

posted 28mo ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · onsite · staff plus

inferencekubernetes-opssoftware-engineergo-langml-platform

posted 4mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

go-langml-platformpython-langsoftware-engineerkubernetes-ops

posted 11w ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

inferenceinference-enginessoftware-engineergpu-genericperformance-engineer

posted 6mo ago · verified 3d ago

Baseteninference provider

San Francisco · hybrid · $200K–$275K/year · unknown

gpu-genericmodel-parallelismpost-trainingpytorch-distresearch-engineer

posted 7mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

collectivescpp-langdistributed-inferenceinferenceinfiniband-ops

posted 8mo ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $165K–$330K/year · senior

fine-tuningml-platformpost-trainingsoftware-engineerkubernetes-ops

posted 9mo ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $165K–$330K/year · senior

go-langkubernetes-opsml-platformobservabilityscheduling-orchestration

posted 14mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +4 more · hybrid · $165K–$330K/year · mid

inferenceinference-engineskubernetes-opsml-platformpython-lang

posted 20mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +4 more · hybrid · $165K–$330K/year · unknown

kubernetes-opsml-platformsoftware-engineerterraform-iacnvidia

posted 12mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

kubernetes-opsobservabilityreliability-sresreterraform-iac

posted 5mo ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $245K–$325K · manager

eng-managerinferenceinference-enginespython-langml-platform

posted 5mo ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $245K–$325K · staff plus

inferenceinference-enginespython-langsoftware-engineerkubernetes-ops

posted 5mo ago · verified 3d ago

SambaNovachip vendor

Bengaluru, India · Bengaluru, Karnataka, India · 3324K–4062K INR · unknown

python-langsolutions-architectinferencefine-tuningkubernetes-ops

posted 3mo ago · verified 3d ago

SambaNovachip vendor

Bengaluru, India · Bengaluru, Karnataka, India · 8900K–10800K INR · staff plus

ansiblego-langinferenceinference-engineskubernetes-ops

posted 4mo ago · verified 3d ago

Scale AIai startup

New York, NY · San Francisco, CA +2 more · unknown

inferenceinference-enginessoftware-engineerkubernetes-opsnetwork-fabric

posted 33mo ago · verified 3d ago

Anyscaleai startup

San Francisco · hybrid · $200K–$240K/year · mid

reliability-sresrego-langkubernetes-opspython-lang

posted 9w ago · verified 3d ago

Anyscaleai startup

San Francisco · hybrid · $170K–$199K/year · senior

ray-distributedsolutions-architectfine-tuninginferencekubernetes-ops

posted 4mo ago · verified 3d ago

Anyscaleai startup

San Francisco · hybrid · $215K–$265K/year · staff plus

go-langkubernetes-opspython-langsoftware-engineerray-distributed

posted 5w ago · verified 3d ago

Anyscaleai startup

San Francisco · hybrid · $200K–$240K/year · mid

kubernetes-opsray-distributedsoftware-engineergo-langml-platform

posted 10w ago · verified 3d ago

Modalinference provider

London · New York +2 more · onsite · $200K–$280K/year · unknown

solutions-architectkubernetes-opspython-langterraform-iac

posted 8mo ago · verified 3d ago

Modalinference provider

New York · San Francisco · onsite · $180K–$240K/year · mid

kubernetes-opssolutions-architectterraform-iacscheduling-orchestrationgpu-generic

posted 13mo ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo · hybrid · $200K–$260K/year · unknown

fine-tuningpython-langsglang-enginesolutions-architectvllm-engine

posted 4mo ago · verified 3d ago

Fireworks AIinference provider

London · hybrid · senior

fine-tuninginferenceinference-enginespython-langsglang-engine

posted 3mo ago · verified 3d ago

Fireworks AIinference provider

Singapore · 200K–280K SGD/year · senior

solutions-architectfine-tuninginferenceinference-enginespython-lang

posted 3mo ago · verified 3d ago

Fireworks AIinference provider

Greater Seattle Area · New York +1 more · hybrid · $175K–$220K/year · unknown

python-langsoftware-engineergo-langinferenceinference-engines

posted 12mo ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo · hybrid · $175K–$220K/year · senior

software-engineerkubernetes-opsml-platformpython-langobservability

posted 16mo ago · verified 3d ago

Fireworks AIinference provider

San Mateo · hybrid · $175K–$220K/year · unknown

gpu-kernelsperformance-engineercudagpu-genericsoftware-engineer

posted 18mo ago · verified 3d ago