AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1293 open roles · 85 companies · last verified today

296 roles

inference-engines

Amazon (AWS)hyperscaler

Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior

cudacutlass-cutedistributed-inferenceevaluationflash-attention

posted 4w ago · verified today

Amazon (AWS)hyperscaler

Herndon, Virginia, USA · New York, New York, USA +1 more · onsite · senior

solutions-architectgpu-genericinference-enginesmodel-parallelismtraining-frameworks

posted 3mo ago · verified today

Perplexityai startup

New York City · Palo Alto +1 more · $220K–$485K/year · mid

cudagpu-kernelsinferenceinference-enginescutlass-cute

posted 5mo ago · verified today

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · staff plus

amdinference-enginespython-langsoftware-engineervllm-engine

posted 7w ago · verified today

Cerebraschip vendor

Sunnyvale, CA · hybrid · manager

cpp-langeng-managerinferencemlir-llvmpython-lang

posted 7w ago · verified today

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · unknown

custom-asicperformance-engineercpp-langinferencepython-lang

posted 9w ago · verified today

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · senior

inferenceinference-engineskubernetes-opsml-platformpython-lang

posted 9w ago · verified today

Cerebraschip vendor

Sunnyvale, CA · hybrid · staff plus

inferencereliability-sresreobservabilitycluster-datacenter

posted 10w ago · verified today

Cerebraschip vendor

Sunnyvale, CA · onsite · junior

cpp-langinferencekubernetes-opspython-langsoftware-engineer

posted 4mo ago · verified today

Cerebraschip vendor

Sunnyvale, CA · onsite · senior

ansibleinferenceinference-engineskubernetes-opsml-platform

posted 4mo ago · verified today

Cerebraschip vendor

Canada · United States · unknown

cpp-langgo-langinferenceinference-enginespython-lang

posted 7mo ago · verified today

Cerebraschip vendor

Canada · United States · unknown

custom-asicperformance-engineercpp-langinferencepython-lang

posted 7mo ago · verified today

Cerebraschip vendor

Canada · United States · senior

amdcpp-langinferenceinference-enginespython-lang

posted 9mo ago · verified today

Cerebraschip vendor

Canada · United States · mid

reliability-sresrekubernetes-opsobservabilitygo-lang

posted 11mo ago · verified today

Cerebraschip vendor

Sunnyvale, CA · onsite · staff plus

inferenceinference-enginesml-platformobservabilityreliability-sre

posted 11mo ago · verified today

Cerebraschip vendor

Toronto, CAN · hybrid · mid

cpp-langinference-enginesmlir-llvmpython-langsoftware-engineer

posted 14mo ago · verified today

Cerebraschip vendor

Sunnyvale, CA · onsite · staff plus

inferenceinference-enginessoftware-engineercpp-langdistributed-inference

posted 26mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · hybrid · $180K–$360K/year · unknown

inference-enginessoftware-engineerdistributed-inferenceinferencekubernetes-ops

posted 3mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · hybrid · $165K–$330K/year · unknown

inferenceinference-enginessoftware-engineerdistributed-inferenceperformance-engineer

posted 4mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · hybrid · $165K–$330K/year · unknown

cpp-langnetwork-fabricnvidiasoftware-engineercollectives

posted 6mo ago · verified today

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

solutions-architectinferenceinference-enginessglang-enginetensorrt-stack

posted 6mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · hybrid · $165K–$330K/year · senior

evaluationgpu-genericperformance-engineerpython-langinference

posted 8mo ago · verified today

Baseteninference provider

New York · San Francisco · hybrid · $165K–$330K/year · senior

fine-tuningml-platformpost-trainingsoftware-engineerkubernetes-ops

posted 7mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · hybrid · $260K–$380K/year · manager

eng-managerinferenceinference-enginespython-langdistributed-inference

posted 4mo ago · verified today