AI infrastructure roles, filterable by the stack you actually work on.
Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.
1293 open roles · 85 companies · last verified today
296 roles
Amazon (AWS)hyperscaler
Austin, Texas, USA · Cupertino, California, USA · onsite · senior
custom-asicgpu-genericcluster-datacentercollectivessoftware-engineer
posted 5mo ago · verified today
Amazon (AWS)hyperscaler
Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior
cudacutlass-cutedistributed-inferenceevaluationflash-attention
posted 4w ago · verified today
Amazon (AWS)hyperscaler
Herndon, Virginia, USA · New York, New York, USA +1 more · onsite · senior
solutions-architectgpu-genericinference-enginesmodel-parallelismtraining-frameworks
posted 3mo ago · verified today
Anthropicfrontier lab
Ontario, CA · Ontario, CAN · staff plus
distributed-inferenceinferenceinference-enginessoftware-engineerscheduling-orchestration
posted 4w ago · verified today
Perplexityai startup
London · manager
eng-managerkubernetes-opsml-platformterraform-iacgpu-generic
posted 5w ago · verified today
Perplexityai startup
London · unknown
cudagpu-kernelsinferenceinference-enginesgpu-generic
posted 5mo ago · verified today
Perplexityai startup
New York City · Palo Alto +1 more · $220K–$485K/year · mid
cudagpu-kernelsinferenceinference-enginescutlass-cute
posted 5mo ago · verified today
Cerebraschip vendor
Sunnyvale, CA · Toronto, CAN · hybrid · staff plus
amdinference-enginespython-langsoftware-engineervllm-engine
posted 7w ago · verified today
Cerebraschip vendor
Sunnyvale, CA · hybrid · staff plus
inferenceinference-enginespython-langsoftware-engineergo-lang
posted 13d ago · verified today
Cerebraschip vendor
Sunnyvale, CA · hybrid · manager
cpp-langeng-managerinferencemlir-llvmpython-lang
posted 7w ago · verified today
Cerebraschip vendor
Sunnyvale, CA · Toronto, CAN · hybrid · unknown
custom-asicperformance-engineercpp-langinferencepython-lang
posted 9w ago · verified today
Cerebraschip vendor
Sunnyvale, CA · Toronto, CAN · hybrid · senior
inferenceinference-engineskubernetes-opsml-platformpython-lang
posted 9w ago · verified today
Cerebraschip vendor
Sunnyvale, CA · hybrid · staff plus
inferencereliability-sresreobservabilitycluster-datacenter
posted 10w ago · verified today
Cerebraschip vendor
Bengaluru, IND · mid
custom-asicperformance-engineercpp-langgpu-kernelsinference
posted 3mo ago · verified today
Cerebraschip vendor
Sunnyvale, CA · onsite · junior
cpp-langinferencekubernetes-opspython-langsoftware-engineer
posted 4mo ago · verified today
Cerebraschip vendor
Sunnyvale, CA · onsite · senior
ansibleinferenceinference-engineskubernetes-opsml-platform
posted 4mo ago · verified today
Cerebraschip vendor
Canada · United States · unknown
cpp-langgo-langinferenceinference-enginespython-lang
posted 7mo ago · verified today
Cerebraschip vendor
Canada · United States · unknown
custom-asicperformance-engineercpp-langinferencepython-lang
posted 7mo ago · verified today
Cerebraschip vendor
Canada · United States · senior
amdcpp-langinferenceinference-enginespython-lang
posted 9mo ago · verified today
Cerebraschip vendor
Canada · United States · mid
reliability-sresrekubernetes-opsobservabilitygo-lang
posted 11mo ago · verified today
Cerebraschip vendor
Sunnyvale, CA · onsite · staff plus
inferenceinference-enginesml-platformobservabilityreliability-sre
posted 11mo ago · verified today
Cerebraschip vendor
Toronto, CAN · hybrid · mid
cpp-langinference-enginesmlir-llvmpython-langsoftware-engineer
posted 14mo ago · verified today
Cerebraschip vendor
Sunnyvale, CA · onsite · staff plus
inferenceinference-enginessoftware-engineercpp-langdistributed-inference
posted 26mo ago · verified today
Baseteninference provider
Montreal · New York +2 more · hybrid · $180K–$360K/year · unknown
inference-enginessoftware-engineerdistributed-inferenceinferencekubernetes-ops
posted 3mo ago · verified today
Baseteninference provider
Montreal · New York +2 more · hybrid · $165K–$330K/year · unknown
inferenceinference-enginessoftware-engineerdistributed-inferenceperformance-engineer
posted 4mo ago · verified today
Baseteninference provider
Montreal · New York +2 more · hybrid · $165K–$330K/year · unknown
cpp-langnetwork-fabricnvidiasoftware-engineercollectives
posted 6mo ago · verified today
Baseteninference provider
Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown
solutions-architectinferenceinference-enginessglang-enginetensorrt-stack
posted 6mo ago · verified today
Baseteninference provider
Montreal · New York +2 more · hybrid · $165K–$330K/year · senior
evaluationgpu-genericperformance-engineerpython-langinference
posted 8mo ago · verified today
Baseteninference provider
New York · San Francisco · hybrid · $165K–$330K/year · senior
fine-tuningml-platformpost-trainingsoftware-engineerkubernetes-ops
posted 7mo ago · verified today
Baseteninference provider
Montreal · New York +2 more · hybrid · $260K–$380K/year · manager
eng-managerinferenceinference-enginespython-langdistributed-inference
posted 4mo ago · verified today