AI infrastructure roles, filterable by the stack you actually work on.

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · senior

software-engineertrainiuminference-enginesvllm-enginedistributed-inference

posted 3mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Tel Aviv-Yafo, Tel Aviv, ISR · onsite · mid

cpp-langsoftware-engineercustom-asicdistributed-inferencegpu-kernels

posted 12w ago · verified 3d ago

Amazon (AWS)hyperscaler

Santa Clara, California, USA · onsite · unknown

cudagpu-kernelstriton-langgpu-genericmodel-parallelism

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Austin, Texas, USA · Cupertino, California, USA · onsite · senior

custom-asicgpu-genericcluster-datacentercollectivessoftware-engineer

posted 7mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior

cudacutlass-cutedistributed-inferenceevaluationflash-attention

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Herndon, Virginia, USA · New York, New York, USA +1 more · onsite · senior

solutions-architectgpu-genericinference-enginesmodel-parallelismtraining-frameworks

posted 4mo ago · verified 3d ago

Anthropicfrontier lab

Ontario, CA · Ontario, CAN · staff plus

distributed-inferenceinferenceinference-enginessoftware-engineerscheduling-orchestration

posted 10w ago · verified 3d ago

Perplexityai startup

London · mid

cudagpu-kernelsinferenceinference-engineskv-cache-systems

posted 6mo ago · verified 3d ago

Perplexityai startup

New York City · Palo Alto +1 more · $220K–$485K/year · mid

cudagpu-kernelsinferenceinference-enginescutlass-cute

posted 6mo ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · staff plus

inferenceinference-engineskv-cache-systemsperformance-engineerrocm-hip

posted 11d ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · manager

eng-managergo-langinferenceinference-enginespython-lang

posted 8w ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · senior

python-langsoftware-engineerinference-enginesinferencego-lang

posted 12d ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · hybrid · manager

cpp-langeng-managerinferencemlir-llvmpython-lang

posted 3mo ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · unknown

custom-asicperformance-engineercpp-langinferencepython-lang

posted 3mo ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · senior

inferenceinference-engineskubernetes-opsml-platformpython-lang

posted 3mo ago · verified 3d ago

Cerebraschip vendor

Bengaluru, IND · mid

custom-asicperformance-engineercpp-langgpu-kernelsinference

posted 4mo ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · onsite · senior

ansibleinferenceinference-engineskubernetes-opsml-platform

posted 5mo ago · verified 3d ago

Cerebraschip vendor

Canada · United States · unknown

software-engineerinferenceinference-enginescpp-langgo-lang

posted 8mo ago · verified 3d ago

Cerebraschip vendor

Canada · United States · unknown

custom-asicperformance-engineercpp-langinferencepython-lang

posted 9mo ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · onsite · senior

amdcpp-langinferenceinference-enginespython-lang

posted 11mo ago · verified 3d ago

Cerebraschip vendor

Toronto, CAN · hybrid · mid

cpp-langinference-enginesmlir-llvmpython-langsoftware-engineer

posted 15mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

inferenceinference-enginessoftware-engineergpu-genericperformance-engineer

posted 6mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

collectivescpp-langdistributed-inferenceinferenceinfiniband-ops

posted 8mo ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $165K–$330K/year · unknown

inferenceinference-enginessglang-enginesolutions-architecttensorrt-stack

posted 8mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · mid

performance-engineerinferenceinference-enginesnvidiaobservability

posted 9mo ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $165K–$330K/year · senior

fine-tuningml-platformpost-trainingsoftware-engineerkubernetes-ops

posted 9mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +4 more · hybrid · $165K–$330K/year · mid

inferenceinference-engineskubernetes-opsml-platformpython-lang

posted 20mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

kubernetes-opsobservabilityreliability-sresreterraform-iac

posted 5mo ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $245K–$325K · manager

eng-managerinferenceinference-enginespython-langml-platform

posted 5mo ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $245K–$325K · staff plus

inferenceinference-enginespython-langsoftware-engineerkubernetes-ops

posted 5mo ago · verified 3d ago