AI infrastructure roles, filterable by the stack you actually work on.

Amazon (AWS)hyperscaler

Cupertino, California, USA · Seattle, Washington, USA · onsite · senior

cpp-langnetwork-fabricsoftware-engineercollectivesdistributed-inference

posted 3mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · senior

trainiumdistributed-inferenceinferencesoftware-engineercpp-lang

posted 12w ago · verified 3d ago

Amazon (AWS)hyperscaler

New York, New York, USA · onsite · mid

software-engineertrainiumdistributed-inferencegpu-kernelstraining-frameworks

posted 3mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · Seattle, Washington, USA · onsite · mid

trainiumperformance-engineersoftware-engineercollectivesgpu-generic

posted 8mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · senior

software-engineertrainiuminference-enginesvllm-enginedistributed-inference

posted 3mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · Seattle, Washington, USA · onsite · mid

trainiummodel-parallelismtraining-frameworkscollectivesperformance-engineer

posted 11w ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · senior

gpu-kernelsvllm-enginemodel-parallelismdistributed-inferenceml-platform

posted 12w ago · verified 3d ago

Amazon (AWS)hyperscaler

Tel Aviv-Yafo, Tel Aviv, ISR · onsite · mid

cpp-langsoftware-engineercustom-asicdistributed-inferencegpu-kernels

posted 12w ago · verified 3d ago

Amazon (AWS)hyperscaler

Houston, Texas, USA · onsite · senior

cudagpu-kernelsmodel-parallelismpytorch-disttraining-frameworks

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior

cudacutlass-cutedistributed-inferenceevaluationflash-attention

posted 10w ago · verified 3d ago

Anthropicfrontier lab

Ontario, CA · Ontario, CAN · staff plus

distributed-inferenceinferenceinference-enginessoftware-engineerscheduling-orchestration

posted 10w ago · verified 3d ago

Perplexityai startup

London · mid

cudagpu-kernelsinferenceinference-engineskv-cache-systems

posted 6mo ago · verified 3d ago

Perplexityai startup

New York City · Palo Alto +1 more · $220K–$485K/year · mid

cudagpu-kernelsinferenceinference-enginescutlass-cute

posted 6mo ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · staff plus

inferenceinference-engineskv-cache-systemsperformance-engineerrocm-hip

posted 10d ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · onsite · senior

ansibleinferenceinference-engineskubernetes-opsml-platform

posted 5mo ago · verified 3d ago

Cerebraschip vendor

Canada · United States · unknown

software-engineerinferenceinference-enginescpp-langgo-lang

posted 8mo ago · verified 3d ago

Cerebraschip vendor

Canada · United States · unknown

custom-asicperformance-engineercpp-langinferencepython-lang

posted 9mo ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · onsite · senior

amdcpp-langinferenceinference-enginespython-lang

posted 11mo ago · verified 3d ago

Cerebraschip vendor

Canada · United States · senior

cpp-langsoftware-engineerml-platforminferencepython-lang

posted 12mo ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · onsite · staff plus

inferencekubernetes-opssoftware-engineergo-langml-platform

posted 4mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

inferenceinference-enginessoftware-engineergpu-genericperformance-engineer

posted 6mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

collectivescpp-langdistributed-inferenceinferenceinfiniband-ops

posted 8mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · mid

performance-engineerinferenceinference-enginesnvidiaobservability

posted 9mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +4 more · hybrid · $165K–$330K/year · mid

inferenceinference-engineskubernetes-opsml-platformpython-lang

posted 20mo ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $245K–$325K · staff plus

inferenceinference-enginespython-langsoftware-engineerkubernetes-ops

posted 5mo ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $180K–$255K · senior

inferenceperformance-engineercpp-langdistributed-inferenceinference-engines

posted 11mo ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $245K–$325K · staff plus

performance-engineerinferenceinference-enginesdistributed-inferencenetwork-fabric

posted 10w ago · verified 3d ago

Scale AIai startup

New York, NY · San Francisco, CA · $290K–$363K · manager

cudaeng-managerpost-trainingtraining-frameworksflash-attention

posted 12mo ago · verified 3d ago

Scale AIai startup

New York, NY · San Francisco, CA +1 more · $190K–$237K · unknown

cudaflash-attentioninference-enginesml-platformresearch-engineer

posted 20mo ago · verified 3d ago

Anyscaleai startup

Palo Alto · San Francisco · hybrid · $170K–$245K/year · unknown

distributed-inferenceinferenceinference-enginessoftware-engineervllm-engine

posted 5mo ago · verified 3d ago