AI infrastructure roles, filterable by the stack you actually work on.

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $210K–$280K · staff plus

inferenceinference-engineskubernetes-opsobservabilityreliability-sre

posted 11mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · San Francisco, CA +1 more · $198K–$264K/year est. · staff plus

amdcluster-datacenterdeepspeed-libdistributed-inferencefsdp

posted 10w ago · verified 3d ago

Nebiusneocloud

Remote - United States · United States · remote · $228K–$285K · manager

eng-managerfine-tuninginferenceinference-engineskubernetes-ops

posted 10w ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $200K–$400K/year · mid

inferencesolutions-architectevaluationinference-enginespost-training

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · manager

eng-managernvidiacluster-datacentercpp-langml-platform

posted 11w ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · unknown

cpp-langdistributed-inferencenetwork-fabricsoftware-engineerkv-cache-systems

posted 4w ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · Seattle, Washington, USA · onsite · senior

cpp-langnetwork-fabricsoftware-engineercollectivesdistributed-inference

posted 3mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · manager

eng-managerml-platformgpu-kernelsinferenceperformance-engineer

posted 4mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · senior

custom-asicrtl-designdatacenter-engineerpython-langinference

posted 7mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · senior

trainiumdistributed-inferenceinferencesoftware-engineercpp-lang

posted 12w ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · Seattle, Washington, USA · onsite · mid

trainiumperformance-engineersoftware-engineercollectivesgpu-generic

posted 8mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · senior

software-engineertrainiuminference-enginesvllm-enginedistributed-inference

posted 3mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · Seattle, Washington, USA · onsite · mid

trainiummodel-parallelismtraining-frameworkscollectivesperformance-engineer

posted 11w ago · verified 3d ago

Amazon (AWS)hyperscaler

Tel Aviv-Yafo, Tel Aviv, ISR · onsite · mid

cpp-langsoftware-engineercustom-asicdistributed-inferencegpu-kernels

posted 12w ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · staff plus

solutions-architectcudagpu-generickubernetes-opscluster-datacenter

posted 4mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Santa Clara, California, USA · onsite · unknown

cudagpu-kernelstriton-langgpu-genericmodel-parallelism

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Houston, Texas, USA · onsite · senior

cudagpu-kernelsmodel-parallelismpytorch-disttraining-frameworks

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior

cudacutlass-cutedistributed-inferenceevaluationflash-attention

posted 10w ago · verified 3d ago

CoreWeaveneocloud

Austin, TX · US - Remote - Texas · $182K–$242K/year est. · unknown

python-langsolutions-architectgpu-genericinfiniband-opskubernetes-ops

posted 10w ago · verified 3d ago

Anthropicfrontier lab

Ontario, CA · Ontario, CAN · staff plus

distributed-inferenceinferenceinference-enginessoftware-engineerscheduling-orchestration

posted 10w ago · verified 3d ago

Perplexityai startup

New York City · Remote (United States) +3 more · $250K–$485K/year · unknown

kubernetes-opssoftware-engineerml-platformnvidiascheduling-orchestration

posted 4d ago · verified 3d ago

Perplexityai startup

London · hybrid · mid

cluster-datacentercpp-langkubernetes-opsobservabilitypython-lang

posted 6mo ago · verified 3d ago

Perplexityai startup

London · mid

cudagpu-kernelsinferenceinference-engineskv-cache-systems

posted 6mo ago · verified 3d ago

Perplexityai startup

Palo Alto · San Francisco · $220K–$405K/year · unknown

cluster-datacentercpp-langgpu-genericinferencekubernetes-ops

posted 6mo ago · verified 3d ago

Perplexityai startup

New York City · Palo Alto +1 more · $220K–$485K/year · mid

cudagpu-kernelsinferenceinference-enginescutlass-cute

posted 6mo ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · staff plus

inferenceinference-engineskv-cache-systemsperformance-engineerrocm-hip

posted 11d ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · manager

eng-managergo-langinferenceinference-enginespython-lang

posted 8w ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · senior

python-langsoftware-engineerinference-enginesinferencego-lang

posted 13d ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · hybrid · manager

cpp-langeng-managerinferencemlir-llvmpython-lang

posted 3mo ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · unknown

custom-asicperformance-engineercpp-langinferencepython-lang

posted 3mo ago · verified 3d ago