AI infrastructure roles, filterable by the stack you actually work on.

Amazon (AWS)hyperscaler

Cupertino, California, USA · Seattle, Washington, USA · onsite · senior

software-engineertrainiummodel-parallelismpre-trainingtraining-frameworks

posted 11w ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · senior

gpu-kernelsvllm-enginemodel-parallelismdistributed-inferenceml-platform

posted 12w ago · verified 3d ago

Amazon (AWS)hyperscaler

Tel Aviv-Yafo, Tel Aviv, ISR · onsite · mid

cpp-langsoftware-engineercustom-asicdistributed-inferencegpu-kernels

posted 12w ago · verified 3d ago

Amazon (AWS)hyperscaler

Santa Clara, California, USA · onsite · unknown

cudagpu-kernelstriton-langgpu-genericmodel-parallelism

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Houston, Texas, USA · onsite · senior

cudagpu-kernelsmodel-parallelismpytorch-disttraining-frameworks

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior

cudacutlass-cutedistributed-inferenceevaluationflash-attention

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Herndon, Virginia, USA · New York, New York, USA +1 more · onsite · senior

solutions-architectgpu-genericinference-enginesmodel-parallelismtraining-frameworks

posted 4mo ago · verified 3d ago

Perplexityai startup

London · mid

cudagpu-kernelsinferenceinference-engineskv-cache-systems

posted 6mo ago · verified 3d ago

Perplexityai startup

New York City · Palo Alto +1 more · $220K–$485K/year · mid

cudagpu-kernelsinferenceinference-enginescutlass-cute

posted 6mo ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · staff plus

inferenceinference-engineskv-cache-systemsperformance-engineerrocm-hip

posted 10d ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · onsite · senior

amdcpp-langinferenceinference-enginespython-lang

posted 11mo ago · verified 3d ago

Baseteninference provider

San Francisco · hybrid · $200K–$275K/year · unknown

gpu-genericmodel-parallelismpost-trainingpytorch-distresearch-engineer

posted 7mo ago · verified 3d ago

Fireworks AIinference provider

Greater Seattle Area · New York +2 more · hybrid · $210K–$320K/year · unknown

fsdpkubernetes-opsmodel-parallelismsoftware-engineertraining-frameworks

posted 3mo ago · verified 3d ago

OpenAIfrontier lab

San Francisco · $295K–$555K/year · unknown

gpu-genericinferenceinference-enginessoftware-engineerdistributed-inference

posted 17mo ago · verified 3d ago

Anthropicfrontier lab

San Francisco, CA · $315K–$560K · senior

python-langinferenceinference-enginesml-platformpytorch-dist

posted 11mo ago · verified 3d ago

Nebiusneocloud

Palo Alto · Palo Alto, California, United States · $195K–$262K · senior

model-parallelismpost-trainingpytorch-distreinforcement-learningtraining-frameworks

posted 3mo ago · verified 3d ago

Together AIneocloud

Remote · Singapore · unknown

fine-tuninginferenceinference-engineskv-cache-systemspost-training

posted 12w ago · verified 3d ago