AI infrastructure roles, filterable by the stack you actually work on.

Nscaleneocloud

Houston · New York +2 more · $220K–$330K · staff plus

inferenceinference-engineskv-cache-systemspost-trainingpython-lang

posted 6w ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · senior

inference-enginessoftware-engineersglang-enginetrainiumvllm-engine

posted 7w ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · senior

trainiuminferenceinference-enginesmoe-systemsperformance-engineer

posted 7w ago · verified 3d ago

DigitalOceanneocloud

Bangalore Metro · Bengaluru · senior

amdcudainferenceinference-engineskubernetes-ops

posted 4mo ago · verified 3d ago

Sakana AIfrontier lab

Tokyo · unknown

reliability-srenvidiainferencesregpu-generic

added 7w ago · verified 3d ago

Inceptionfrontier lab

San Mateo, United States · onsite · unknown

cudagpu-genericinferenceinference-engineskubernetes-ops

posted 7mo ago · verified 3d ago

Together AIneocloud

San Francisco · $270K–$300K/year est. · senior

inference-engineskv-cache-systemspython-langspeculative-decodinginference

posted 5mo ago · verified 3d ago

Coherefrontier lab

Montreal · New York +2 more · remote · senior

cpp-langgpu-genericinferenceinference-enginesperformance-engineer

posted 11mo ago · verified 3d ago

Thinking Machines Labfrontier lab

San Francisco · onsite · unknown

reinforcement-learningpython-langresearch-engineerinference-enginesdistributed-inference

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior

gpu-kernelsinferenceinference-engineskv-cache-systemsperformance-engineer

posted 9w ago · verified 3d ago

Nebiusneocloud

Remote - United States · United States · remote · $228K–$285K · manager

eng-managerfine-tuninginferenceinference-engineskubernetes-ops

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Tel Aviv-Yafo, Tel Aviv, ISR · onsite · mid

cpp-langsoftware-engineercustom-asicdistributed-inferencegpu-kernels

posted 12w ago · verified 3d ago

Amazon (AWS)hyperscaler

Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior

cudacutlass-cutedistributed-inferenceevaluationflash-attention

posted 10w ago · verified 3d ago

Perplexityai startup

London · mid

cudagpu-kernelsinferenceinference-engineskv-cache-systems

posted 6mo ago · verified 3d ago

Perplexityai startup

New York City · Palo Alto +1 more · $220K–$485K/year · mid

cudagpu-kernelsinferenceinference-enginescutlass-cute

posted 6mo ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $200K–$275K · senior

inferenceinference-enginespython-langvllm-enginesoftware-engineer

posted 4mo ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $220K–$300K · staff plus

fine-tuninginferencesoftware-engineerinference-enginespre-training

posted 10w ago · verified 3d ago

Modalinference provider

New York · San Francisco · $150K–$350K/year · unknown

inferencespeculative-decodingkv-cache-systemsquantizationresearch-engineer

posted 3mo ago · verified 3d ago

Fireworks AIinference provider

London · hybrid · unknown

fine-tuninginferencepost-trainingpython-langgpu-generic

posted 8w ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · Seattle, WA · $180K–$440K/year est. · unknown

cpp-langinferenceinference-enginessoftware-engineerdistributed-inference

posted 25mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $152K–$204K/year est. · senior

cudadistributed-inferencego-langgpu-genericgpu-kernels

posted 13mo ago · verified 3d ago

Nebiusneocloud

Palo Alto, California, United States · San Francisco Bay Area · $195K–$262K · senior

inferenceinference-engineskv-cache-systemsquantizationsglang-engine

posted 3mo ago · verified 3d ago

Nebiusneocloud

Palo Alto, California, United States · San Francisco Bay Area · $195K–$262K · senior

cudadistributed-inferencegpu-genericinferencekv-cache-systems

posted 3mo ago · verified 3d ago

Together AIneocloud

San Francisco · $200K–$300K/year est. · mid

inferenceinference-enginespython-langpytorch-distsoftware-engineer

posted 29mo ago · verified 3d ago

Together AIneocloud

Remote · Singapore · unknown

fine-tuninginferenceinference-engineskv-cache-systemspost-training

posted 12w ago · verified 3d ago