AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

95 roles

quantization ✕

Inferactinference provider

Singapore · onsite · 200K–400K SGD/year · unknown

amdgpu-kernelsinferenceinference-enginesperformance-engineer

posted 4mo ago · verified 3d ago

Inferactinference provider

Singapore · onsite · $200K–$400K/year · unknown

gpu-kernelscudaperformance-engineercpp-langinference

posted 4mo ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · $200K–$400K/year · unknown

tpuinference-enginesjax-pallasperformance-engineerxla-compiler

posted 4mo ago · verified 3d ago

FriendliAIinference provider

Seoul · onsite · mid

amdcpp-langcudacutlass-cutegpu-kernels

posted 6mo ago · verified 3d ago

FriendliAIinference provider

San Francisco · hybrid · mid

amdcpp-langcudagpu-genericgpu-kernels

posted 7mo ago · verified 3d ago

Thinking Machines Labfrontier lab

San Francisco · onsite · unknown

cudagpu-kernelstriton-langresearch-engineergpu-generic

posted 12w ago · verified 3d ago

Amazon (AWS)hyperscaler

Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior

gpu-kernelsinferenceinference-engineskv-cache-systemsperformance-engineer

posted 9w ago · verified 3d ago

Nebiusneocloud

Remote - United States · United States · remote · $228K–$285K · manager

eng-managerfine-tuninginferenceinference-engineskubernetes-ops

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior

cudacutlass-cutedistributed-inferenceevaluationflash-attention

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Herndon, Virginia, USA · New York, New York, USA +1 more · onsite · senior

solutions-architectgpu-genericinference-enginesmodel-parallelismtraining-frameworks

posted 4mo ago · verified 3d ago

Perplexityai startup

New York City · Palo Alto +1 more · $220K–$485K/year · mid

cudagpu-kernelsinferenceinference-enginescutlass-cute

posted 6mo ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · staff plus

inferenceinference-engineskv-cache-systemsperformance-engineerrocm-hip

posted 10d ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · onsite · senior

amdcpp-langinferenceinference-enginespython-lang

posted 11mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $180K–$360K/year · unknown

cudagpu-kernelsgpu-genericsoftware-engineercpp-lang

posted 15mo ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $180K–$255K · senior

inferenceperformance-engineercpp-langdistributed-inferenceinference-engines

posted 11mo ago · verified 3d ago

SambaNovachip vendor

Bengaluru, India · Bengaluru, Karnataka, India · 3324K–4062K INR · unknown

python-langsolutions-architectinferencefine-tuningkubernetes-ops

posted 3mo ago · verified 3d ago

Modalinference provider

New York · San Francisco · $150K–$350K/year · unknown

inferencespeculative-decodingkv-cache-systemsquantizationresearch-engineer

posted 3mo ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo +1 more · hybrid · $200K–$260K/year · senior

inference-enginesquantizationsglang-enginevllm-enginefine-tuning

posted 4mo ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo · hybrid · $200K–$260K/year · unknown

fine-tuningpython-langsglang-enginesolutions-architectvllm-engine

posted 4mo ago · verified 3d ago

Fireworks AIinference provider

London · hybrid · unknown

fine-tuninginferencepost-trainingpython-langgpu-generic

posted 8w ago · verified 3d ago

Fireworks AIinference provider

London · hybrid · senior

fine-tuninginferenceinference-enginespython-langsglang-engine

posted 3mo ago · verified 3d ago

Fireworks AIinference provider

Singapore · 200K–280K SGD/year · senior

solutions-architectfine-tuninginferenceinference-enginespython-lang

posted 3mo ago · verified 3d ago

Fireworks AIinference provider

San Mateo · hybrid · $175K–$220K/year · unknown

gpu-kernelsperformance-engineercudagpu-genericsoftware-engineer

posted 18mo ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · Seattle, WA · $180K–$440K/year est. · unknown

cpp-langinferenceinference-enginessoftware-engineerdistributed-inference

posted 25mo ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · $180K–$440K/year est. · unknown

inferenceinference-enginespython-langreinforcement-learningcpp-lang

posted 3mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $188K–$275K/year est. · staff plus

inferenceinference-enginesdistributed-inferencegpu-generickubernetes-ops

posted 5mo ago · verified 3d ago