AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1297 open roles · 85 companies · last verified today

279 roles

cpp-lang

Cerebraschip vendor

Canada · United States · unknown

cpp-langpython-langreliability-sresoftware-engineercustom-asic

posted 1d ago · verified today

Amazon (AWS)hyperscaler

Austin, Texas, USA · New York, New York, USA +2 more · onsite · senior

solutions-architectkubernetes-opsmpinccl-libtraining-frameworks

posted 2d ago · verified today

SambaNovachip vendor

Tokyo, Japan · Tokyo Prefecture, Japan · 105K–130K JPY · senior

inferencepython-langsolutions-architectperformance-engineerevaluation

posted 2d ago · verified today

Amazon (AWS)hyperscaler

Austin, Texas, USA · Cupertino, California, USA +1 more · onsite · senior

cluster-datacentergpu-genericreliability-srelinux-kernelsoftware-engineer

posted 5d ago · verified today

Inferactinference provider

San Francisco · onsite · junior

amdcudagpu-kernelsinferenceinference-engines

posted 1d ago · verified today

Anthropicfrontier lab

New York City, NY · San Francisco, CA · $350K–$850K · unknown

inferenceinference-enginesperformance-engineergpu-genericrust-lang

posted 6d ago · verified today

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · senior

trainiuminferenceinference-enginesmoe-systemsperformance-engineer

posted 7d ago · verified today

Amazon (AWS)hyperscaler

Haifa, Haifa, ISR · onsite · mid

cpp-langefa-fabriclinux-kernelnetwork-fabricrdma-verbs

posted 7d ago · verified today

Runwareinference provider

United Kingdom · remote · senior

inferenceinference-enginesgpu-genericgpu-kernelsperformance-engineer

posted 7d ago · verified today

DigitalOceanneocloud

Bangalore Metro · Bengaluru · senior

cudakubernetes-opsnvidiaamdrocm-hip

posted 11w ago · verified today

DeepInfrainference provider

Sofia, Bulgaria · onsite · junior

inferenceinference-enginespython-langsoftware-engineercpp-lang

posted 11w ago · verified today

DeepInfrainference provider

Bulgaria - Remote · remote · mid

cpp-langcudagpu-genericinferenceinference-engines

posted 5mo ago · verified today

DeepInfrainference provider

Palo Alto, United States · onsite · mid

cudainferencepython-langsoftware-engineercpp-lang

posted 5mo ago · verified today

DeepInfrainference provider

Bulgaria - Remote · remote · junior

cpp-langcudainferencepython-langsoftware-engineer

posted 7mo ago · verified today

DeepInfrainference provider

Palo Alto, United States · onsite · $140K–$150K/year est. · junior

inference-enginessoftware-engineercpp-langcudaml-platform

posted 8mo ago · verified today

DeepInfrainference provider

Bulgaria - Remote · remote · junior

cpp-langcudainferenceinference-enginespython-lang

posted 11mo ago · verified today

DeepInfrainference provider

Palo Alto, United States · onsite · junior

cpp-langcudanccl-libpython-langsoftware-engineer

posted 11mo ago · verified today

Fish Audio (39 AI)ai startup

Location not specified · unknown

cpp-langinference-enginespython-langinferencemegatron-lm

added 7d ago · verified today

Interfazeinference provider

San Francisco, CA · senior

fine-tuninginferenceinference-enginespython-langquantization

added 7d ago · verified today

Relaceinference provider

San Francisco · onsite · mid

cudagpu-kernelsperformance-engineersoftware-engineercpp-lang

posted 10mo ago · verified today

Inceptionfrontier lab

San Mateo, United States · onsite · unknown

python-langsoftware-engineertraining-frameworksgpu-genericpytorch-dist

posted 6mo ago · verified today

Crusoeneocloud

San Francisco, CA - US · onsite · staff plus

inferenceinference-enginesperformance-engineersglang-enginevllm-engine

posted 7d ago · verified today

Fireworks AIinference provider

New York · San Mateo · hybrid · $200K–$230K/year · unknown

scheduling-orchestrationcpp-langnetwork-fabricpython-langstorage-checkpointing

posted 7d ago · verified today

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · mid

custom-asicdatacenter-engineerpython-langcpp-langperformance-engineer

posted 8d ago · verified today

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · senior

distributed-inferenceinferenceinference-enginespython-langpytorch-dist

posted 9d ago · verified today

Harveyai startup

San Francisco · hybrid · $231K–$340K/year · staff plus

inferenceinference-enginessoftware-engineerml-platformobservability

posted 9d ago · verified today