AI infrastructure roles, filterable by the stack you actually work on.

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · mid

software-engineerml-platformpost-trainingreinforcement-learningtraining-frameworks

posted 4mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Tel Aviv-Yafo, Tel Aviv, ISR · onsite · mid

cpp-langsoftware-engineercustom-asicdistributed-inferencegpu-kernels

posted 12w ago · verified 3d ago

Amazon (AWS)hyperscaler

Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior

cudacutlass-cutedistributed-inferenceevaluationflash-attention

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Herndon, Virginia, USA · New York, New York, USA +1 more · onsite · senior

solutions-architectgpu-genericinference-enginesmodel-parallelismtraining-frameworks

posted 4mo ago · verified 3d ago

Perplexityai startup

New York City · Remote (United States) +3 more · $250K–$485K/year · unknown

kubernetes-opssoftware-engineerml-platformnvidiascheduling-orchestration

posted 4d ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · staff plus

inferenceinference-engineskv-cache-systemsperformance-engineerrocm-hip

posted 10d ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · onsite · senior

amdcpp-langinferenceinference-enginespython-lang

posted 11mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

inferenceinference-enginessoftware-engineergpu-genericperformance-engineer

posted 6mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

collectivescpp-langdistributed-inferenceinferenceinfiniband-ops

posted 8mo ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $165K–$330K/year · unknown

inferenceinference-enginessglang-enginesolutions-architecttensorrt-stack

posted 8mo ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $200K–$275K · senior

inferenceinference-enginespython-langvllm-enginesoftware-engineer

posted 4mo ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $180K–$255K · senior

inferenceperformance-engineercpp-langdistributed-inferenceinference-engines

posted 11mo ago · verified 3d ago

Anyscaleai startup

Palo Alto · San Francisco · hybrid · $170K–$245K/year · unknown

distributed-inferenceinferenceinference-enginessoftware-engineervllm-engine

posted 5mo ago · verified 3d ago

Modalinference provider

New York · San Francisco · $200K–$350K/year · senior

cudainference-enginesnvidiaperformance-engineerinference

posted 6mo ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo · hybrid · $200K–$260K/year · unknown

fine-tuningpython-langsglang-enginesolutions-architectvllm-engine

posted 4mo ago · verified 3d ago

Fireworks AIinference provider

London · hybrid · senior

fine-tuninginferenceinference-enginespython-langsglang-engine

posted 3mo ago · verified 3d ago

Fireworks AIinference provider

Singapore · 200K–280K SGD/year · senior

solutions-architectfine-tuninginferenceinference-enginespython-lang

posted 3mo ago · verified 3d ago

Fireworks AIinference provider

Greater Seattle Area · New York +1 more · hybrid · $175K–$220K/year · unknown

python-langsoftware-engineergo-langinferenceinference-engines

posted 12mo ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · Seattle, WA · $180K–$440K/year est. · unknown

cpp-langinferenceinference-enginessoftware-engineerdistributed-inference

posted 25mo ago · verified 3d ago

xAIfrontier lab

London, England, United Kingdom · UK · £107K–£262K/year est. · unknown

inferenceinference-enginesrust-langsoftware-engineercpp-lang

posted 6mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $188K–$275K/year est. · staff plus

inferenceinference-enginesdistributed-inferencegpu-generickubernetes-ops

posted 5mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $92K–$135K/year est. · junior

inferencepython-langsoftware-engineergo-langinference-engines

posted 12mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $182K–$242K/year est. · senior

kubernetes-opsperformance-engineerpython-langsoftware-engineergo-lang

posted 5mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $152K–$204K/year est. · senior

cudadistributed-inferencego-langgpu-genericgpu-kernels

posted 13mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $139K–$204K/year est. · senior

software-engineerinferenceinference-engineskubernetes-opsgpu-generic

posted 9mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $206K–$333K/year est. · staff plus

cudaperformance-engineergpu-genericinferenceinference-engines

posted 10mo ago · verified 3d ago

OpenAIfrontier lab

San Francisco · $295K–$555K/year · unknown

gpu-genericinferenceinference-enginessoftware-engineerdistributed-inference

posted 17mo ago · verified 3d ago

Nebiusneocloud

Austin, Texas, United States · Netherlands +4 more · remote · unknown

cpp-langcudagpu-kernelscutlass-cutegpu-generic

posted 9mo ago · verified 3d ago

Nebiusneocloud

Amsterdam · Amsterdam, Netherlands +7 more · senior

go-langgpu-generickubernetes-opsml-platformsoftware-engineer

posted 3mo ago · verified 3d ago

Nebiusneocloud

Palo Alto, California, United States · San Francisco Bay Area · $195K–$262K · senior

inferenceinference-engineskv-cache-systemsquantizationsglang-engine

posted 3mo ago · verified 3d ago