ai-infra-jobs

AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

983 open roles · 19 companies · last verified today

Nebiusneocloud

Remote - United States · United States · remote · manager

eng-managersolutions-architectinference-enginesinferencevllm-engine

posted 1d ago · verified today

Amazon (AWS)hyperscaler

Tel Aviv-Yafo, Tel Aviv, ISR · mid

cpp-langcustom-asicdistributed-inferencegpu-kernelsinference

posted 13d ago · verified today

Amazon (AWS)hyperscaler

Cupertino, California, USA · staff plus

cpp-langcustom-asicdistributed-inferencegpu-kernelsinference-engines

posted 16d ago · verified today

Amazon (AWS)hyperscaler

Herndon, Virginia, USA · New York, New York, USA · senior

solutions-architectinference-enginesnvidiatrainiumdistributed-inference

posted 9w ago · verified today

Amazon (AWS)hyperscaler

Tel Aviv-Yafo, Tel Aviv, ISR · senior

cpp-langcustom-asicinferenceinference-enginessoftware-engineer

posted 6w ago · verified today

Amazon (AWS)hyperscaler

Cupertino, California, USA · Seattle, Washington, USA · senior

custom-asicinferenceinference-enginessoftware-engineertrainium

posted 3d ago · verified today

Amazon (AWS)hyperscaler

Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · senior

cudadistributed-inferencegpu-kernelsinferenceinference-engines

posted 3d ago · verified today

Amazon (AWS)hyperscaler

Tel Aviv-Yafo, Tel Aviv, ISR · senior

cpp-langcustom-asicdistributed-inferenceinferenceinference-engines

posted 3mo ago · verified today

Perplexityai startup

New York City · Palo Alto +1 more · $220K–$485K · senior

cudacutlass-cutegpu-kernelsinferenceinference-engines

posted 4mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · remote · $180K–$360K · mid

inferenceinference-enginesml-platformsoftware-engineertensorrt-stack

posted 10mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · remote · $180K–$360K · mid

gpu-genericinferenceinference-enginescpp-langnvidia

posted 29mo ago · verified today

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · staff plus

custom-asicmoe-systemsreinforcement-learningspeculative-decodingfine-tuning

posted 3d ago · verified today

Modalinference provider

New York · San Francisco · $150K–$350K · senior

inferenceinference-enginesspeculative-decodinggpu-genericgpu-kernels

posted 6w ago · verified today

xAIfrontier lab

Palo Alto, CA · Palo Alto, California · senior

cpp-langgpu-genericinferenceinference-enginessoftware-engineer

posted 3d ago · verified today

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA +1 more · senior

distributed-inferenceinferenceinference-engineskubernetes-opsml-platform

posted 3d ago · verified today

CoreWeaveneocloud

Bellevue, WA · Bellevue, WA/ San Francisco, CA/ Sunnyvale, CA +3 more · mid

inferenceinference-enginespython-langperformance-engineervllm-engine

posted 3d ago · verified today

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA +1 more · senior

inferenceinference-engineskubernetes-opspython-langcuda

posted 3d ago · verified today

Anthropicfrontier lab

New York City, NY · San Francisco, CA +2 more · staff plus

distributed-inferencegpu-genericinferenceinference-engineskubernetes-ops

posted 3d ago · verified today

Nebiusneocloud

Amsterdam · Amsterdam, Netherlands +13 more · senior

distributed-inferenceinferenceinference-enginesvllm-enginego-lang

posted 3d ago · verified today

Nebiusneocloud

Amsterdam, Netherlands; Berlin, Germany; Israel; London, United Kingdom; Prague, Czech Republic; Remote - Europe · Israel +3 more · remote · senior

gpu-genericinferenceinference-enginesperformance-engineerpython-lang

posted 3d ago · verified today

Nebiusneocloud

Palo Alto, California, United States · San Francisco Bay Area · senior

inferenceinference-enginespython-langresearch-engineergpu-generic

posted 3d ago · verified today

Nebiusneocloud

Canada · Canada; Remote - United States +1 more · remote · manager

solutions-architectcluster-datacenterdistributed-inferencefine-tuninginference

posted 3d ago · verified today

Nebiusneocloud

Remote - United States · United States · senior

inferenceinference-enginessolutions-architectfine-tuningpython-lang

posted 3d ago · verified today

Nebiusneocloud

Germany; Israel; Netherlands; Prague, Czech Republic; Remote - Europe; United Kingdom · Israel +3 more · remote · senior

fine-tuninggpu-genericinferencejax-pallaspython-lang

posted 3d ago · verified today