ai-infra-jobs

AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

984 open roles · 19 companies · last verified today

Modalinference provider

New York · San Francisco · $200K–$350K · senior

inferenceinference-enginesperformance-engineercudagpu-generic

posted 4mo ago · verified today

Modalinference provider

New York · San Francisco · $150K–$350K · senior

inferenceinference-enginesspeculative-decodinggpu-genericgpu-kernels

posted 6w ago · verified today

Fireworks AIinference provider

San Mateo · $175K–$220K · senior

cudagpu-genericgpu-kernelsinferenceperformance-engineer

posted 15mo ago · verified today

Fireworks AIinference provider

Singapore · 200K–350K SGD · senior

solutions-architectfine-tuninggpu-genericinferenceinference-engines

posted 4w ago · verified today

Fireworks AIinference provider

New York · San Mateo · $200K–$260K · senior

inference-enginespython-langsolutions-architectfine-tuninginference

posted 10w ago · verified today

Fireworks AIinference provider

New York · San Mateo +1 more · $200K–$260K · senior

python-langsolutions-architectinferenceinference-enginesfine-tuning

posted 10w ago · verified today

xAIfrontier lab

Palo Alto, CA · Palo Alto, California · senior

cpp-langgpu-genericinferenceinference-enginessoftware-engineer

posted 3d ago · verified today

xAIfrontier lab

Palo Alto, CA · Palo Alto, California · mid

cpp-langcudadistributed-inferenceinferenceinference-engines

posted 3d ago · verified today

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA +1 more · senior

cudagpu-kernelsperformance-engineercpp-langinference

posted 3d ago · verified today

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA +1 more · senior

distributed-inferenceinferenceinference-engineskubernetes-opsml-platform

posted 3d ago · verified today

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA +1 more · senior

inferenceinference-engineskubernetes-opspython-langcuda

posted 3d ago · verified today

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA +1 more · staff plus

gpu-genericinferenceinference-engineskubernetes-opssoftware-engineer

posted 3d ago · verified today

CoreWeaveneocloud

Bellevue, WA · Bellevue, WA/ San Francisco, CA/ Sunnyvale, CA +3 more · mid

inferenceinference-enginespython-langperformance-engineervllm-engine

posted 3d ago · verified today

OpenAIfrontier lab

San Francisco · Seattle · remote · $342K–$555K · senior

cpp-langcudagpu-genericgpu-kernelsperformance-engineer

posted 5mo ago · verified today

OpenAIfrontier lab

San Francisco · $360K–$440K · senior

pre-trainingtraining-frameworksinference-enginespytorch-distresearch-engineer

posted 15mo ago · verified today

OpenAIfrontier lab

San Francisco · remote · $266K–$445K · mid

gpu-kernelssoftware-engineercpp-langgpu-genericperformance-engineer

posted 4mo ago · verified today

Anthropicfrontier lab

New York City, NY · Remote-Friendly US (Travel Required) +3 more · mid

performance-engineergpu-genericgpu-kernelsinferencedistributed-inference

posted 3d ago · verified today

Anthropicfrontier lab

New York City, NY · San Francisco, CA +2 more · staff plus

distributed-inferencegpu-genericinferenceinference-engineskubernetes-ops

posted 3d ago · verified today

Anthropicfrontier lab

San Francisco, CA · San Francisco, CA | New York City, NY | Seattle, WA · senior

cudaperformance-engineergpu-genericgpu-kernelscollectives

posted 3d ago · verified today

Anthropicfrontier lab

San Francisco, CA · San Francisco, CA | New York City, NY | Seattle, WA · senior

inferenceperformance-engineerinference-enginespython-langdistributed-inference

posted 3d ago · verified today

Anthropicfrontier lab

New York City, NY · Remote-Friendly US (Travel Required) +3 more · senior

gpu-kernelsperformance-engineertpucpp-langcollectives

posted 3d ago · verified today

Nebiusneocloud

Amsterdam, Netherlands; Remote - Europe; Remote - United States · Czech Republic +3 more · remote · mid

performance-engineercudagpu-genericgpu-kernelsnccl-lib

posted 3d ago · verified today

Nebiusneocloud

Amsterdam, Netherlands · Israel +3 more · senior

cpp-langcudagpu-genericgpu-kernelsinference

posted 3d ago · verified today

Nebiusneocloud

Canada · Canada; Remote - United States +1 more · remote · manager

solutions-architectcluster-datacenterdistributed-inferencefine-tuninginference

posted 3d ago · verified today

Nebiusneocloud

Amsterdam, Netherlands; Israel; Remote - Europe; United Kingdom · Czech Republic +4 more · remote · senior

jax-pallaspost-trainingpython-langreinforcement-learningresearch-engineer

posted 3d ago · verified today

Nebiusneocloud

Germany; Israel; Netherlands; Prague, Czech Republic; Remote - Europe; United Kingdom · Israel +3 more · remote · senior

fine-tuninggpu-genericinferencejax-pallaspython-lang

posted 3d ago · verified today

Nebiusneocloud

Remote - United States · United States · senior

inferenceinference-enginessolutions-architectfine-tuningpython-lang

posted 3d ago · verified today