AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

80 roles

ray-distributed ✕

Luma AIai startup

New York, NY · Redwood City, CA +2 more · hybrid · $195K–$395K/year · unknown

post-trainingreinforcement-learningresearch-engineerdistributed-inferencefsdp

posted 3mo ago · verified 3d ago

Sesameai startup

Bellevue · New York +1 more · onsite · $175K–$280K/year · senior

inferenceinference-enginesperformance-engineersglang-enginevllm-engine

posted 19mo ago · verified 3d ago

Lightning AIai startup

New York, New York, United States · San Francisco, California +3 more · $115K–$140K · unknown

cudagpu-generickubernetes-opsnccl-libobservability

posted 5mo ago · verified 3d ago

Lightning AIai startup

London, England, United Kingdom · London, UK · £75K–£95K · mid

gpu-generickubernetes-opscudaml-platformnccl-lib

posted 5mo ago · verified 3d ago

Lightning AIai startup

Philippines · Remote +1 more · unknown

cudagpu-generickubernetes-opsnccl-libobservability

posted 5mo ago · verified 3d ago

Coherefrontier lab

Canada · Europe +1 more · remote · senior

python-langsoftware-engineerpytorch-disttraining-frameworksjax-pallas

posted 11w ago · verified 3d ago

Coherefrontier lab

London · Montreal +4 more · hybrid · unknown

post-trainingpython-langsoftware-engineerfine-tuningjax-pallas

posted 16mo ago · verified 3d ago

Coherefrontier lab

London · Montreal +4 more · remote · unknown

python-langsoftware-engineertraining-frameworksjax-pallaskubernetes-ops

posted 20mo ago · verified 3d ago

Inferactinference provider

Remote · remote · $200K–$400K/year · unknown

go-langkubernetes-opspython-langrust-langterraform-iac

posted 9w ago · verified 3d ago

Inferactinference provider

Singapore · onsite · 200K–400K SGD/year · unknown

cluster-datacentergo-langgpu-genericinferencekubernetes-ops

posted 4mo ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · $200K–$400K/year · unknown

kubernetes-opssoftware-engineercluster-datacentergo-langinference

posted 9mo ago · verified 3d ago

Prime Intellectneocloud

Remote · San Francisco · unknown

collectivesdeepspeed-libfsdpgpu-genericgpu-kernels

posted 3mo ago · verified 3d ago

Periodic Labsfrontier lab

Menlo Park, CA · onsite · unknown

collectivescudacutlass-cutedistributed-inferencefsdp

posted 6mo ago · verified 3d ago

Mistral AIfrontier lab

Amsterdam · Lausanne +3 more · hybrid · unknown

post-trainingreinforcement-learningresearch-engineerevaluationfine-tuning

posted 8w ago · verified 3d ago

Thinking Machines Labfrontier lab

New York · San Francisco · onsite · unknown

srepost-traininggpu-genericobservabilityreinforcement-learning

posted 8w ago · verified 3d ago

Anyscaleai startup

San Francisco · $215K–$265K/year · senior

cpp-langray-distributedsoftware-engineerscheduling-orchestrationgpu-generic

posted 8w ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $210K–$280K · staff plus

inferenceinference-engineskubernetes-opsobservabilityreliability-sre

posted 11mo ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $200K–$400K/year · mid

inferencesolutions-architectevaluationinference-enginespost-training

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Bellevue, Washington, USA · onsite · mid

software-engineerml-platformtrainiumscheduling-orchestrationfsdp

posted 12w ago · verified 3d ago

Baseteninference provider

San Francisco · hybrid · $200K–$275K/year · unknown

gpu-genericmodel-parallelismpost-trainingpytorch-distresearch-engineer

posted 7mo ago · verified 3d ago

SambaNovachip vendor

Bengaluru, India · Bengaluru, Karnataka, India · 8900K–10800K INR · staff plus

ansiblego-langinferenceinference-engineskubernetes-ops

posted 4mo ago · verified 3d ago

Anyscaleai startup

San Francisco · hybrid · $170K–$199K/year · senior

ray-distributedsolutions-architectfine-tuninginferencekubernetes-ops

posted 4mo ago · verified 3d ago

Anyscaleai startup

San Francisco · hybrid · $215K–$265K/year · staff plus

go-langkubernetes-opspython-langsoftware-engineerray-distributed

posted 5w ago · verified 3d ago

Anyscaleai startup

San Francisco · hybrid · $200K–$240K/year · mid

kubernetes-opsray-distributedsoftware-engineergo-langml-platform

posted 10w ago · verified 3d ago

Anyscaleai startup

Palo Alto · San Francisco · hybrid · $170K–$245K/year · unknown

distributed-inferenceinferenceinference-enginessoftware-engineervllm-engine

posted 5mo ago · verified 3d ago

Anyscaleai startup

Bengaluru, Karnataka · unknown

ray-distributedsoftware-engineercpp-langscheduling-orchestrationml-platform

posted 3mo ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · $150K–$450K/year est. · unknown

jax-pallaskubernetes-opspytorch-distsoftware-engineerevaluation

posted 7mo ago · verified 3d ago