AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

412 roles

inference ✕

TensorWaveneocloud

Las Vegas, Nevada · onsite · junior

amdgpu-genericsoftware-engineerkubernetes-opsml-platform

posted 3w ago · verified 3d ago

Anthropicfrontier lab

New York City, NY · San Francisco, CA +1 more · $320K–$485K · staff plus

inferenceinference-enginessoftware-engineerdistributed-inferencescheduling-orchestration

posted 4w ago · verified 3d ago

Anthropicfrontier lab

New York City, NY · San Francisco, CA +1 more · $320K–$485K · staff plus

software-engineerinferenceinference-enginesobservabilitykubernetes-ops

posted 4w ago · verified 3d ago

Anthropicfrontier lab

New York City, NY · San Francisco, CA +1 more · $320K–$485K · staff plus

software-engineerinferenceinference-engineskubernetes-opsml-platform

posted 4w ago · verified 3d ago

Tenstorrentchip vendor

Tokyo · Tokyo, Japan · unknown

solutions-architectgpu-generickubernetes-opspython-langcluster-datacenter

posted 4w ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +6 more · senior

inferenceinference-enginesquantizationresearch-engineercuda

posted 4w ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · unknown

cpp-langgpu-kernelspython-langsoftware-engineercuda

posted 4w ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · $200K–$400K/year · unknown

inferenceinference-enginesvllm-engineamdcuda

posted 4w ago · verified 3d ago

Thinking Machines Labfrontier lab

New York · San Francisco · onsite · unknown

software-engineergo-langml-platformpython-langscheduling-orchestration

posted 4w ago · verified 3d ago

Thinking Machines Labfrontier lab

New York · San Francisco · onsite · unknown

inferenceinference-enginesobservabilitypython-langsoftware-engineer

posted 4w ago · verified 3d ago

Parasailinference provider

Europe · Remote · manager

eng-managerreliability-sresregpu-genericinference

posted 4w ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo · hybrid · $270K–$310K/year · manager

eng-managerevaluationfine-tuninginferencesglang-engine

posted 4w ago · verified 3d ago

Amazon (AWS)hyperscaler

New York, New York, USA · onsite · unknown

ml-platformsoftware-engineercpp-langgpu-genericinference

posted 4w ago · verified 3d ago

Parasailinference provider

Remote · San Mateo · senior

gpu-generickubernetes-opsreliability-sresrecluster-datacenter

posted 5w ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · junior

software-engineerinferenceinference-enginespython-langobservability

posted 5w ago · verified 3d ago

Amazon (AWS)hyperscaler

Austin, Texas, USA · Cupertino, California, USA +2 more · onsite · junior

cpp-langsoftware-engineertrainiummlir-llvmpython-lang

posted 5w ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +2 more · remote · senior

distributed-inferenceinferenceinference-engineskv-cache-systemsperformance-engineer

posted 5w ago · verified 3d ago

Crusoeneocloud

San Francisco, CA - US · onsite · manager

eng-managerinferenceinference-enginessglang-enginevllm-engine

posted 5w ago · verified 3d ago

Amazon (AWS)hyperscaler

New York, New York, USA · Seattle, Washington, USA +1 more · onsite · senior

performance-engineercpp-langgpu-genericgpu-kernelscluster-datacenter

posted 5w ago · verified 3d ago

Amazon (AWS)hyperscaler

Toronto, Ontario, CAN · Vancouver, British Columbia, CAN · onsite · senior

gpu-genericperformance-engineercudainferenceinference-engines

posted 5w ago · verified 3d ago

Crusoeneocloud

San Francisco, CA - US · onsite · staff plus

inferenceinference-enginesperformance-engineercudadistributed-inference

posted 5w ago · verified 3d ago