AI infrastructure roles, filterable by the stack you actually work on.

Hedraai startup

San Francisco · unknown

cudatriton-langgpu-kernelsinferencegpu-generic

posted 3w ago · verified 3d ago

River AIfrontier lab

HQ · Palo Alto, CA · $200K–$420K/year est. · unknown

cpp-langinferenceinference-enginespython-langsoftware-engineer

posted 7w ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $240K–$270K/year · manager

eng-managerinference-enginesgpu-genericgpu-kernelsinference

posted 3w ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · New York, New York, USA +2 more · onsite · manager

eng-managertrainiumsolutions-architectinferenceinference-engines

posted 3w ago · verified 3d ago

Baseteninference provider

London · Remote · hybrid · $145K–$290K/year · unknown

solutions-architectinferencesglang-enginetensorrt-stackvllm-engine

posted 5d ago · verified 3d ago

Mistral AIfrontier lab

London · Munich +1 more · hybrid · unknown

inferenceinference-enginescudadistributed-inferencegpu-generic

posted 3w ago · verified 3d ago

Radiantneocloud

London · hybrid · senior

ml-platformfine-tuninggpu-genericinferencekubernetes-ops

posted 3w ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · mid

inferenceinference-enginessglang-enginesoftware-engineertrainium

posted 3w ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $180K–$360K/year · unknown

inferenceml-platformsoftware-engineerdistributed-inferencegpu-generic

posted 3w ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $180K–$360K/year · unknown

inferenceinference-enginesperformance-engineerquantizationspeculative-decoding

posted 3w ago · verified 3d ago

Sierraai startup

San Francisco, CA · onsite · $230K–$390K/year · unknown

inferenceinference-enginesdistributed-inferencegpu-genericsoftware-engineer

posted 3w ago · verified 3d ago

Anthropicfrontier lab

New York City, NY · San Francisco, CA +1 more · $320K–$485K · staff plus

inferenceinference-enginessoftware-engineerdistributed-inferencescheduling-orchestration

posted 4w ago · verified 3d ago

Anthropicfrontier lab

New York City, NY · San Francisco, CA +1 more · $320K–$485K · staff plus

software-engineerinferenceinference-enginesobservabilitykubernetes-ops

posted 4w ago · verified 3d ago

Anthropicfrontier lab

New York City, NY · San Francisco, CA +1 more · $320K–$485K · staff plus

software-engineerinferenceinference-engineskubernetes-opsml-platform

posted 4w ago · verified 3d ago

Tenstorrentchip vendor

Tokyo · Tokyo, Japan · unknown

solutions-architectgpu-generickubernetes-opspython-langcluster-datacenter

posted 4w ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +6 more · senior

inferenceinference-enginesquantizationresearch-engineercuda

posted 4w ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · unknown

cpp-langgpu-kernelspython-langsoftware-engineercuda

posted 4w ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · $200K–$400K/year · unknown

inferenceinference-enginesvllm-engineamdcuda

posted 4w ago · verified 3d ago

Thinking Machines Labfrontier lab

New York · San Francisco · onsite · unknown

inferenceinference-enginesobservabilitypython-langsoftware-engineer

posted 4w ago · verified 3d ago

Amazon (AWS)hyperscaler

New York, New York, USA · onsite · unknown

ml-platformsoftware-engineercpp-langgpu-genericinference

posted 4w ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · junior

software-engineerinferenceinference-enginespython-langobservability

posted 5w ago · verified 3d ago

Runpodneocloud

Remote - USA · remote · senior

inference-enginesgpu-genericinferenceperformance-engineerpython-lang

posted 4w ago · verified 3d ago

Nebiusneocloud

Amsterdam, Netherlands · Berlin, Germany +2 more · remote · senior

distributed-inferenceinferenceinference-engineskv-cache-systemsperformance-engineer

posted 5w ago · verified 3d ago

Nebiusneocloud

Remote - Europe · Zurich, Switzerland · senior

inferenceinference-enginesperformance-engineerpython-langquantization

posted 5w ago · verified 3d ago

Crusoeneocloud

San Francisco, CA - US · onsite · manager

eng-managerinferenceinference-enginessglang-enginevllm-engine

posted 5w ago · verified 3d ago

Amazon (AWS)hyperscaler

New York, New York, USA · Seattle, Washington, USA +1 more · onsite · senior

performance-engineercpp-langgpu-genericgpu-kernelscluster-datacenter

posted 5w ago · verified 3d ago

Amazon (AWS)hyperscaler

Toronto, Ontario, CAN · Vancouver, British Columbia, CAN · onsite · senior

gpu-genericperformance-engineercudainferenceinference-engines

posted 5w ago · verified 3d ago

Crusoeneocloud

San Francisco, CA - US · onsite · staff plus

inferenceinference-enginesperformance-engineercudadistributed-inference

posted 5w ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · senior

cpp-langgpu-kernelspython-langsoftware-engineertrainium

posted 5w ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · mid

inferenceinference-enginespython-langsoftware-engineertrainium

posted 5w ago · verified 3d ago