AI infrastructure roles, filterable by the stack you actually work on.

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · onsite · staff plus

inferencekubernetes-opssoftware-engineergo-langml-platform

posted 12w ago · verified today

Baseteninference provider

Montreal · New York +2 more · hybrid · $180K–$360K/year · unknown

inference-enginessoftware-engineerdistributed-inferenceinferencekubernetes-ops

posted 3mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · hybrid · $165K–$330K/year · unknown

inferenceinference-enginessoftware-engineerdistributed-inferenceperformance-engineer

posted 4mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · hybrid · $165K–$330K/year · unknown

cpp-langnetwork-fabricnvidiasoftware-engineercollectives

posted 6mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · hybrid · $165K–$330K/year · senior

evaluationgpu-genericperformance-engineerpython-langinference

posted 8mo ago · verified today

Baseteninference provider

New York · San Francisco · hybrid · $165K–$330K/year · senior

fine-tuningml-platformpost-trainingsoftware-engineerkubernetes-ops

posted 7mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · hybrid · $180K–$360K/year · mid

cudainferenceinference-enginestensorrt-stackgpu-generic

posted 11mo ago · verified today

Baseteninference provider

New York · San Francisco · hybrid · $165K–$330K/year · unknown

go-langkubernetes-opsscheduling-orchestrationsoftware-engineerml-platform

posted 12mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · hybrid · $180K–$360K/year · unknown

cpp-langcudagpu-genericgpu-kernelssoftware-engineer

posted 14mo ago · verified today

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

inferencekubernetes-opsml-platformpython-langsoftware-engineer

posted 18mo ago · verified today

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

inferencekubernetes-opsml-platformsoftware-engineerinference-engines

posted 11mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · hybrid · $180K–$360K/year · unknown

inferenceinference-engineskv-cache-systemsperformance-engineerquantization

posted 30mo ago · verified today

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $245K–$325K · staff plus

inferenceinference-enginespython-langsoftware-engineerkubernetes-ops

posted 3mo ago · verified today

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $200K–$275K · senior

inferenceinference-enginessoftware-engineerspeculative-decodingvllm-engine

posted 3mo ago · verified today

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · staff plus

custom-asicgpu-kernelsnetwork-fabricrdma-verbsroce-net

posted 5mo ago · verified today

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $220K–$300K · staff plus

fine-tuninginferencesoftware-engineerinference-enginespre-training

posted 4w ago · verified today

SambaNovachip vendor

Austin, Texas, United States · Remote - US +1 more · $180K–$255K · staff plus

software-engineermlir-llvm

posted 4w ago · verified today

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $180K–$255K · staff plus

cpp-langlinux-kernelnetwork-fabricrdma-verbssoftware-engineer

posted 5mo ago · verified today

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $210K–$280K · senior

software-engineermlir-llvmperformance-engineer

posted 9mo ago · verified today

Scale AIai startup

New York, NY · San Francisco, CA · $290K–$363K · manager

cudaeng-managerpost-trainingtraining-frameworksflash-attention

posted 11mo ago · verified today

Scale AIai startup

New York, NY · San Francisco, CA · $180K–$225K · mid

software-engineertraining-data-inframl-platformscheduling-orchestrationevaluation

posted 13mo ago · verified today

Scale AIai startup

New York, NY · San Francisco, CA +2 more · unknown

inferenceinference-enginessoftware-engineerkubernetes-opsnetwork-fabric

posted 31mo ago · verified today

Scale AIai startup

New York, NY · San Francisco, CA +1 more · $190K–$237K · unknown

cudaflash-attentioninference-enginesml-platformresearch-engineer

posted 18mo ago · verified today

Scale AIai startup

London, UK · unknown

inferenceinference-enginessoftware-engineercpp-langgo-lang

posted 7w ago · verified today

Anyscaleai startup

Bengaluru, Karnataka · unknown

go-langkubernetes-opspython-langsoftware-engineerml-platform

posted 6w ago · verified today

Anyscaleai startup

San Francisco · hybrid · $200K–$240K/year · mid

kubernetes-opsray-distributedsoftware-engineergo-langml-platform

posted 4w ago · verified today

Anyscaleai startup

Palo Alto · San Francisco · hybrid · $170K–$245K/year · unknown

distributed-inferenceinferenceinference-enginessoftware-engineervllm-engine

posted 3mo ago · verified today

Anyscaleai startup

Bengaluru, Karnataka · unknown

ray-distributedsoftware-engineercpp-langscheduling-orchestrationml-platform

posted 7w ago · verified today

Modalinference provider

New York · San Francisco · $150K–$350K/year · unknown

inferenceinference-engineskv-cache-systemsquantizationresearch-engineer

posted 10w ago · verified today

Modalinference provider

Stockholm · mid

inferencesolutions-architectdistributed-inferencefine-tuninggpu-generic

posted 6mo ago · verified today