ai-infra-jobs

AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

983 open roles · 19 companies · last verified today

Nebiusneocloud

Remote - United States · United States · remote · manager

eng-managersolutions-architectinference-enginesinferencevllm-engine

posted 1d ago · verified today

Amazon (AWS)hyperscaler

Herndon, Virginia, USA · New York, New York, USA · senior

solutions-architectinference-enginesnvidiatrainiumdistributed-inference

posted 9w ago · verified today

Amazon (AWS)hyperscaler

Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · senior

cudadistributed-inferencegpu-kernelsinferenceinference-engines

posted 3d ago · verified today

Amazon (AWS)hyperscaler

Tel Aviv-Yafo, Tel Aviv, ISR · senior

cpp-langcustom-asicdistributed-inferenceinferenceinference-engines

posted 3mo ago · verified today

Amazon (AWS)hyperscaler

Santa Clara, California, USA · staff plus

trainiumcpp-langcustom-asicgpu-kernelspython-lang

posted 8mo ago · verified today

Perplexityai startup

New York City · Palo Alto +1 more · $220K–$485K · senior

cudacutlass-cutegpu-kernelsinferenceinference-engines

posted 4mo ago · verified today

Cerebraschip vendor

US and Canada Offices · senior

inference-enginesamdcpp-langdistributed-inferenceinference

posted 8mo ago · verified today

Cerebraschip vendor

Headquarters/Sunnyvale Office · Toronto Office · remote · staff plus

cpp-langinferenceinference-enginesrocm-hipvllm-engine

posted 3w ago · verified today

Cerebraschip vendor

Headquarters/Sunnyvale Office · senior

inferenceinference-enginesperformance-engineercudavllm-engine

posted 4mo ago · verified today

Baseteninference provider

New York · San Francisco · remote · $165K–$330K · manager

eng-managerinferenceinference-enginessglang-enginesolutions-architect

posted 3mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · remote · $180K–$360K · mid

inferenceinference-enginesml-platformsoftware-engineertensorrt-stack

posted 10mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · remote · $165K–$330K · senior

collectivescpp-langdistributed-inferencegpu-genericinference

posted 5mo ago · verified today

Baseteninference provider

Montreal · New York +3 more · remote · $165K–$330K · mid

inferenceinference-enginessolutions-architectgpu-genericvllm-engine

posted 5mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · remote · $180K–$360K · mid

cpp-langcudagpu-genericgpu-kernelsinference

posted 13mo ago · verified today

Baseteninference provider

San Francisco · remote · $200K–$275K · senior

post-trainingresearch-engineermodel-parallelismfine-tuninggpu-generic

posted 4mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · remote · $260K–$380K · manager

eng-managerinferenceinference-enginespython-langdistributed-inference

posted 3mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · remote · $180K–$360K · mid

gpu-genericinferenceinference-enginescpp-langnvidia

posted 29mo ago · verified today

SambaNovachip vendor

Bengaluru, India · Bengaluru, Karnataka, India · senior

inferenceinference-engineskubernetes-opspython-langsglang-engine

posted 3d ago · verified today

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · staff plus

inferenceinference-enginesperformance-engineercustom-asicquantization

posted 3d ago · verified today

SambaNovachip vendor

Austin, Texas, United States; San Jose, California, United States · Austin, TX +1 more · senior

inferenceinference-enginespython-langquantizationcustom-asic

posted 3d ago · verified today

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · senior

performance-engineergpu-genericgpu-kernelsinferenceinference-engines

posted 3d ago · verified today

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · staff plus

custom-asicmoe-systemsreinforcement-learningspeculative-decodingfine-tuning

posted 3d ago · verified today

SambaNovachip vendor

Remote - US · remote · senior

inferenceinference-enginespython-langsolutions-architectfine-tuning

posted 3d ago · verified today