ai-infra-jobs

AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

984 open roles · 19 companies · last verified today

Amazon (AWS)hyperscaler

Tel Aviv-Yafo, Tel Aviv, ISR · mid

cpp-langcustom-asicdistributed-inferencegpu-kernelsinference

posted 13d ago · verified today

Amazon (AWS)hyperscaler

Herndon, Virginia, USA · New York, New York, USA · senior

solutions-architectinference-enginesnvidiatrainiumdistributed-inference

posted 9w ago · verified today

Amazon (AWS)hyperscaler

Tel Aviv-Yafo, Tel Aviv, ISR · senior

cpp-langcustom-asicinferenceinference-enginessoftware-engineer

posted 6w ago · verified today

Amazon (AWS)hyperscaler

Cupertino, California, USA · Seattle, Washington, USA · senior

trainiumcollectivescustom-asicgpu-kernelsjax-pallas

posted 10d ago · verified today

Amazon (AWS)hyperscaler

Santa Clara, California, USA · senior

cudafine-tuninggpu-genericgpu-kernelsinference

posted 3d ago · verified today

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Denver, Colorado, USA +2 more · senior

cluster-datacentergpu-generickubernetes-opsscheduling-orchestrationsolutions-architect

posted 3w ago · verified today

Perplexityai startup

New York City · Palo Alto +1 more · $220K–$485K · senior

cudacutlass-cutegpu-kernelsinferenceinference-engines

posted 4mo ago · verified today

Cerebraschip vendor

Headquarters/Sunnyvale Office · Toronto Office · remote · staff plus

cpp-langinferenceinference-enginesrocm-hipvllm-engine

posted 3w ago · verified today

Cerebraschip vendor

US and Canada Offices · senior

inference-enginesamdcpp-langdistributed-inferenceinference

posted 8mo ago · verified today

Cerebraschip vendor

Headquarters/Sunnyvale Office · Toronto Office · mid

performance-engineercustom-asiccpp-langgpu-kernelspython-lang

posted 5w ago · verified today

Cerebraschip vendor

India Office · remote · manager

cpp-langcustom-asiceng-managergpu-kernelspython-lang

posted 10mo ago · verified today

Cerebraschip vendor

US and Canada Offices · senior

cpp-langsoftware-engineercustom-asicinference-enginestraining-frameworks

posted 9mo ago · verified today

Cerebraschip vendor

US and Canada Offices · remote · junior

cpp-langcustom-asicgpu-kernelsperformance-engineerpython-lang

posted 4w ago · verified today

Cerebraschip vendor

Headquarters/Sunnyvale Office · staff plus

post-trainingcustom-asicreinforcement-learningpre-trainingpython-lang

posted 8mo ago · verified today

Baseteninference provider

Montreal · New York +2 more · remote · $180K–$360K · mid

cpp-langcudagpu-genericgpu-kernelsinference

posted 13mo ago · verified today

Baseteninference provider

New York · San Francisco · remote · $165K–$330K · senior

go-langkubernetes-opsml-platformnetwork-fabricobservability

posted 11mo ago · verified today

Baseteninference provider

San Francisco · remote · $200K–$275K · senior

post-trainingresearch-engineermodel-parallelismfine-tuninggpu-generic

posted 4mo ago · verified today

Baseteninference provider

New York · San Francisco · remote · $165K–$330K · senior

software-engineerfine-tuninggpu-genericml-platformpost-training

posted 6mo ago · verified today

Baseteninference provider

San Francisco · remote · $210K–$285K · staff plus

inferencepost-trainingresearch-engineerinference-engineskv-cache-systems

posted 5mo ago · verified today

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · senior

performance-engineergpu-genericgpu-kernelsinferenceinference-engines

posted 3d ago · verified today

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · staff plus

inferenceinference-enginesperformance-engineercustom-asicquantization

posted 3d ago · verified today

Scale AIai startup

San Francisco, CA · San Francisco, CA; New York, NY · manager

ml-platformpost-trainingtraining-frameworkseng-managergpu-generic

posted 3d ago · verified today

Anyscaleai startup

San Francisco · remote · $215K–$265K · senior

cpp-langml-platformray-distributedscheduling-orchestrationsoftware-engineer

posted 3mo ago · verified today

Modalinference provider

New York · San Francisco · $150K–$350K · senior

research-engineercluster-datacenterpost-trainingreinforcement-learninggpu-generic

posted 6w ago · verified today

Fireworks AIinference provider

New York · San Mateo · remote · $210K–$320K · mid

gpu-generickubernetes-opsml-platformmodel-parallelismpython-lang

posted 20d ago · verified today