AI infrastructure roles, filterable by the stack you actually work on.

Baseteninference provider

Montreal · New York +2 more · remote · $180K–$360K · mid

gpu-genericinferenceinference-enginescpp-langnvidia

posted 29mo ago · verified today

SambaNovachip vendor

Remote - US · remote · senior

inferenceinference-enginespython-langsolutions-architectfine-tuning

posted 3d ago · verified today

SambaNovachip vendor

Bengaluru, India · Bengaluru, Karnataka, India · senior

inferenceinference-engineskubernetes-opspython-langsglang-engine

posted 3d ago · verified today

SambaNovachip vendor

Austin, Texas, United States; San Jose, California, United States · San Jose, CA · senior

linux-kernelcpp-langcustom-asicsoftware-engineergpu-kernels

posted 3d ago · verified today

SambaNovachip vendor

Remote - US · San Jose, CA +1 more · senior

custom-asicmlir-llvmsoftware-engineercpp-langgpu-kernels

posted 3d ago · verified today

SambaNovachip vendor

Austin, Texas, United States; San Jose, California, United States · Remote - US · staff plus

software-engineercustom-asiccpp-langmlir-llvmtraining-frameworks

posted 3d ago · verified today

SambaNovachip vendor

Remote - US · remote · senior

inferenceinference-enginespython-langvllm-enginecustom-asic

posted 3d ago · verified today

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · staff plus

inferenceinference-enginesperformance-engineercustom-asicquantization

posted 3d ago · verified today

SambaNovachip vendor

Austin, Texas, United States; Remote - US; San Jose, California, United States · Austin, TX +1 more · remote · staff plus

custom-asicnetwork-fabriccluster-datacenterdatacenter-engineercpp-lang

posted 3d ago · verified today

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · senior

performance-engineergpu-genericgpu-kernelsinferenceinference-engines

posted 3d ago · verified today

Scale AIai startup

New York, NY · San Francisco, CA +1 more · senior

inferenceinference-enginessoftware-engineerkubernetes-opsml-platform

posted 3d ago · verified today

Anyscaleai startup

San Francisco · remote · $215K–$265K · senior

cpp-langml-platformray-distributedscheduling-orchestrationsoftware-engineer

posted 3mo ago · verified today

Anyscaleai startup

Palo Alto · San Francisco · remote · $170K–$245K · mid

distributed-inferencegpu-genericinferenceinference-enginessoftware-engineer

posted 12w ago · verified today

Modalinference provider

Stockholm · $175K–$250K · manager

eng-managerml-platformscheduling-orchestrationsoftware-engineercluster-datacenter

posted 3mo ago · verified today

Modalinference provider

New York · $275K–$330K · manager

eng-managerlinux-kernelcluster-datacentercpp-langml-platform

posted 6mo ago · verified today

Modalinference provider

New York · San Francisco · $200K–$350K · senior

inferenceinference-enginesperformance-engineercudagpu-generic

posted 4mo ago · verified today

Fireworks AIinference provider

Singapore · 200K–350K SGD · senior

solutions-architectfine-tuninggpu-genericinferenceinference-engines

posted 4w ago · verified today

Fireworks AIinference provider

New York · San Mateo · $175K–$220K · senior

ml-platformkubernetes-opspython-langscheduling-orchestrationsoftware-engineer

posted 14mo ago · verified today

Fireworks AIinference provider

New York · San Mateo · $210K–$320K · mid

gpu-genericpython-langpytorch-distcpp-langtraining-frameworks

posted 6w ago · verified today

Fireworks AIinference provider

New York · $175K–$220K · senior

ml-platformkubernetes-opssoftware-engineerpython-langray-distributed

posted 10w ago · verified today

Fireworks AIinference provider

San Mateo · $175K–$220K · senior

cudagpu-genericgpu-kernelsinferenceperformance-engineer

posted 15mo ago · verified today

xAIfrontier lab

Palo Alto, California; Seattle, Washington · Seattle, WA · mid

cpp-langlinux-kernelsoftware-engineernetwork-fabriccluster-datacenter

posted 3d ago · verified today

xAIfrontier lab

Palo Alto, CA · Palo Alto, California · senior

storage-checkpointingsoftware-engineercpp-langrust-langobservability

posted 3d ago · verified today

xAIfrontier lab

Memphis, Tennessee; Southaven, Mississippi · Memphis, TN +1 more · mid

cluster-datacenterdatacenter-engineerpython-langreliability-sresre

posted 3d ago · verified today

xAIfrontier lab

Palo Alto, CA · Palo Alto, California · senior

cpp-langgpu-genericinferenceinference-enginessoftware-engineer

posted 3d ago · verified today

xAIfrontier lab

Palo Alto, CA · Palo Alto, California · mid

cluster-datacentercpp-langkubernetes-opssoftware-engineergpu-generic

posted 3d ago · verified today

xAIfrontier lab

Palo Alto, CA · Palo Alto, California · senior

cpp-langcudacutlass-cutegpu-kernelssoftware-engineer

posted 3d ago · verified today

xAIfrontier lab

Palo Alto, CA · Palo Alto, California · mid

gpu-genericml-platformpython-langcpp-langnvidia

posted 3d ago · verified today

xAIfrontier lab

London · London, England, United Kingdom · mid

software-engineerinferenceinference-enginesrust-langcpp-lang

posted 3d ago · verified today

xAIfrontier lab

Palo Alto, CA · Palo Alto, California · senior

cpp-langjax-pallasperformance-engineerpython-langreinforcement-learning

posted 3d ago · verified today