AI infrastructure roles, filterable by the stack you actually work on.
Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.
1530 open roles · 88 companies · last verified today
1530 roles
Baseteninference provider
New York · San Francisco · hybrid · $165K–$330K/year · senior
fine-tuningml-platformpost-trainingsoftware-engineerkubernetes-ops
posted 9mo ago · verified today
Baseteninference provider
New York · San Francisco · hybrid · $165K–$330K/year · senior
go-langkubernetes-opsml-platformobservabilityscheduling-orchestration
posted 14mo ago · verified today
Baseteninference provider
Montreal · New York +3 more · hybrid · $180K–$360K/year · unknown
cudagpu-kernelsgpu-genericsoftware-engineercpp-lang
posted 15mo ago · verified today
Baseteninference provider
Montreal · New York +4 more · hybrid · $165K–$330K/year · mid
inferenceinference-engineskubernetes-opsml-platformpython-lang
posted 20mo ago · verified today
Baseteninference provider
Montreal · New York +4 more · hybrid · $165K–$330K/year · unknown
kubernetes-opsml-platformsoftware-engineerterraform-iacnvidia
posted 12mo ago · verified today
Baseteninference provider
Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown
kubernetes-opsobservabilityreliability-sresreterraform-iac
posted 5mo ago · verified today
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $245K–$325K · manager
eng-managerinferenceinference-enginespython-langml-platform
posted 5mo ago · verified today
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $245K–$325K · staff plus
inferenceinference-enginespython-langsoftware-engineerkubernetes-ops
posted 5mo ago · verified today
SambaNovachip vendor
Austin, Texas, United States · Austin, TX +2 more · $200K–$275K · senior
inferenceinference-enginespython-langvllm-enginesoftware-engineer
posted 5mo ago · verified today
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · staff plus
custom-asicrdma-verbsroce-netsoftware-engineerinference
posted 7mo ago · verified today
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $220K–$300K · staff plus
fine-tuninginferencesoftware-engineerinference-enginespre-training
posted 11w ago · verified today
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $180K–$255K · senior
inferenceperformance-engineercpp-langdistributed-inferenceinference-engines
posted 11mo ago · verified today
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $150K–$190K · unknown
datacenter-engineercluster-datacentergo-langpython-langnetwork-fabric
posted 3mo ago · verified today
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $180K–$255K · staff plus
cpp-langlinux-kernelnetwork-fabricrdma-verbssoftware-engineer
posted 6mo ago · verified today
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $250K–$330K · senior
network-engineernetwork-fabricinfiniband-opsroce-netnvlink-topology
posted 4mo ago · verified today
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $245K–$325K · staff plus
performance-engineerinferenceinference-enginesdistributed-inferencenetwork-fabric
posted 11w ago · verified today
SambaNovachip vendor
Bengaluru, India · Bengaluru, Karnataka, India · 3324K–4062K INR · unknown
python-langsolutions-architectinferencefine-tuningkubernetes-ops
posted 3mo ago · verified today
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $210K–$280K · senior
software-engineermlir-llvmperformance-engineer
posted 11mo ago · verified today
SambaNovachip vendor
Bengaluru, India · Bengaluru, Karnataka, India · 8900K–10800K INR · staff plus
ansiblego-langinferenceinference-engineskubernetes-ops
posted 4mo ago · verified today
SambaNovachip vendor
Austin, Texas, United States · Austin, TX +3 more · remote · $250K–$350K · staff plus
network-fabriccustom-asicnetwork-engineercpp-langpython-lang
posted 3mo ago · verified today
Scale AIai startup
New York, NY · San Francisco, CA · $290K–$363K · manager
cudaeng-managerpost-trainingtraining-frameworksflash-attention
posted 12mo ago · verified today
Scale AIai startup
New York, NY · San Francisco, CA +2 more · unknown
inferenceinference-enginessoftware-engineerkubernetes-opsnetwork-fabric
posted 33mo ago · verified today
Scale AIai startup
New York, NY · San Francisco, CA +1 more · $190K–$237K · unknown
cudaflash-attentioninference-enginesml-platformresearch-engineer
posted 20mo ago · verified today
Anyscaleai startup
San Francisco · hybrid · $200K–$240K/year · mid
reliability-sresrego-langkubernetes-opspython-lang
posted 9w ago · verified today
Anyscaleai startup
San Francisco · hybrid · $170K–$199K/year · senior
ray-distributedsolutions-architectfine-tuninginferencekubernetes-ops
posted 4mo ago · verified today
Anyscaleai startup
San Francisco · hybrid · $215K–$265K/year · staff plus
go-langkubernetes-opspython-langsoftware-engineerray-distributed
posted 6w ago · verified today
Anyscaleai startup
Bengaluru, Karnataka · unknown
go-langkubernetes-opspython-langsoftware-engineerml-platform
posted 3mo ago · verified today
Anyscaleai startup
San Francisco · hybrid · $200K–$240K/year · mid
kubernetes-opsray-distributedsoftware-engineergo-langml-platform
posted 10w ago · verified today
Anyscaleai startup
Palo Alto · San Francisco · hybrid · $170K–$245K/year · unknown
distributed-inferenceinferenceinference-enginessoftware-engineervllm-engine
posted 5mo ago · verified today
Anyscaleai startup
Bengaluru, Karnataka · unknown
ray-distributedsoftware-engineercpp-langscheduling-orchestrationml-platform
posted 3mo ago · verified today