AI infrastructure roles, filterable by the stack you actually work on.
Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.
1297 open roles · 85 companies · last verified today
309 roles
Baseteninference provider
Montreal · New York +2 more · hybrid · $165K–$330K/year · unknown
inferenceinference-enginessoftware-engineerdistributed-inferenceperformance-engineer
posted 4mo ago · verified today
Baseteninference provider
San Francisco · hybrid · $200K–$275K/year · unknown
post-traininggpu-genericmodel-parallelismpytorch-distresearch-engineer
posted 5mo ago · verified today
Baseteninference provider
Montreal · New York +2 more · hybrid · $165K–$330K/year · unknown
cpp-langnetwork-fabricnvidiasoftware-engineercollectives
posted 6mo ago · verified today
Baseteninference provider
Montreal · New York +2 more · hybrid · $165K–$330K/year · senior
evaluationgpu-genericperformance-engineerpython-langinference
posted 8mo ago · verified today
Baseteninference provider
Montreal · New York +2 more · hybrid · $180K–$360K/year · mid
cudainferenceinference-enginestensorrt-stackgpu-generic
posted 11mo ago · verified today
Baseteninference provider
Montreal · New York +2 more · hybrid · $180K–$360K/year · unknown
cudagpu-kernelscpp-langgpu-genericinference
posted 14mo ago · verified today
Baseteninference provider
Montreal · New York +2 more · hybrid · $180K–$360K/year · unknown
inferenceinference-engineskv-cache-systemsperformance-engineerquantization
posted 30mo ago · verified today
SambaNovachip vendor
Austin, Texas, United States · Austin, TX +2 more · $200K–$275K · senior
inferenceinference-enginessoftware-engineerspeculative-decodingvllm-engine
posted 3mo ago · verified today
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · staff plus
custom-asicgpu-kernelsnetwork-fabricrdma-verbsroce-net
posted 5mo ago · verified today
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $180K–$255K · senior
inferenceperformance-engineercpp-langdistributed-inferenceinference-engines
posted 9mo ago · verified today
SambaNovachip vendor
Bengaluru, India · Bengaluru, Karnataka, India · 3324K–4062K INR · unknown
python-langsolutions-architectinferencefine-tuningkubernetes-ops
posted 9w ago · verified today
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $210K–$280K · senior
software-engineermlir-llvmperformance-engineer
posted 9mo ago · verified today
Anyscaleai startup
Palo Alto · San Francisco · hybrid · $170K–$245K/year · unknown
distributed-inferenceinferenceinference-enginessoftware-engineervllm-engine
posted 3mo ago · verified today
Modalinference provider
New York · San Francisco · $150K–$350K/year · unknown
inferenceinference-engineskv-cache-systemsquantizationresearch-engineer
posted 10w ago · verified today
Modalinference provider
London · New York +2 more · $150K–$220K/year · unknown
solutions-architectgpu-genericsoftware-engineerml-platforminference
posted 11mo ago · verified today
Modalinference provider
New York · San Francisco · $200K–$350K/year · senior
performance-engineercudagpu-kernelsinference-enginesnvidia
posted 4mo ago · verified today
Modalinference provider
New York · San Francisco · $180K–$250K/year · unknown
solutions-architectsglang-enginevllm-engineperformance-engineerinference
posted 6mo ago · verified today
Fireworks AIinference provider
Singapore · 200K–350K SGD/year · senior
fine-tuninginferenceinference-enginespython-langsglang-engine
posted 8w ago · verified today
Fireworks AIinference provider
San Mateo · hybrid · $175K–$220K/year · unknown
gpu-kernelsperformance-engineercudagpu-genericsoftware-engineer
posted 16mo ago · verified today
xAIfrontier lab
Palo Alto, CA · $180K–$440K/year est. · unknown
cpp-langgpu-genericgpu-kernelsinferenceinference-engines
posted 23mo ago · verified today
xAIfrontier lab
Palo Alto, CA · $180K–$440K/year est. · unknown
cpp-langkubernetes-opsrust-langsoftware-engineercluster-datacenter
posted 8w ago · verified today
xAIfrontier lab
Palo Alto, CA · $180K–$440K/year est. · unknown
cudacutlass-cutegpu-kernelsperformance-engineersoftware-engineer
posted 6mo ago · verified today
xAIfrontier lab
Palo Alto, CA · $180K–$440K/year est. · unknown
cpp-langcudadistributed-inferenceinferenceinference-engines
posted 10w ago · verified today
CoreWeaveneocloud
Bellevue, WA · Sunnyvale, CA · $188K–$275K/year est. · staff plus
inferenceinference-enginesdistributed-inferencegpu-generickubernetes-ops
posted 4mo ago · verified today
CoreWeaveneocloud
Bellevue, WA · Livingston, NJ +3 more · $188K–$275K/year est. · staff plus
object-storagesoftware-engineergo-langrust-langkubernetes-ops
posted 10mo ago · verified today
CoreWeaveneocloud
Bellevue, WA · San Francisco, CA +1 more · $188K–$275K/year est. · senior
gpu-genericnvidiacluster-datacenterinfiniband-opsnetwork-fabric
posted 3mo ago · verified today
CoreWeaveneocloud
Bellevue, WA · Sunnyvale, CA · $182K–$242K/year est. · senior
kubernetes-opsperformance-engineerpython-langsoftware-engineergo-lang
posted 4mo ago · verified today
CoreWeaveneocloud
Bellevue, WA · Sunnyvale, CA · $152K–$204K/year est. · senior
cudadistributed-inferencego-langgpu-genericgpu-kernels
posted 11mo ago · verified today
CoreWeaveneocloud
Bellevue, WA · Sunnyvale, CA · $139K–$204K/year est. · senior
software-engineerinferenceinference-engineskubernetes-opsgpu-generic
posted 7mo ago · verified today
CoreWeaveneocloud
Bellevue, WA · Sunnyvale, CA · $182K–$242K/year est. · senior
gpu-kernelsperformance-engineernvidiaamdtpu
posted 9w ago · verified today