AI infrastructure roles, filterable by the stack you actually work on.
Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.
1297 open roles · 85 companies · last verified today
297 roles
Baseteninference provider
Montreal · New York +2 more · hybrid · $260K–$380K/year · manager
eng-managerinferenceinference-enginespython-langdistributed-inference
posted 4mo ago · verified today
Baseteninference provider
Montreal · New York +2 more · hybrid · $180K–$360K/year · mid
cudainferenceinference-enginestensorrt-stackgpu-generic
posted 11mo ago · verified today
Baseteninference provider
Montreal · New York +2 more · hybrid · $180K–$360K/year · unknown
cudagpu-kernelscpp-langgpu-genericinference
posted 14mo ago · verified today
Baseteninference provider
Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown
inferencekubernetes-opsml-platformpython-langsoftware-engineer
posted 18mo ago · verified today
Baseteninference provider
Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown
inferencekubernetes-opsml-platformsoftware-engineerinference-engines
posted 11mo ago · verified today
Baseteninference provider
Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown
kubernetes-opsobservabilityreliability-sresreterraform-iac
posted 4mo ago · verified today
Baseteninference provider
Montreal · New York +2 more · hybrid · $180K–$360K/year · unknown
inferenceinference-engineskv-cache-systemsperformance-engineerquantization
posted 30mo ago · verified today
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $245K–$325K · manager
eng-managerinferenceinference-enginesml-platformgo-lang
posted 3mo ago · verified today
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $245K–$325K · staff plus
inferenceinference-enginespython-langsoftware-engineerkubernetes-ops
posted 3mo ago · verified today
SambaNovachip vendor
Austin, Texas, United States · Austin, TX +2 more · $200K–$275K · senior
inferenceinference-enginessoftware-engineerspeculative-decodingvllm-engine
posted 3mo ago · verified today
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · staff plus
custom-asicgpu-kernelsnetwork-fabricrdma-verbsroce-net
posted 5mo ago · verified today
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $220K–$300K · staff plus
fine-tuninginferencesoftware-engineerinference-enginespre-training
posted 4w ago · verified today
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $180K–$255K · senior
inferenceperformance-engineercpp-langdistributed-inferenceinference-engines
posted 9mo ago · verified today
Scale AIai startup
New York, NY · San Francisco, CA · $290K–$363K · manager
cudaeng-managerpost-trainingtraining-frameworksflash-attention
posted 11mo ago · verified today
Scale AIai startup
New York, NY · San Francisco, CA +2 more · unknown
inferenceinference-enginessoftware-engineerkubernetes-opsnetwork-fabric
posted 31mo ago · verified today
Scale AIai startup
New York, NY · San Francisco, CA +1 more · $190K–$237K · unknown
cudaflash-attentioninference-enginesml-platformresearch-engineer
posted 18mo ago · verified today
Scale AIai startup
London, UK · unknown
inferenceinference-enginessoftware-engineercpp-langgo-lang
posted 7w ago · verified today
Anyscaleai startup
Palo Alto · San Francisco · hybrid · $170K–$245K/year · unknown
distributed-inferenceinferenceinference-enginessoftware-engineervllm-engine
posted 3mo ago · verified today
Modalinference provider
New York · San Francisco · $150K–$350K/year · unknown
inferenceinference-engineskv-cache-systemsquantizationresearch-engineer
posted 10w ago · verified today
Modalinference provider
Stockholm · mid
inferencesolutions-architectdistributed-inferencefine-tuninggpu-generic
posted 6mo ago · verified today
Modalinference provider
New York · San Francisco · $200K–$350K/year · senior
performance-engineercudagpu-kernelsinference-enginesnvidia
posted 4mo ago · verified today
Modalinference provider
New York · San Francisco · $180K–$250K/year · unknown
solutions-architectsglang-enginevllm-engineperformance-engineerinference
posted 6mo ago · verified today
Fireworks AIinference provider
New York · San Mateo +1 more · hybrid · $200K–$260K/year · senior
inference-enginesquantizationsglang-enginevllm-enginefine-tuning
posted 3mo ago · verified today
Fireworks AIinference provider
New York · San Mateo · hybrid · $200K–$260K/year · unknown
fine-tuningpython-langsglang-enginesolutions-architectvllm-engine
posted 3mo ago · verified today
Fireworks AIinference provider
London · senior
fine-tuninginferenceinference-enginespost-trainingpython-lang
posted 14d ago · verified today
Fireworks AIinference provider
London · senior
fine-tuninginferenceinference-enginespython-langsglang-engine
posted 8w ago · verified today
Fireworks AIinference provider
Singapore · 200K–350K SGD/year · senior
fine-tuninginferenceinference-enginespython-langsglang-engine
posted 8w ago · verified today
Fireworks AIinference provider
San Mateo · hybrid · $175K–$220K/year · unknown
ml-platformpython-langsoftware-engineerinferenceinference-engines
posted 10mo ago · verified today
Fireworks AIinference provider
New York · San Mateo · hybrid · $175K–$220K/year · senior
software-engineerkubernetes-opsml-platformpython-langobservability
posted 15mo ago · verified today
Fireworks AIinference provider
San Mateo · hybrid · $175K–$220K/year · unknown
gpu-kernelsperformance-engineercudagpu-genericsoftware-engineer
posted 16mo ago · verified today