AI infrastructure roles, filterable by the stack you actually work on.
Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.
1538 open roles · 87 companies · last verified 3d ago
301 roles
SambaNovachip vendor
Austin, Texas, United States · Austin, TX +2 more · $200K–$275K · senior
inferenceinference-enginespython-langvllm-enginesoftware-engineer
posted 4mo ago · verified 3d ago
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $220K–$300K · staff plus
fine-tuninginferencesoftware-engineerinference-enginespre-training
posted 11w ago · verified 3d ago
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $180K–$255K · senior
inferenceperformance-engineercpp-langdistributed-inferenceinference-engines
posted 11mo ago · verified 3d ago
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $245K–$325K · staff plus
performance-engineerinferenceinference-enginesdistributed-inferencenetwork-fabric
posted 11w ago · verified 3d ago
SambaNovachip vendor
Bengaluru, India · Bengaluru, Karnataka, India · 8900K–10800K INR · staff plus
ansiblego-langinferenceinference-engineskubernetes-ops
posted 4mo ago · verified 3d ago
Scale AIai startup
New York, NY · San Francisco, CA · $290K–$363K · manager
cudaeng-managerpost-trainingtraining-frameworksflash-attention
posted 12mo ago · verified 3d ago
Scale AIai startup
New York, NY · San Francisco, CA +2 more · unknown
inferenceinference-enginessoftware-engineerkubernetes-opsnetwork-fabric
posted 33mo ago · verified 3d ago
Scale AIai startup
New York, NY · San Francisco, CA +1 more · $190K–$237K · unknown
cudaflash-attentioninference-enginesml-platformresearch-engineer
posted 20mo ago · verified 3d ago
Anyscaleai startup
Palo Alto · San Francisco · hybrid · $170K–$245K/year · unknown
distributed-inferenceinferenceinference-enginessoftware-engineervllm-engine
posted 5mo ago · verified 3d ago
Modalinference provider
New York · San Francisco · $150K–$350K/year · unknown
inferencespeculative-decodingkv-cache-systemsquantizationresearch-engineer
posted 3mo ago · verified 3d ago
Modalinference provider
New York · San Francisco · $200K–$350K/year · senior
cudainference-enginesnvidiaperformance-engineerinference
posted 6mo ago · verified 3d ago
Fireworks AIinference provider
New York · San Mateo +1 more · hybrid · $200K–$260K/year · senior
inference-enginesquantizationsglang-enginevllm-enginefine-tuning
posted 4mo ago · verified 3d ago
Fireworks AIinference provider
New York · San Mateo · hybrid · $200K–$260K/year · unknown
fine-tuningpython-langsglang-enginesolutions-architectvllm-engine
posted 4mo ago · verified 3d ago
Fireworks AIinference provider
London · hybrid · unknown
fine-tuninginferencepost-trainingpython-langgpu-generic
posted 8w ago · verified 3d ago
Fireworks AIinference provider
London · hybrid · senior
fine-tuninginferenceinference-enginespython-langsglang-engine
posted 3mo ago · verified 3d ago
Fireworks AIinference provider
Singapore · 200K–280K SGD/year · senior
solutions-architectfine-tuninginferenceinference-enginespython-lang
posted 3mo ago · verified 3d ago
Fireworks AIinference provider
Greater Seattle Area · New York +1 more · hybrid · $175K–$220K/year · unknown
python-langsoftware-engineergo-langinferenceinference-engines
posted 12mo ago · verified 3d ago
Fireworks AIinference provider
New York · San Mateo · hybrid · $175K–$220K/year · senior
software-engineerkubernetes-opsml-platformpython-langobservability
posted 16mo ago · verified 3d ago
Fireworks AIinference provider
San Mateo · hybrid · $175K–$220K/year · unknown
gpu-kernelsperformance-engineercudagpu-genericsoftware-engineer
posted 18mo ago · verified 3d ago
xAIfrontier lab
Palo Alto, CA · $150K–$450K/year est. · unknown
jax-pallaskubernetes-opspytorch-distsoftware-engineerevaluation
posted 7mo ago · verified 3d ago
xAIfrontier lab
Palo Alto, CA · Seattle, WA · $180K–$440K/year est. · unknown
cpp-langinferenceinference-enginessoftware-engineerdistributed-inference
posted 25mo ago · verified 3d ago
xAIfrontier lab
Palo Alto, CA · $180K–$440K/year est. · unknown
inferenceinference-enginespython-langreinforcement-learningcpp-lang
posted 3mo ago · verified 3d ago
xAIfrontier lab
London, England, United Kingdom · UK · £107K–£262K/year est. · unknown
inferenceinference-enginesrust-langsoftware-engineercpp-lang
posted 6mo ago · verified 3d ago
CoreWeaveneocloud
Bellevue, WA · Sunnyvale, CA · $188K–$275K/year est. · staff plus
inferenceinference-enginesdistributed-inferencegpu-generickubernetes-ops
posted 5mo ago · verified 3d ago
CoreWeaveneocloud
Bellevue, WA · Sunnyvale, CA · $92K–$135K/year est. · junior
inferencepython-langsoftware-engineergo-langinference-engines
posted 12mo ago · verified 3d ago
CoreWeaveneocloud
Bellevue, WA · Sunnyvale, CA · $152K–$204K/year est. · senior
cudadistributed-inferencego-langgpu-genericgpu-kernels
posted 13mo ago · verified 3d ago
CoreWeaveneocloud
Bellevue, WA · Sunnyvale, CA · $139K–$204K/year est. · senior
software-engineerinferenceinference-engineskubernetes-opsgpu-generic
posted 9mo ago · verified 3d ago
CoreWeaveneocloud
Bellevue, WA · Sunnyvale, CA · $206K–$333K/year est. · staff plus
cudaperformance-engineergpu-genericinferenceinference-engines
posted 10mo ago · verified 3d ago
OpenAIfrontier lab
San Francisco · hybrid · $266K–$445K/year · senior
reliability-sresoftware-engineerinferenceinference-enginesml-platform
posted 4mo ago · verified 3d ago
OpenAIfrontier lab
San Francisco · Seattle · hybrid · $293K–$385K/year · unknown
evaluationgpu-kernelsinferencesoftware-engineercollectives
posted 6mo ago · verified 3d ago