AI infrastructure roles, filterable by the stack you actually work on.
Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.
1538 open roles · 87 companies · last verified 3d ago
95 roles
Inferactinference provider
Singapore · onsite · 200K–400K SGD/year · unknown
amdgpu-kernelsinferenceinference-enginesperformance-engineer
posted 4mo ago · verified 3d ago
Inferactinference provider
Singapore · onsite · $200K–$400K/year · unknown
gpu-kernelscudaperformance-engineercpp-langinference
posted 4mo ago · verified 3d ago
Inferactinference provider
San Francisco · onsite · $200K–$400K/year · unknown
tpuinference-enginesjax-pallasperformance-engineerxla-compiler
posted 4mo ago · verified 3d ago
FriendliAIinference provider
Seoul · onsite · mid
amdcpp-langcudacutlass-cutegpu-kernels
posted 6mo ago · verified 3d ago
FriendliAIinference provider
San Francisco · hybrid · mid
amdcpp-langcudagpu-genericgpu-kernels
posted 7mo ago · verified 3d ago
Liquid AIfrontier lab
Boston · hybrid · unknown
cpp-langinferenceinference-enginespython-langevaluation
posted 9w ago · verified 3d ago
Thinking Machines Labfrontier lab
San Francisco · onsite · unknown
reinforcement-learningpython-langresearch-engineerinference-enginesdistributed-inference
posted 10w ago · verified 3d ago
Thinking Machines Labfrontier lab
San Francisco · onsite · unknown
cudagpu-kernelstriton-langresearch-engineergpu-generic
posted 12w ago · verified 3d ago
Thinking Machines Labfrontier lab
San Francisco · onsite · unknown
gpu-kernelsmodel-parallelismquantizationresearch-engineercollectives
posted 12w ago · verified 3d ago
Amazon (AWS)hyperscaler
Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior
gpu-kernelsinferenceinference-engineskv-cache-systemsperformance-engineer
posted 9w ago · verified 3d ago
Nebiusneocloud
Remote - United States · United States · remote · $228K–$285K · manager
eng-managerfine-tuninginferenceinference-engineskubernetes-ops
posted 10w ago · verified 3d ago
Amazon (AWS)hyperscaler
Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior
cudacutlass-cutedistributed-inferenceevaluationflash-attention
posted 10w ago · verified 3d ago
Amazon (AWS)hyperscaler
Herndon, Virginia, USA · New York, New York, USA +1 more · onsite · senior
solutions-architectgpu-genericinference-enginesmodel-parallelismtraining-frameworks
posted 4mo ago · verified 3d ago
Perplexityai startup
London · mid
cudagpu-kernelsinferenceinference-engineskv-cache-systems
posted 6mo ago · verified 3d ago
Perplexityai startup
New York City · Palo Alto +1 more · $220K–$485K/year · mid
cudagpu-kernelsinferenceinference-enginescutlass-cute
posted 6mo ago · verified 3d ago
Cerebraschip vendor
Sunnyvale, CA · Toronto, CAN · hybrid · staff plus
inferenceinference-engineskv-cache-systemsperformance-engineerrocm-hip
posted 10d ago · verified 3d ago
Cerebraschip vendor
Sunnyvale, CA · Toronto, CAN · onsite · senior
amdcpp-langinferenceinference-enginespython-lang
posted 11mo ago · verified 3d ago
Baseteninference provider
Montreal · New York +3 more · hybrid · $180K–$360K/year · unknown
cudagpu-kernelsgpu-genericsoftware-engineercpp-lang
posted 15mo ago · verified 3d ago
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $180K–$255K · senior
inferenceperformance-engineercpp-langdistributed-inferenceinference-engines
posted 11mo ago · verified 3d ago
SambaNovachip vendor
Bengaluru, India · Bengaluru, Karnataka, India · 3324K–4062K INR · unknown
python-langsolutions-architectinferencefine-tuningkubernetes-ops
posted 3mo ago · verified 3d ago
Modalinference provider
New York · San Francisco · $150K–$350K/year · unknown
inferencespeculative-decodingkv-cache-systemsquantizationresearch-engineer
posted 3mo ago · verified 3d ago
Fireworks AIinference provider
New York · San Mateo +1 more · hybrid · $200K–$260K/year · senior
inference-enginesquantizationsglang-enginevllm-enginefine-tuning
posted 4mo ago · verified 3d ago
Fireworks AIinference provider
New York · San Mateo · hybrid · $200K–$260K/year · unknown
fine-tuningpython-langsglang-enginesolutions-architectvllm-engine
posted 4mo ago · verified 3d ago
Fireworks AIinference provider
London · hybrid · unknown
fine-tuninginferencepost-trainingpython-langgpu-generic
posted 8w ago · verified 3d ago
Fireworks AIinference provider
London · hybrid · senior
fine-tuninginferenceinference-enginespython-langsglang-engine
posted 3mo ago · verified 3d ago
Fireworks AIinference provider
Singapore · 200K–280K SGD/year · senior
solutions-architectfine-tuninginferenceinference-enginespython-lang
posted 3mo ago · verified 3d ago
Fireworks AIinference provider
San Mateo · hybrid · $175K–$220K/year · unknown
gpu-kernelsperformance-engineercudagpu-genericsoftware-engineer
posted 18mo ago · verified 3d ago
xAIfrontier lab
Palo Alto, CA · Seattle, WA · $180K–$440K/year est. · unknown
cpp-langinferenceinference-enginessoftware-engineerdistributed-inference
posted 25mo ago · verified 3d ago
xAIfrontier lab
Palo Alto, CA · $180K–$440K/year est. · unknown
inferenceinference-enginespython-langreinforcement-learningcpp-lang
posted 3mo ago · verified 3d ago
CoreWeaveneocloud
Bellevue, WA · Sunnyvale, CA · $188K–$275K/year est. · staff plus
inferenceinference-enginesdistributed-inferencegpu-generickubernetes-ops
posted 5mo ago · verified 3d ago