AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

412 roles

inference ✕

SambaNovachip vendor

Bengaluru, India · Bengaluru, Karnataka, India · 8900K–10800K INR · staff plus

ansiblego-langinferenceinference-engineskubernetes-ops

posted 4mo ago · verified 3d ago

Scale AIai startup

New York, NY · San Francisco, CA · $290K–$363K · manager

cudaeng-managerpost-trainingtraining-frameworksflash-attention

posted 12mo ago · verified 3d ago

Scale AIai startup

New York, NY · San Francisco, CA +2 more · unknown

inferenceinference-enginessoftware-engineerkubernetes-opsnetwork-fabric

posted 33mo ago · verified 3d ago

Anyscaleai startup

San Francisco · hybrid · $170K–$199K/year · senior

ray-distributedsolutions-architectfine-tuninginferencekubernetes-ops

posted 4mo ago · verified 3d ago

Anyscaleai startup

Palo Alto · San Francisco · hybrid · $170K–$245K/year · unknown

distributed-inferenceinferenceinference-enginessoftware-engineervllm-engine

posted 5mo ago · verified 3d ago

Modalinference provider

New York · San Francisco · $150K–$350K/year · unknown

inferencespeculative-decodingkv-cache-systemsquantizationresearch-engineer

posted 3mo ago · verified 3d ago

Modalinference provider

New York · San Francisco · $200K–$350K/year · senior

cudainference-enginesnvidiaperformance-engineerinference

posted 6mo ago · verified 3d ago

Modalinference provider

New York · San Francisco · $180K–$250K/year · unknown

solutions-architectinferencefine-tuninggpu-genericreinforcement-learning

posted 8mo ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo · hybrid · $200K–$260K/year · unknown

fine-tuningpython-langsglang-enginesolutions-architectvllm-engine

posted 4mo ago · verified 3d ago

Fireworks AIinference provider

London · hybrid · unknown

fine-tuninginferencepost-trainingpython-langgpu-generic

posted 8w ago · verified 3d ago

Fireworks AIinference provider

London · hybrid · senior

fine-tuninginferenceinference-enginespython-langsglang-engine

posted 3mo ago · verified 3d ago

Fireworks AIinference provider

Singapore · 200K–280K SGD/year · senior

solutions-architectfine-tuninginferenceinference-enginespython-lang

posted 3mo ago · verified 3d ago

Fireworks AIinference provider

Greater Seattle Area · New York +1 more · hybrid · $175K–$220K/year · unknown

python-langsoftware-engineergo-langinferenceinference-engines

posted 12mo ago · verified 3d ago

Fireworks AIinference provider

New York · San Mateo · hybrid · $175K–$220K/year · senior

software-engineerkubernetes-opsml-platformpython-langobservability

posted 16mo ago · verified 3d ago

Fireworks AIinference provider

San Mateo · hybrid · $175K–$220K/year · unknown

gpu-kernelsperformance-engineercudagpu-genericsoftware-engineer

posted 18mo ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · $150K–$450K/year est. · unknown

jax-pallaskubernetes-opspytorch-distsoftware-engineerevaluation

posted 7mo ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · Seattle, WA · $180K–$440K/year est. · unknown

cpp-langinferenceinference-enginessoftware-engineerdistributed-inference

posted 25mo ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · Seattle, WA · $180K–$440K/year est. · unknown

cpp-langcudacutlass-cutegpu-genericgpu-kernels

posted 7mo ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · $180K–$440K/year est. · unknown

gpu-genericpython-langsoftware-engineernvidiacluster-datacenter

posted 3mo ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · $180K–$440K/year est. · unknown

inferenceinference-enginespython-langreinforcement-learningcpp-lang

posted 3mo ago · verified 3d ago

xAIfrontier lab

Palo Alto, CA · $180K–$440K/year est. · senior

post-trainingpre-trainingpython-langsoftware-engineertraining-data-infra

posted 6mo ago · verified 3d ago

xAIfrontier lab

London, England, United Kingdom · UK · £107K–£262K/year est. · unknown

inferenceinference-enginesrust-langsoftware-engineercpp-lang

posted 6mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $188K–$275K/year est. · staff plus

inferenceinference-enginesdistributed-inferencegpu-generickubernetes-ops

posted 5mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $92K–$135K/year est. · junior

inferencepython-langsoftware-engineergo-langinference-engines

posted 12mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $152K–$204K/year est. · senior

cudadistributed-inferencego-langgpu-genericgpu-kernels

posted 13mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $139K–$204K/year est. · senior

software-engineerinferenceinference-engineskubernetes-opsgpu-generic

posted 9mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $206K–$333K/year est. · staff plus

cudaperformance-engineergpu-genericinferenceinference-engines

posted 10mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Sunnyvale, CA · $206K–$303K/year est. · staff plus

kubernetes-opsscheduling-orchestrationgo-langsoftware-engineerslurm-admin

posted 8mo ago · verified 3d ago

CoreWeaveneocloud

Atlanta, GA · San Francisco, CA · $182K–$242K/year est. · unknown

solutions-architectpython-langnvidiafine-tuninginfiniband-ops

posted 3mo ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · Seattle, WA · $182K–$242K/year est. · unknown

solutions-architectnvidiapython-langvllm-enginegpu-generic

posted 3mo ago · verified 3d ago