AI infrastructure roles, filterable by the stack you actually work on.
Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.
1538 open roles · 87 companies · last verified 3d ago
115 roles
Novita AIinference provider
San Mateo · onsite · unknown
kubernetes-opspython-langsolutions-architectinferenceinference-engines
posted 4mo ago · verified 3d ago
Crusoeneocloud
San Francisco, CA - US · onsite · staff plus
inferenceinference-enginesperformance-engineersglang-enginevllm-engine
posted 7w ago · verified 3d ago
Together AIneocloud
San Francisco · $270K–$300K/year est. · senior
inference-engineskv-cache-systemspython-langspeculative-decodinginference
posted 5mo ago · verified 3d ago
Amazon (AWS)hyperscaler
Arlington, Virginia, USA · Denver, Colorado, USA +1 more · onsite · senior
kubernetes-opssolutions-architectgpu-genericnvidiascheduling-orchestration
posted 7w ago · verified 3d ago
Tenstorrentchip vendor
Asia · Malaysia +1 more · unknown
python-langsolutions-architectcudacpp-lang
posted 11w ago · verified 3d ago
Tenstorrentchip vendor
Belgrade · Munich, Germany +2 more · unknown
solutions-architecttraining-frameworkscluster-datacenterfine-tuning
posted 4mo ago · verified 3d ago
Prime Intellectneocloud
APAC · Remote +2 more · remote · unknown
cluster-datacentergpu-genericinfiniband-opskubernetes-opsnetwork-fabric
posted 3mo ago · verified 3d ago
Amazon (AWS)hyperscaler
Arlington, Virginia, USA · Denver, Colorado, USA +1 more · onsite · senior
solutions-architectgpu-generickubernetes-opsml-platformnvidia
posted 8w ago · verified 3d ago
Nebiusneocloud
Abu Dhabi, UAE · Middle East +1 more · remote · senior
solutions-architectgpu-generickubernetes-opsml-platforminference
posted 3mo ago · verified 3d ago
Nebiusneocloud
South Korea · staff plus
solutions-architectcudagpu-genericansiblekubernetes-ops
posted 9w ago · verified 3d ago
Nebiusneocloud
Japan · staff plus
solutions-architectcudagpu-generickubernetes-opsml-platform
posted 9w ago · verified 3d ago
Nebiusneocloud
Finland · France +6 more · remote · manager
solutions-architecteng-managerkubernetes-ops
posted 10w ago · verified 3d ago
Amazon (AWS)hyperscaler
Arlington, Virginia, USA · Denver, Colorado, USA +1 more · onsite · senior
solutions-architectkubernetes-opsml-platformcluster-datacenternvidia
posted 10w ago · verified 3d ago
Amazon (AWS)hyperscaler
Arlington, Virginia, USA · Denver, Colorado, USA +1 more · onsite · senior
solutions-architectcluster-datacenterkubernetes-opsnvidiascheduling-orchestration
posted 10w ago · verified 3d ago
Amazon (AWS)hyperscaler
Arlington, Virginia, USA · Denver, Colorado, USA +1 more · onsite · senior
kubernetes-opsgpu-genericscheduling-orchestrationsolutions-architectcluster-datacenter
posted 10w ago · verified 3d ago
Nebiusneocloud
Remote - United States · United States · remote · $180K–$220K/year est. · senior
gpu-genericnvidiasolutions-architectcluster-datacenterperformance-engineer
posted 7mo ago · verified 3d ago
Lambdaneocloud
San Francisco Office (Second St) · San Jose Office (First St) · remote · $251K–$335K · unknown
gpu-generickubernetes-opscluster-datacentersolutions-architectnetwork-fabric
posted 10w ago · verified 3d ago
SambaNovachip vendor
San Jose, CA · San Jose, California, United States · $225K–$250K · unknown
solutions-architectnetwork-fabricinfiniband-opsnetwork-engineercluster-datacenter
posted 10w ago · verified 3d ago
CoreWeaveneocloud
Bellevue, WA · San Francisco, CA +1 more · $198K–$264K/year est. · staff plus
amdcluster-datacenterdeepspeed-libdistributed-inferencefsdp
posted 10w ago · verified 3d ago
Baseteninference provider
New York · San Francisco · hybrid · $200K–$400K/year · mid
inferencesolutions-architectevaluationinference-enginespost-training
posted 10w ago · verified 3d ago
Amazon (AWS)hyperscaler
Seattle, Washington, USA · onsite · staff plus
solutions-architectcudagpu-generickubernetes-opscluster-datacenter
posted 4mo ago · verified 3d ago
Amazon (AWS)hyperscaler
Tel Aviv-Yafo, Tel Aviv, ISR · onsite · senior
solutions-architectscheduling-orchestrationcluster-datacenterparallel-fsgpu-generic
posted 5mo ago · verified 3d ago
Amazon (AWS)hyperscaler
Herndon, Virginia, USA · New York, New York, USA +1 more · onsite · senior
solutions-architectgpu-genericinference-enginesmodel-parallelismtraining-frameworks
posted 4mo ago · verified 3d ago
CoreWeaveneocloud
Austin, TX · US - Remote - Texas · $182K–$242K/year est. · unknown
python-langsolutions-architectgpu-genericinfiniband-opskubernetes-ops
posted 10w ago · verified 3d ago
Baseteninference provider
New York · San Francisco · hybrid · $165K–$330K/year · unknown
inferenceinference-enginessglang-enginesolutions-architecttensorrt-stack
posted 8mo ago · verified 3d ago
SambaNovachip vendor
Bengaluru, India · Bengaluru, Karnataka, India · 3324K–4062K INR · unknown
python-langsolutions-architectinferencefine-tuningkubernetes-ops
posted 3mo ago · verified 3d ago
Anyscaleai startup
San Francisco · hybrid · $170K–$199K/year · senior
ray-distributedsolutions-architectfine-tuninginferencekubernetes-ops
posted 4mo ago · verified 3d ago
Modalinference provider
London · New York +2 more · onsite · $200K–$280K/year · unknown
solutions-architectkubernetes-opspython-langterraform-iac
posted 8mo ago · verified 3d ago
Modalinference provider
New York · San Francisco · onsite · $180K–$240K/year · mid
kubernetes-opssolutions-architectterraform-iacscheduling-orchestrationgpu-generic
posted 13mo ago · verified 3d ago
Modalinference provider
New York · San Francisco · $180K–$250K/year · unknown
solutions-architectinferencefine-tuninggpu-genericreinforcement-learning
posted 8mo ago · verified 3d ago