AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

115 roles

solutions-architect ✕

Novita AIinference provider

San Mateo · onsite · unknown

kubernetes-opspython-langsolutions-architectinferenceinference-engines

posted 4mo ago · verified 3d ago

Crusoeneocloud

San Francisco, CA - US · onsite · staff plus

inferenceinference-enginesperformance-engineersglang-enginevllm-engine

posted 7w ago · verified 3d ago

Together AIneocloud

San Francisco · $270K–$300K/year est. · senior

inference-engineskv-cache-systemspython-langspeculative-decodinginference

posted 5mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Denver, Colorado, USA +1 more · onsite · senior

kubernetes-opssolutions-architectgpu-genericnvidiascheduling-orchestration

posted 7w ago · verified 3d ago

Tenstorrentchip vendor

Asia · Malaysia +1 more · unknown

python-langsolutions-architectcudacpp-lang

posted 11w ago · verified 3d ago

Tenstorrentchip vendor

Belgrade · Munich, Germany +2 more · unknown

solutions-architecttraining-frameworkscluster-datacenterfine-tuning

posted 4mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Denver, Colorado, USA +1 more · onsite · senior

solutions-architectgpu-generickubernetes-opsml-platformnvidia

posted 8w ago · verified 3d ago

Nebiusneocloud

Abu Dhabi, UAE · Middle East +1 more · remote · senior

solutions-architectgpu-generickubernetes-opsml-platforminference

posted 3mo ago · verified 3d ago

Nebiusneocloud

Finland · France +6 more · remote · manager

solutions-architecteng-managerkubernetes-ops

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Denver, Colorado, USA +1 more · onsite · senior

solutions-architectkubernetes-opsml-platformcluster-datacenternvidia

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Denver, Colorado, USA +1 more · onsite · senior

solutions-architectcluster-datacenterkubernetes-opsnvidiascheduling-orchestration

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Arlington, Virginia, USA · Denver, Colorado, USA +1 more · onsite · senior

kubernetes-opsgpu-genericscheduling-orchestrationsolutions-architectcluster-datacenter

posted 10w ago · verified 3d ago

Nebiusneocloud

Remote - United States · United States · remote · $180K–$220K/year est. · senior

gpu-genericnvidiasolutions-architectcluster-datacenterperformance-engineer

posted 7mo ago · verified 3d ago

Lambdaneocloud

San Francisco Office (Second St) · San Jose Office (First St) · remote · $251K–$335K · unknown

gpu-generickubernetes-opscluster-datacentersolutions-architectnetwork-fabric

posted 10w ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $225K–$250K · unknown

solutions-architectnetwork-fabricinfiniband-opsnetwork-engineercluster-datacenter

posted 10w ago · verified 3d ago

CoreWeaveneocloud

Bellevue, WA · San Francisco, CA +1 more · $198K–$264K/year est. · staff plus

amdcluster-datacenterdeepspeed-libdistributed-inferencefsdp

posted 10w ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $200K–$400K/year · mid

inferencesolutions-architectevaluationinference-enginespost-training

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · staff plus

solutions-architectcudagpu-generickubernetes-opscluster-datacenter

posted 4mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Herndon, Virginia, USA · New York, New York, USA +1 more · onsite · senior

solutions-architectgpu-genericinference-enginesmodel-parallelismtraining-frameworks

posted 4mo ago · verified 3d ago

CoreWeaveneocloud

Austin, TX · US - Remote - Texas · $182K–$242K/year est. · unknown

python-langsolutions-architectgpu-genericinfiniband-opskubernetes-ops

posted 10w ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $165K–$330K/year · unknown

inferenceinference-enginessglang-enginesolutions-architecttensorrt-stack

posted 8mo ago · verified 3d ago

SambaNovachip vendor

Bengaluru, India · Bengaluru, Karnataka, India · 3324K–4062K INR · unknown

python-langsolutions-architectinferencefine-tuningkubernetes-ops

posted 3mo ago · verified 3d ago

Anyscaleai startup

San Francisco · hybrid · $170K–$199K/year · senior

ray-distributedsolutions-architectfine-tuninginferencekubernetes-ops

posted 4mo ago · verified 3d ago

Modalinference provider

London · New York +2 more · onsite · $200K–$280K/year · unknown

solutions-architectkubernetes-opspython-langterraform-iac

posted 8mo ago · verified 3d ago

Modalinference provider

New York · San Francisco · onsite · $180K–$240K/year · mid

kubernetes-opssolutions-architectterraform-iacscheduling-orchestrationgpu-generic

posted 13mo ago · verified 3d ago

Modalinference provider

New York · San Francisco · $180K–$250K/year · unknown

solutions-architectinferencefine-tuninggpu-genericreinforcement-learning

posted 8mo ago · verified 3d ago