AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1291 open roles · 84 companies · last verified today

Location

Remote184United States1011United Kingdom112Canada91Netherlands37France32Israel30India29Germany25Singapore25Finland12Poland11Sweden11Czechia9South Korea9Ireland8Norway8Bulgaria6Spain6Japan6Switzerland5Taiwan5Iceland3Serbia3United Arab Emirates2Australia2Estonia2Portugal2Mexico1Saudi Arabia1CA, US733WA, US269NY, US215TX, US149Ontario, CA41England, GB38NJ, US33Europe29TN, US23CO, US20MS, US18Quebec, CA16Tel Aviv, IL16Karnataka, IN15Ile-de-France, FR14MA, US14NV, US14Québec, CA12London, GB8Singapore, SG8DC, US7ON, CA7VA, US7IL, US6North Holland, NL6AZ, US5GA, US5Americas4Bavaria, DE4EMEA4Greater London, GB4Haifa, IL4Leinster, IE4APAC3FL, US3LA, US3Masovian Voivodeship, PL3MN, US3MO, US3OK, US3Pas-de-Calais, FR3Seoul, KR3Taiwan, TW3AL, US2Baden-Württemberg, DE2British Columbia, CA2Finland, FI2New South Wales, AU2PA, US2Pomeranian Voivodeship, PL2TPE, TW2Vaud, CH2Worldwide2Baden Württemberg, DE1Bajío, MX1BC, CA1Berlin, DE1EMEA, GB1Mass, US1ND, US1Norway, NO1QC, CA1Riyadh, SA1Southern Peninsula, IS1Tamil Nadu, IN1UK, SG1United Kingdom, GB1San Francisco, CA, US409New York, NY, US212Seattle, WA, US204Austin, TX, US122Sunnyvale, CA, US119Cupertino, CA, US102San Jose, CA, US80Bellevue, WA, US64Palo Alto, CA, US45Toronto, Ontario, CA41London, England, GB38London, GB33Manhattan, NY, US30Livingston, NJ, US28Amsterdam, NL26Memphis, TN, US23San Mateo, CA, US20Denver, CO, US19Houston, TX, US19Southaven, MS, US18Santa Clara, CA, US16Montreal, Quebec, CA15Bengaluru, Karnataka, IN14Paris, Ile-de-France, FR14Toronto, CA14Las Vegas, NV, US13Los Angeles, CA, US13Tel Aviv-Yafo, Tel Aviv, IL13Montreal, Québec, CA12Berlin, DE9Boston, MA, US9Paris, FR9Prague, CZ9London, London, GB8Redwood City, CA, US8Stockholm, SE8Herndon, VA, US7Toronto, ON, CA7Amsterdam, North Holland, NL6DigitalOcean Seattle6Seattle Metro6Arlington, VA, US5U.S., US5Warsaw, PL5Washington, DC, US5Atlanta, GA, US4Bay Area Metro4Bengaluru, IN4Cambridge, GB4Dublin, IE4Dublin, Leinster, IE4Gloucestershire, GB4Haifa, Haifa, IL4Lappeenranta, FI4London, Greater London, GB4Munich, Bavaria, DE4San Francisco Bay Area, CA, US4All Other Locations3Belgrade, RS3Béthune, Pas-de-Calais, FR3Dallas, TX, US3Hyderabad, IN3Miami, FL, US3River Bend, LA, US3Seoul, Seoul, KR3Taipei, Taiwan, TW3Tel Aviv, Tel Aviv, IL3Tokyo, JP3Tucson, AZ, US3Warszawa, Masovian Voivodeship, PL3Zurich, CH3Abu Dhabi, AE2Alewife, MA, US2Allen, TX, US2Anniston, AL, US2Bangalore Metro2Cambridge, MA, US2Chicago, IL, US2Elk Grove Village, IL, US2Fort Worth, TX, US2Freiburg, Baden-Württemberg, DE2Gdańsk, Pomeranian Voivodeship, PL2Hauts-de-France, FR2Lausanne, Vaud, CH2Munich, DE2New Kensington2Ontario, CA2Phoenix, AZ, US2Pittsburgh Area2Plano, TX, US2Pune or Bangalore, IN2Quincy, WA, US2Reno, NV, US2San Francisco Bay Area (San Mateo) or Boston (Somerville, US2Seoul, KR2Sofia, BG2Sydney, New South Wales, AU2Taipei City, TPE, TW2Tallinn, EE2Tel Aviv, IL2Tokyo Prefecture, JP2Vancouver, British Columbia, CA2Abernathy, TX, US1Abilene, TX, US1Austin Metro1Bangalore, IN1Bangalore India1Bangalore, Karnataka, IN1Barrie1Bastrop, TX, US1Berlin, Berlin, DE1Boston, Mass, US1British Columbia, CA1Central Finland, FI1Chennai, Tamil Nadu, IN1Childress, TX, US1Cyprus1Dalton, GA, US1Dubai, AE1East Palo Alto, CA, US1Elk Grove, DC, US1Elk Grove, IL, US1Ellendale, ND, US1Fort Collins, CO, US1Freiburg, Baden Württemberg, DE1Hsinchu City, TPE, TW1Independence, MO, US1Lisle, IL, US1London, United Kingdom, GB1Madrid, ES1Menlo Park, CA, US1Mountain View, CA, US1Muskogee, DC, US1Muskogee, OK, US1Newark, DC, US1Newport, GB1Nottingham, England, GB1One Charles Park, MA, US1Philadelphia, PA, US1Philippines1Pittsburgh, PA, US1Puyallup, WA, US1Quebec, CA1Québec City, Quebec, CA1Quebec, QC, CA1Reykjanesbær, IS1Reykjanesbæ, Southern Peninsula, IS1Riyadh, Riyadh, SA1Round Rock, DC, US1Round Rock, TX, US1San Carlos, CA, US1San Francisco. CA1San Fransisco, CA, US1Santiago de Querétaro, Bajío, MX1Shakopee, MN, US1South San Francisco, CA, US1St. Louis, MO, US1Vancouver, BC, CA1Vernon, CA, US1Wenatchee1Location not specified2

Workload stage

Inference & serving377Distributed inference208Pre-training128Evaluation infrastructure114Fine-tuning94Reinforcement learning86Post-training84Training data infrastructure51

Infra layer

Cluster & datacenter681Reliability / fleet SRE454ML platform406Network fabric332Scheduling & orchestration308Inference engines291GPU kernels & performance189Training frameworks182Storage & checkpointing120Collectives & communication118

Hardware

GPU (general)621NVIDIA206AWS Trainium/Inferentia105Custom ASIC88AMD39Google TPU30

Role type

Software engineer586Datacenter / hardware engineer365Performance engineer305SRE / production engineer146Engineering manager121Solutions architect / field engineer102Network engineer98Research engineer80

Skills & stack

Python592Kubernetes444Observability343C++280Go275CUDA198InfiniBand operations180vLLM157Terraform / IaC153PyTorch (distributed/internals)149Rust148SLURM130RoCE129Ansible119NCCL118TensorRT / TensorRT-LLM105SGLang102RDMA programming97Quantization88Triton (kernel DSL)84Linux kernel & drivers83Ray75JAX / Pallas61NVLink / NVSwitch58KV-cache systems56RTL / chip design49Parallel filesystems43Parallelism strategies42Speculative decoding40DeepSpeed38XLA / OpenXLA38ROCm / HIP37FSDP36MLIR / LLVM35Kubeflow31Object storage30MPI24Megatron-LM22CUTLASS / CuTe20eBPF / XDP17FlashAttention16Triton Inference Server13DPDK10GPU virtualization / MIG10MoE systems8NVSHMEM7PTX / SASS7AWS EFA6UCX5cuDNN4ONNX Runtime4

Seniority

senior425unknown396staff plus172manager141mid118junior39

Remote policy

onsite438hybrid158remote143

Company type

neocloud469frontier lab251hyperscaler209chip vendor158ai startup103inference provider100enterprise1

Compensationsalary disclosed

1291 roles

Sort by

AI Infrastructure System Engineer Bangalore

Together AIneocloud

Bangalore, India · Remote · unknown

ansible cluster-datacenter go-lang gpu-generic kubernetes-ops

posted 9w ago · verified today

← Previouspage 44 of 44

ainfra.dev

AI Infra Dev — every listing links to the original posting; we never intermediate applications.

Jobs Companies AI infra news Trends Courses Tools X · @ainfradev