AI infrastructure roles, filterable by the stack you actually work on.

Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.

1538 open roles · 87 companies · last verified 3d ago

Location

Remote191United States1199United Kingdom120Canada93France44Netherlands44Singapore42Germany30India30Israel23Poland18Ireland13Norway12Australia11Switzerland11Czechia9Finland9South Korea9Sweden9Taiwan8Bulgaria7Japan7Serbia7Spain6Austria2United Arab Emirates1Estonia1Hungary1Iceland1Portugal1Romania1Saudi Arabia1Türkiye1CA, US819WA, US355NY, US241TX, US233England, GB41Ontario, CA41DC, US37TN, US36NJ, US34MS, US30Europe27Ile-de-France, FR26CO, US24NV, US19MA, US18Quebec, CA16Karnataka, IN15VA, US14London, GB12APAC11AZ, US11ON, CA11Québec, CA11Tel Aviv, IL11New South Wales, AU9Singapore, SG9North Holland, NL8Bavaria, DE7IN, US7Americas6British Columbia, CA6GA, US6IL, US6LA, US6EMEA5Greater London, GB5Leinster, IE5Haifa, IL4MO, US4OK, US4Taiwan, TW4AL, US3Baden-Württemberg, DE3FL, US3MN, US3NC, US3Pas-de-Calais, FR3PA, US3Seoul, KR3TPE, TW3Masovian Voivodeship, PL2OH, US2OR, US2Baden Württemberg, DE1BC, CA1Berlin, DE1Bucharest, RO1Dalarna, SE1EMEA, GB1Finland, FI1Mass, US1MI, US1ND, US1Poland, PL1Pomeranian Voivodeship, PL1QC, CA1Riyadh, SA1Southern Peninsula, IS1UK, SG1Vaud, CH1West Coast, US1Worldwide1San Francisco, CA, US420Seattle, WA, US252New York, NY, US241Austin, TX, US163Cupertino, CA, US126Sunnyvale, CA, US121San Jose, CA, US81Palo Alto, CA, US74Bellevue, WA, US70London, England, GB41Toronto, Ontario, CA41London, GB37Memphis, TN, US35Washington, DC, US35Redmond, WA, US34Hawthorne, CA, US32Manhattan, NY, US32Amsterdam, NL31Livingston, NJ, US30Southaven, MS, US30San Mateo, CA, US27Paris, Ile-de-France, FR26Denver, CO, US23Houston, TX, US23Las Vegas, NV, US18Berlin, DE17Fort Worth, TX, US16Santa Clara, CA, US16Bengaluru, Karnataka, IN15Montreal, Quebec, CA15Toronto, CA15Arlington, VA, US12Boston, MA, US12London, London, GB12Mountain View, CA, US12Montreal, Québec, CA11Paris, FR11Toronto, ON, CA11Tel Aviv-Yafo, Tel Aviv, IL10Zurich, CH10Childress, TX, US9DigitalOcean Seattle9Herndon, VA, US9Sydney, New South Wales, AU9Warsaw, PL9Amsterdam, North Holland, NL8Prague, CZ8Belgrade, RS7Munich, Bavaria, DE7Stockholm, SE7U.S., US7EU6New Lebanon, IN, US6Phoenix, AZ, US6River Bend, LA, US6Dallas, TX, US5Dublin, IE5Dublin, Leinster, IE5Hyderabad, IN5London, Greater London, GB5San Diego, CA, US5Seattle Metro5Tokyo, JP5Atlanta, GA, US4Bastrop, TX, US4East Palo Alto, CA, US4Haifa, Haifa, IL4Madrid, ES4Redwood City, CA, US4Taipei, Taiwan, TW4Abernathy, TX, US3Bengaluru, IN3Béthune, Pas-de-Calais, FR3Cambridge, GB3Freiburg, Baden-Württemberg, DE3Gloucestershire, GB3Lappeenranta, FI3Miami, FL, US3Plano, TX, US3Seoul, KR3Seoul, Seoul, KR3Sofia, BG3Sweetwater, TX, US3Taipei City, TPE, TW3Tucson, AZ, US3Vancouver, British Columbia, CA3Abilene, TX, US2Alewife, MA, US2Asia2Bay Area Metro2Bessé-sur-Braye, FR2Cambridge, MA, US2Greater Seattle Area, US2Independence, MO, US2Linz, AT2Lisle, IL, US2Los Angeles, CA, US2Mackenzie, British Columbia, CA2Malaysai2Munich, DE2New Kensington2Philadelphia, PA, US2Pittsburgh Area2Pune or Bangalore, IN2Quincy, WA, US2San Francisco Bay Area, CA, US2San Francisco Bay Area (San Mateo) or Boston (Somerville, US2Tel Aviv, IL2Tempe, AZ, US2Warszawa, Masovian Voivodeship, PL25215 N. O'Connor Blvd, TX, US1A1Abu Dhabi, AE1Allen, TX, US1All Other Locations1Anniston, AL, US1Austin Metro1Bangalore, IN1Bangalore Metro1Barber Lake, TX, US1Berlin, Berlin, DE1Birmingham, AL, US1Borlange, Dalarna, SE1Boston, Mass, US1British Columbia, CA1Bucharest, Bucharest, RO1Caledonia, MI, US1Campbell, CA, US1Central Finland, FI1Chicago, IL, US1Cincinnati, OH, US1Colossus, TN, US1Columbus, OH, US1Culver City, CA, US1Cyprus1Dalton, GA, US1Douglasville, GA, US1Elk Grove, DC, US1Elk Grove, IL, US1Elk Grove Village, IL, US1Ellendale, ND, US1Fort Collins, CO, US1Freiburg, Baden Württemberg, DE1Gdańsk, Pomeranian Voivodeship, PL1Greensboro, NC, US1Hammond, IN, US1Harlingen1Hauts-de-France, FR1Hillsboro, OR, US1Hsinchu City, TPE, TW1INT1Kansas City, MO, US1Kuala Lumpur1Lausanne, Vaud, CH1Lubbock, TX, US1Macrohard, TN, US1Mäntsälä, FI1Marble, NC, US1Menlo Park, CA, US1Muskogee, DC, US1Muskogee, OK, US1Newport, GB1One Charles Park, MA, US1Ontario, CA1PERM1Philippines1Pittsburgh, PA, US1Portland, OR, US1Prince George, British Columbia, CA1Puyallup, WA, US1Quebec, CA1Québec City, Quebec, CA1Quebec, QC, CA1Raleigh, NC, US1Reno, NV, US1Reykjanesbæ, Southern Peninsula, IS1Richmond1Riyadh, Riyadh, SA1Round Rock, DC, US1Round Rock, TX, US1San Carlos, CA, US1Sandusky, DC, US1Sandusky, OH, US1San Francisco. CA1San Fransisco, CA, US1South San Francisco, CA, US1St. Louis, MO, US1Sydney Australia, AU1Tallinn, EE1Tel Aviv, Tel Aviv, IL1Tokyo Prefecture, JP1Vancouver, BC, CA1Volo, IL, US1Warren, OH, US1Warsaw, Poland, PL1Washington D.C, US1Westborough, MA, US1Location not specified2

Workload stage

Inference & serving412Distributed inference219Pre-training136Evaluation infrastructure114Fine-tuning105Reinforcement learning86Post-training81Training data infrastructure46

Infra layer

Cluster & datacenter870Reliability / fleet SRE532ML platform421Network fabric409Scheduling & orchestration342Inference engines301GPU kernels & performance213Training frameworks184Storage & checkpointing147Collectives & communication127

Hardware

GPU (general)690NVIDIA255AWS Trainium/Inferentia147Custom ASIC85Google TPU39AMD35

Role type

Software engineer659Datacenter / hardware engineer477Performance engineer349SRE / production engineer193Engineering manager151Network engineer140Solutions architect / field engineer115Research engineer98

Skills & stack

Python713Kubernetes488C++352Observability347Go309CUDA239InfiniBand operations220vLLM190PyTorch (distributed/internals)176RoCE172Terraform / IaC162Rust155Ansible138SLURM135NCCL133SGLang130TensorRT / TensorRT-LLM130Triton (kernel DSL)108RDMA programming102Linux kernel & drivers101Quantization95Ray80NVLink / NVSwitch79KV-cache systems75JAX / Pallas69RTL / chip design62Parallel filesystems60Speculative decoding55Parallelism strategies47MLIR / LLVM44XLA / OpenXLA41DeepSpeed40FSDP39Object storage34ROCm / HIP33Megatron-LM29CUTLASS / CuTe27eBPF / XDP26MPI26Kubeflow22FlashAttention18MoE systems17Triton Inference Server14AWS EFA9DPDK9GPU virtualization / MIG9PTX / SASS8NVSHMEM7UCX7ONNX Runtime3cuDNN2

Seniority

senior521unknown478manager185staff plus174mid122junior58

Remote policy

onsite559hybrid184remote142

Company type

neocloud562frontier lab294hyperscaler241chip vendor170inference provider110ai startup108enterprise53

Compensationsalary disclosed

301 roles

Sort by

inference-engines ✕

Forward Deployed Engineer (Inference & Post-Training) - Mandarin Speaking

Together AIneocloud

Remote · Singapore · unknown

fine-tuning inference inference-engines kv-cache-systems post-training

posted 12w ago · verified 3d ago

← Previouspage 11 of 11

ainfra.dev

AI Infra Dev — every listing links to the original posting; we never intermediate applications.

Jobs Companies Trends Tools X · @ainfradev