AI infrastructure roles, filterable by the stack you actually work on.
Distributed training · inference serving · GPU fleets · network fabric — aggregated straight from company boards, never a copy of a copy.
1538 open roles · 87 companies · last verified 3d ago
219 roles
Inferactinference provider
Remote · remote · $200K–$400K/year · unknown
go-langkubernetes-opspython-langrust-langterraform-iac
posted 9w ago · verified 3d ago
Inferactinference provider
San Francisco · onsite · $200K–$400K/year · unknown
amdgpu-kernelsinferenceperformance-engineerrocm-hip
posted 4mo ago · verified 3d ago
Inferactinference provider
Singapore · onsite · 200K–400K SGD/year · unknown
amdgpu-kernelsinferenceinference-enginesperformance-engineer
posted 4mo ago · verified 3d ago
Inferactinference provider
Singapore · onsite · 200K–400K SGD/year · unknown
software-engineerdistributed-inferenceinference-enginesinfiniband-opsnvlink-topology
posted 4mo ago · verified 3d ago
Inferactinference provider
Singapore · onsite · 200K–400K SGD/year · unknown
cluster-datacentergo-langgpu-genericinferencekubernetes-ops
posted 4mo ago · verified 3d ago
Inferactinference provider
San Francisco · onsite · $200K–$400K/year · unknown
tpuinference-enginesjax-pallasperformance-engineerxla-compiler
posted 4mo ago · verified 3d ago
Inferactinference provider
Remote · remote · unknown
gpu-kernelsinferenceinference-enginesvllm-enginedistributed-inference
posted 9mo ago · verified 3d ago
Inferactinference provider
San Francisco · onsite · $200K–$400K/year · unknown
distributed-inferenceinference-enginesvllm-enginecpp-langgo-lang
posted 9mo ago · verified 3d ago
FriendliAIinference provider
San Francisco · hybrid · senior
cluster-datacentergpu-genericinferencekubernetes-opsml-platform
posted 11w ago · verified 3d ago
FriendliAIinference provider
Seoul · onsite · senior
kubernetes-opssoftware-engineernetwork-fabricscheduling-orchestrationcluster-datacenter
posted 12w ago · verified 3d ago
FriendliAIinference provider
San Francisco · hybrid · mid
amdcpp-langcudagpu-genericgpu-kernels
posted 7mo ago · verified 3d ago
FriendliAIinference provider
San Francisco · hybrid · senior
cpp-langgpu-kernelsinferenceinference-enginespython-lang
posted 7mo ago · verified 3d ago
TensorWaveneocloud
Las Vegas, Nevada · Remote · onsite · senior
gpu-generickubernetes-opsml-platformpython-langscheduling-orchestration
posted 11mo ago · verified 3d ago
Periodic Labsfrontier lab
Menlo Park, CA · onsite · unknown
collectivescudacutlass-cutedistributed-inferencefsdp
posted 6mo ago · verified 3d ago
Thinking Machines Labfrontier lab
San Francisco · onsite · unknown
reinforcement-learningpython-langresearch-engineerinference-enginesdistributed-inference
posted 10w ago · verified 3d ago
Thinking Machines Labfrontier lab
San Francisco · onsite · unknown
inferenceinference-enginesresearch-engineergpu-genericsglang-engine
posted 12w ago · verified 3d ago
Nscaleneocloud
Austin, TX · Houston +3 more · staff plus
ansiblecluster-datacentercollectivescpp-langdeepspeed-lib
posted 8w ago · verified 3d ago
Mistral AIfrontier lab
Palo Alto · hybrid · unknown
ml-platformscheduling-orchestrationkubernetes-opspython-langcuda
posted 8w ago · verified 3d ago
Anthropicfrontier lab
New York City, NY · San Francisco, CA +1 more · $405K–$625K · manager
eng-managerinferencescheduling-orchestrationinference-enginescluster-datacenter
posted 8w ago · verified 3d ago
Amazon (AWS)hyperscaler
Seattle, Washington, USA · onsite · mid
distributed-inferencegpu-kernelsinferenceinference-enginessoftware-engineer
posted 8w ago · verified 3d ago
Baseteninference provider
Montreal · New York +4 more · hybrid · $165K–$330K/year · unknown
inference-enginessglang-enginetensorrt-stackvllm-engineinference
posted 9w ago · verified 3d ago
SambaNovachip vendor
Stockholm, Sweden · staff plus
cpp-langsoftware-engineerinferencelinux-kernelnetwork-fabric
posted 9w ago · verified 3d ago
Amazon (AWS)hyperscaler
Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior
gpu-kernelsinferenceinference-engineskv-cache-systemsperformance-engineer
posted 9w ago · verified 3d ago
Nebiusneocloud
Abu Dhabi, UAE · Middle East +1 more · remote · senior
solutions-architectgpu-generickubernetes-opsml-platforminference
posted 3mo ago · verified 3d ago
OpenAIfrontier lab
San Francisco · hybrid · $266K–$445K/year · unknown
software-engineerinference-enginesinferencekv-cache-systemsscheduling-orchestration
posted 9w ago · verified 3d ago
SambaNovachip vendor
Bengaluru, India · Bengaluru, Karnataka, India · 10300K–12500K INR · staff plus
inference-enginessoftware-engineergo-langinferencekubernetes-ops
posted 10w ago · verified 3d ago
Together AIneocloud
India · Remote · senior
gpu-generickubernetes-opsml-platformscheduling-orchestrationsoftware-engineer
posted 10w ago · verified 3d ago
CoreWeaveneocloud
Bellevue, WA · San Francisco, CA +1 more · $198K–$264K/year est. · staff plus
amdcluster-datacenterdeepspeed-libdistributed-inferencefsdp
posted 10w ago · verified 3d ago
Amazon (AWS)hyperscaler
Seattle, Washington, USA · onsite · manager
eng-managernvidiacluster-datacentercpp-langml-platform
posted 11w ago · verified 3d ago
Amazon (AWS)hyperscaler
Cupertino, California, USA · onsite · unknown
cpp-langdistributed-inferencenetwork-fabricsoftware-engineerkv-cache-systems
posted 4w ago · verified 3d ago