AI infrastructure roles, filterable by the stack you actually work on.

Generalistai startup

San Francisco Bay Area (San Mateo) or Boston (Somerville) · onsite · $260K–$350K/year · unknown

cudagpu-kernelspython-langgpu-genericnvlink-topology

posted 8mo ago · verified 3d ago

Lightning AIai startup

New York, New York · New York, New York, United States +5 more · remote · $170K–$210K · senior

infiniband-opsnetwork-engineernetwork-fabricnvidiaansible

posted 3mo ago · verified 3d ago

Lightning AIai startup

New York, New York, United States · San Francisco, California +3 more · $115K–$140K · unknown

cudagpu-generickubernetes-opsnccl-libobservability

posted 5mo ago · verified 3d ago

Etchedchip vendor

San Jose · onsite · junior

collectivescpp-langinference-enginespython-langdistributed-inference

posted 10mo ago · verified 3d ago

Etchedchip vendor

San Jose · onsite · $175K–$400K/year · unknown

cpp-langinferencesoftware-engineercollectivesdistributed-inference

posted 16mo ago · verified 3d ago

Reflection AIfrontier lab

London · New York, NY +1 more · onsite · unknown

pre-trainingsoftware-engineerdeepspeed-libgpu-genericmodel-parallelism

posted 7mo ago · verified 3d ago

Reflection AIfrontier lab

London · New York, NY +1 more · onsite · unknown

cluster-datacentergpu-generickubernetes-opsscheduling-orchestrationsoftware-engineer

posted 7mo ago · verified 3d ago

Inferactinference provider

San Francisco · onsite · $200K–$400K/year · unknown

amdgpu-kernelsinferenceperformance-engineerrocm-hip

posted 4mo ago · verified 3d ago

Inferactinference provider

Singapore · onsite · 200K–400K SGD/year · unknown

amdgpu-kernelsinferenceinference-enginesperformance-engineer

posted 4mo ago · verified 3d ago

FriendliAIinference provider

San Francisco · hybrid · mid

amdcpp-langcudagpu-genericgpu-kernels

posted 7mo ago · verified 3d ago

Prime Intellectneocloud

Remote · San Francisco · unknown

collectivesdeepspeed-libfsdpgpu-genericgpu-kernels

posted 3mo ago · verified 3d ago

TensorWaveneocloud

Las Vegas, Nevada · onsite · mid

kubernetes-opsreliability-sreamdpython-langscheduling-orchestration

posted 9w ago · verified 3d ago

Liquid AIfrontier lab

San Francisco · hybrid · unknown

deepspeed-libfsdppytorch-distsoftware-engineertraining-frameworks

posted 15mo ago · verified 3d ago

Periodic Labsfrontier lab

Menlo Park, CA · onsite · unknown

collectivescudacutlass-cutedistributed-inferencefsdp

posted 6mo ago · verified 3d ago

Thinking Machines Labfrontier lab

San Francisco · onsite · unknown

research-engineergpu-generictraining-frameworkspytorch-distdeepspeed-lib

posted 12w ago · verified 3d ago

Thinking Machines Labfrontier lab

San Francisco · onsite · unknown

gpu-kernelsmodel-parallelismquantizationresearch-engineercollectives

posted 12w ago · verified 3d ago

Thinking Machines Labfrontier lab

San Francisco · onsite · unknown

gpu-genericnetwork-engineernetwork-fabriccollectives

posted 4mo ago · verified 3d ago

Thinking Machines Labfrontier lab

New York · San Francisco · onsite · unknown

srepost-traininggpu-genericobservabilityreinforcement-learning

posted 8w ago · verified 3d ago

Nscaleneocloud

Austin, TX · Houston +3 more · staff plus

ansiblecluster-datacentercollectivescpp-langdeepspeed-lib

posted 8w ago · verified 3d ago

Nscaleneocloud

Singapore · senior

infiniband-opsnetwork-fabricnvidiareliability-sreslurm-admin

posted 4mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · senior

gpu-kernelstrainiumperformance-engineersoftware-engineerinference-engines

posted 8w ago · verified 3d ago

SambaNovachip vendor

Stockholm, Sweden · staff plus

cpp-langsoftware-engineerinferencelinux-kernelnetwork-fabric

posted 9w ago · verified 3d ago

Amazon (AWS)hyperscaler

Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior

gpu-kernelsinferenceinference-engineskv-cache-systemsperformance-engineer

posted 9w ago · verified 3d ago

OpenAIfrontier lab

San Francisco · hybrid · $266K–$445K/year · unknown

software-engineerinference-enginesinferencekv-cache-systemsscheduling-orchestration

posted 9w ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · unknown

cpp-langdistributed-inferencenetwork-fabricsoftware-engineerkv-cache-systems

posted 4w ago · verified 3d ago

Amazon (AWS)hyperscaler

Austin, Texas, USA · Cupertino, California, USA · onsite · mid

cpp-langsoftware-engineercollectivespython-langrust-lang

posted 7mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · Seattle, Washington, USA · onsite · senior

cpp-langnetwork-fabricsoftware-engineercollectivesdistributed-inference

posted 3mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · Seattle, Washington, USA · onsite · senior

cpp-langnccl-libnetwork-fabricnvidiacollectives

posted 3mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Toronto, Ontario, CAN · onsite · manager

eng-managergpu-kernelstrainiumperformance-engineercollectives

posted 11w ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · senior

trainiumfsdppytorch-distsoftware-engineertraining-frameworks

posted 13mo ago · verified 3d ago