AI infrastructure roles, filterable by the stack you actually work on.

Prime Intellectneocloud

Remote · San Francisco · remote · unknown

kubernetes-opsml-platformfine-tuningpython-langscheduling-orchestration

posted 3mo ago · verified 3d ago

Prime Intellectneocloud

Remote · San Francisco · unknown

collectivesdeepspeed-libfsdpgpu-genericgpu-kernels

posted 3mo ago · verified 3d ago

Periodic Labsfrontier lab

Menlo Park, CA · onsite · unknown

collectivescudacutlass-cutedistributed-inferencefsdp

posted 6mo ago · verified 3d ago

Thinking Machines Labfrontier lab

San Francisco · onsite · unknown

reinforcement-learningpython-langresearch-engineerinference-enginesdistributed-inference

posted 10w ago · verified 3d ago

Thinking Machines Labfrontier lab

San Francisco · onsite · unknown

inferenceinference-enginesresearch-engineergpu-genericsglang-engine

posted 12w ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · mid

distributed-inferencegpu-kernelsinferenceinference-enginessoftware-engineer

posted 8w ago · verified 3d ago

Baseteninference provider

Montreal · New York +4 more · hybrid · $165K–$330K/year · unknown

inference-enginessglang-enginetensorrt-stackvllm-engineinference

posted 9w ago · verified 3d ago

Amazon (AWS)hyperscaler

Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior

gpu-kernelsinferenceinference-engineskv-cache-systemsperformance-engineer

posted 9w ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $210K–$280K · staff plus

inferenceinference-engineskubernetes-opsobservabilityreliability-sre

posted 11mo ago · verified 3d ago

Nebiusneocloud

Remote - United States · United States · remote · $228K–$285K · manager

eng-managerfine-tuninginferenceinference-engineskubernetes-ops

posted 10w ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $200K–$400K/year · mid

inferencesolutions-architectevaluationinference-enginespost-training

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · senior

trainiumdistributed-inferenceinferencesoftware-engineercpp-lang

posted 12w ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · senior

software-engineertrainiuminference-enginesvllm-enginedistributed-inference

posted 3mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Seattle, Washington, USA · onsite · mid

software-engineerml-platformpost-trainingreinforcement-learningtraining-frameworks

posted 4mo ago · verified 3d ago

Amazon (AWS)hyperscaler

Cupertino, California, USA · onsite · senior

gpu-kernelsvllm-enginemodel-parallelismdistributed-inferenceml-platform

posted 12w ago · verified 3d ago

Amazon (AWS)hyperscaler

Tel Aviv-Yafo, Tel Aviv, ISR · onsite · mid

cpp-langsoftware-engineercustom-asicdistributed-inferencegpu-kernels

posted 12w ago · verified 3d ago

Amazon (AWS)hyperscaler

Boston, Massachusetts, USA · Seattle, Washington, USA +1 more · onsite · senior

cudacutlass-cutedistributed-inferenceevaluationflash-attention

posted 10w ago · verified 3d ago

Amazon (AWS)hyperscaler

Herndon, Virginia, USA · New York, New York, USA +1 more · onsite · senior

solutions-architectgpu-genericinference-enginesmodel-parallelismtraining-frameworks

posted 4mo ago · verified 3d ago

CoreWeaveneocloud

Austin, TX · US - Remote - Texas · $182K–$242K/year est. · unknown

python-langsolutions-architectgpu-genericinfiniband-opskubernetes-ops

posted 10w ago · verified 3d ago

Perplexityai startup

New York City · Remote (United States) +3 more · $250K–$485K/year · unknown

kubernetes-opssoftware-engineerml-platformnvidiascheduling-orchestration

posted 4d ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · hybrid · staff plus

inferenceinference-engineskv-cache-systemsperformance-engineerrocm-hip

posted 10d ago · verified 3d ago

Cerebraschip vendor

Sunnyvale, CA · Toronto, CAN · onsite · senior

amdcpp-langinferenceinference-enginespython-lang

posted 11mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

inferenceinference-enginessoftware-engineergpu-genericperformance-engineer

posted 6mo ago · verified 3d ago

Baseteninference provider

Montreal · New York +3 more · hybrid · $165K–$330K/year · unknown

collectivescpp-langdistributed-inferenceinferenceinfiniband-ops

posted 8mo ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $165K–$330K/year · unknown

inferenceinference-enginessglang-enginesolutions-architecttensorrt-stack

posted 8mo ago · verified 3d ago

Baseteninference provider

New York · San Francisco · hybrid · $165K–$330K/year · senior

fine-tuningml-platformpost-trainingsoftware-engineerkubernetes-ops

posted 9mo ago · verified 3d ago

SambaNovachip vendor

Austin, Texas, United States · Austin, TX +2 more · $200K–$275K · senior

inferenceinference-enginespython-langvllm-enginesoftware-engineer

posted 4mo ago · verified 3d ago

SambaNovachip vendor

San Jose, CA · San Jose, California, United States · $180K–$255K · senior

inferenceperformance-engineercpp-langdistributed-inferenceinference-engines

posted 11mo ago · verified 3d ago

SambaNovachip vendor

Bengaluru, India · Bengaluru, Karnataka, India · 3324K–4062K INR · unknown

python-langsolutions-architectinferencefine-tuningkubernetes-ops

posted 3mo ago · verified 3d ago

SambaNovachip vendor

Bengaluru, India · Bengaluru, Karnataka, India · 8900K–10800K INR · staff plus

ansiblego-langinferenceinference-engineskubernetes-ops

posted 4mo ago · verified 3d ago