Deep dive on LLM Inference at Scale — Harshul Jain, Audible & Tanmay Sah, Independent AI Researcher

Watch on YouTube

Technical talk by Harshul Jain (Audible) and Tanmay Sah covering a deep dive on LLM inference at scale, discussing engineering challenges and approaches for serving large language models.

Source: AI Engineer — AI Engineer.