
mohit
@mohitwt_ • 7,686 subscribers
20 || mts @emulated_ai || reinforcement learning & llm inference
Videos

Part 1: CUDA Graphs - Intro & Basics - how normal CPU ←→ GPU execution works - what a kernel launch is and where CPU launch overhead comes from - why launching many small kernels individually can become a bottleneck - what CUDA Graphs are and how they reduce CPU launch overhead - common benefits of using CUDA Graphs - the two ways to create CUDA Graphs: a. Explicit Graph Construction b. Stream Capture - where these graph creation methods are used - the CUDA Graph lifecycle: capture → instantiate/prepare → replay this is the first ever content that ive recorded and taught, its genuinely so much harder to record than i thought lmao, feedback's are appreciated and hopefully it just gets better from here youtube link shared below
mohit29,135 görüntüleme • 2 ay önce
Daha fazla içerik yok.