Aritra 🤗
@ariG23498 • 7,525 subscribers
MLE at @huggingface
Shorts
The final part of the three part "Profiling in PyTorch" series is out now! In Part 1 we profiled addition and multiplication In Part 2 we profiled a torch Linear layer (and also MLP) In this part we profile Attention. > a naive implementation of attention > talk about the torch sdpa API > math backend > xformers backend > flash backend > cuDNN backend PS: This is a long read, bookmark this and read it over the weekends. 🤗
15,466 Aufrufe