Day 9/90 of Inference Engineering
12.746 görüntüleme
Day 9/90 of Inference Engineering
I built a visualization tool for CUDA kernels and C code to view the buffers for each step through.
Check out
Yesterday, I was terramogged by a simple implementation of a basic matmul between three matrices in 1D vector form. There were essentially three 1D vectors, each vector representing a corresponding matrix (A, B, C).
In the implementation, each matrix is just just a pointer to the first element of a 1D array. You are to compute the output matrix through A^T @ B and store it in C.
This morning I built a visualizer to help me see and understand why the triple for-loops work the way they do. In the coming days, I’m confident I can make sense as well as backpropagation!
As for it does not include a built-in compiler. It's just an interpreter; the visualization shows exactly what the code does, bugs included. The main thing I wanted to visualize is matmul with a triple for-loop between a sequential program to that of a parallel one.
Expect bugs and other inconsistencies within I’ll polish this mini-project in the coming days. As for the rest of today, I’ll be trying to understand backpropagation in C and CUDA .
Yorumlar
Yorumlar X (Twitter) üzerindeki orijinal gönderiden alınmıştır
Henüz yorum yok
