Loading video...
Video Failed to Load
What the hell does Quant actually do? A model is trained in BF16, released in Q8, and we use Q4 because we're told 'its nearly lossless'. Fine, but I was curious about the 'nearly' part, what is actually being lost between BF16 all the way down to Q2? As... show more
19,273 views • 4 days ago •via X (Twitter)
0 Comments
No comments available
Comments from the original post will appear here
