正在加载视频...
视频加载失败
What the hell does Quant actually do? A model is trained in BF16, released in Q8, and we use Q4 because we're told 'its nearly lossless'. Fine, but I was curious about the 'nearly' part, what is actually being lost between BF16 all the way down to Q2? As... show more
19,273 次观看 • 4 天前 •via X (Twitter)
0 条评论
暂无评论
原始帖子的评论将显示在这里
