Video wird geladen...
Video konnte nicht geladen werden
He says current models burn capacity memorizing things nobody needs, like SHA hashes, because the training data isn't curated. Strip that out and what he calls the cognitive core could run on a billion parameters. The mechanism is distillation. A very large model, or a huge amount of compute,... show more
90,200 Aufrufe • vor 6 Tagen •via TikTok
0 Kommentare
Keine Kommentare verfügbar
Kommentare vom Original-Post werden hier angezeigt





