"Models training on each other's data is like a human centipede effect" 💀💀

Sadly quite true. It takes a lot of work to purge LLMs from the Internet training data. Grok 2, which comes out in August, will be a giant improvement in this regard.

Lol. Exactly. Garbage in, garbage out.

Someone once explained it as screenshotting a JPEG. And then screenshotting that screenshot. Then screenshotting that screenshot of a screenshot. So on so forth.

“Humans training on each other’s data is like a model centipede effect” Makes about as much sense

Digital circle jerk...

Sounds awful

I think of a snake eating itself