Thomas Fel's banner
Thomas Fel's profile picture

Thomas Fel

@thomas_fel_ • 3,819 subscribers

Interpretability, Visual Intelligence @GoodfireAI. Prev: @Harvard, @Google, @BrownUniversity (@tserre lab). Crêpe lover.

Shorts

A science of post-training can be built on interpretability. Models know when they reward hack, and we see it, yet training ignores it. We propose Mechanistic Shaping: using the model’s own concepts to write training rules. In vision, DPO & RL, and its effects on monitoring 🧵

A science of post-training can be built on interpretability. Models know when they reward hack, and we see it, yet training ignores it. We propose Mechanistic Shaping: using the model’s own concepts to write training rules. In vision, DPO & RL, and its effects on monitoring 🧵

66,478 просмотров

Videos

Больше нет контента для загрузки