Maya Bechler-Speicher
@mayabechlerspei • 2,059 subscribers
AI Research Scientist@Meta, CS PhD@TAU, Lecturer of "Machine Learning with Graphs"@ CS-TAU, Mathematician.
Videos
🤔 Why do we still rely on the final layer of an LLM, when different layers encode different information? 🤔 In our new work, “Improving LLM Final Representations with Inter-Layer Geometry” (ICLR 2026 Workshop on Geometry-grounded Representation Learning and Generative Modeling) we show that actually, LLMs do not have one “best” layer. We introduce the Cayley-Encoder: an efficient and effective geometric encoder that learns one strong representation from all layer representations of the LLM, without biasing the representation toward any specific layer. While adding at most 0.1% learned parameters to the LLM, the Cayley-Encoder achieves large empirical gains over LoRA fine-tuning, final-layer representations, expensive attention-based aggregation, and methods that optimize specific layers for the task.
Maya Bechler-Speicher16,351 görüntüleme • 16 gün önce
Another year of 'Machine Learning with Graphs' at the School of Computer Science and AI at Tel Aviv University has come to an end, and here’s a short summary video of me explaining Graph Neural Networks with my hands 👐 This year I had around 80 students from across Computer Science, Math, and Electrical Engineering who came to explore the magic of Graph Learning. We wrapped up with nearly 30 final research projects, and it was truly inspiring to see students come up with novel, creative ideas, combining graph methods in diverse domains and leveraging their own unique expertise. It’s always fascinating to see how graph modeling can enhance performance or solve challenges in almost every field. While some ideas didn’t fully work out (as research often goes!), many did, and I genuinely hope to see some of them published soon. Well done to all the students!!! Once again, I have to say that TAU students are simply brilliant, curious, and incredibly hard-working. Next year, I’ll continue lecturing as a Teaching Fellow at CS@TAU and I’m already excited about the many updates I plan for the course (Graph Foundation Models are coming 👀).
Maya Bechler-Speicher75,948 görüntüleme • 7 ay önce
Daha fazla içerik yok.