Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Understanding LLMs by Building One 👉 We use large language models every day, but what actually happens inside them?

Danilo Poccia

30,062 subscribers

14,353 views • 4 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Today we introduce T-Free, a new paradigm in language processing. Tokenization is one of the core building blocks of large language models (LLMs), transforming natural language into numeric representations for further processing. (1/3) 🔗 #writtenbyalephalpha

Today we introduce T-Free, a new paradigm in language processing. Tokenization is one of the core building blocks of large language models (LLMs), transforming natural language into numeric representations for further processing. (1/3) 🔗 #writtenbyalephalpha

Aleph Alpha

18,121 views • 1 year ago

New Anthropic research: Tracing the thoughts of a large language model. We built a "microscope" to inspect what happens inside AI models and use it to understand Claude’s (often complex and surprising) internal mechanisms.

New Anthropic research: Tracing the thoughts of a large language model. We built a "microscope" to inspect what happens inside AI models and use it to understand Claude’s (often complex and surprising) internal mechanisms.

Anthropic

1,573,086 views • 1 year ago

Yann LeCun argues that large language models (LLMs) cannot reach human-level or superintelligence just by scaling. He says the current LLM paradigm is hitting its limits. Many researchers are now exploring “agentic systems,” but building them on top of LLMs alone is flawed. LLMs can't plan actions well because they don’t truly understand or predict consequences. To get intelligent behavior, we need something fundamentally different.

Yann LeCun argues that large language models (LLMs) cannot reach human-level or superintelligence just by scaling. He says the current LLM paradigm is hitting its limits. Many researchers are now exploring “agentic systems,” but building them on top of LLMs alone is flawed. LLMs can't plan actions well because they don’t truly understand or predict consequences. To get intelligent behavior, we need something fundamentally different.

Wes Roth

71,832 views • 6 months ago

.Trenton Bricken explains how we know LLMs are actually generalizing - aka they're not just stochastic parrots: - Training models on code makes them better at reasoning in language. - Models fine tuned on math problems become better at entity detection. - We can just straightforwardly read the world-models developed by smaller NNs which are easier to interpret (Othello). Transfer learning shows models are developing a deeper understanding of their data. Full episode out Thursday.

.Trenton Bricken explains how we know LLMs are actually generalizing - aka they're not just stochastic parrots: - Training models on code makes them better at reasoning in language. - Models fine tuned on math problems become better at entity detection. - We can just straightforwardly read the world-models developed by smaller NNs which are easier to interpret (Othello). Transfer learning shows models are developing a deeper understanding of their data. Full episode out Thursday.

Dwarkesh Patel

237,812 views • 2 years ago

This is how large language models turn objects to vector representations. In this video, we explore how large language models (LLMs) convert objects into internal representations, especially when translating between languages like English and Hindi. Using real-world examples, we highlight the challenges of gender inference, grammatical structure, and why direct word-to-word translations often fail. If you're curious about how LLMs deal with multilingual contexts and what it takes to improve translation quality across languages, this video is for you. #LLMs #Vectors #LCM

This is how large language models turn objects to vector representations. In this video, we explore how large language models (LLMs) convert objects into internal representations, especially when translating between languages like English and Hindi. Using real-world examples, we highlight the challenges of gender inference, grammatical structure, and why direct word-to-word translations often fail. If you're curious about how LLMs deal with multilingual contexts and what it takes to improve translation quality across languages, this video is for you. #LLMs #Vectors #LCM

Gaurav Sen

27,368 views • 1 year ago

The lack of understanding of how current AI/ large language models work makes us susceptible to thinking that AI is more powerful and all-knowing than it actually is. That’s what concerns me the most.

The lack of understanding of how current AI/ large language models work makes us susceptible to thinking that AI is more powerful and all-knowing than it actually is. That’s what concerns me the most.

Sinead Bovell

143,642 views • 3 years ago

Eat Oats Every Day and watch What happens inside your stomach.

Eat Oats Every Day and watch What happens inside your stomach.

Fitness Doctor 🩺

183,667 views • 6 months ago

Most drivers use their car every day… but never learn what it can actually do 🚗🧠

Most drivers use their car every day… but never learn what it can actually do 🚗🧠

Ahib Jane

59,623 views • 6 months ago

When You Eat Oats Every Day! watch What happens inside your stomach

When You Eat Oats Every Day! watch What happens inside your stomach

Fit_Fusion

10,281,231 views • 7 months ago

Large Language Models (LLMs), the engines behind the likes of Chat GPT, are capable (and incapable) of many things. But are they useful for mathematicians? Jordan Ellenberg has been working on LLMs with Google DeepMind. Here are his thoughts. Full lecture:

Large Language Models (LLMs), the engines behind the likes of Chat GPT, are capable (and incapable) of many things. But are they useful for mathematicians? Jordan Ellenberg has been working on LLMs with Google DeepMind. Here are his thoughts. Full lecture:

Oxford Mathematics

31,598 views • 2 years ago

$AI agents are about to redefine the internet. The mistake we made with Large Language Models? We let a handful of corporations capture all the value. Action Model is building a different path. By training through our extension, users gain fractional ownership in the Large Action Model, giving them a real stake in the future of AI. When LLMs emerged, the upside flowed to Big Tech. This time, it doesn’t have to. They’re building AI on our data, and keeping the upside for themselves. Community-owned Large Action Model is how we take it back.$

AI agents are about to redefine the internet. The mistake we made with Large Language Models? We let a handful of corporations capture all the value. Action Model is building a different path. By training through our extension, users gain fractional ownership in the Large Action Model, giving them a real stake in the future of AI. When LLMs emerged, the upside flowed to Big Tech. This time, it doesn’t have to. They’re building AI on our data, and keeping the upside for themselves. Community-owned Large Action Model is how we take it back.

Action Model

77,260 views • 5 months ago

“In my own company here, we have more than 100 use cases already in production using large language models or agentic AI models,” HP CEO Antonio Neri says.

“In my own company here, we have more than 100 use cases already in production using large language models or agentic AI models,” HP CEO Antonio Neri says.

Yahoo Finance

28,319 views • 8 months ago

I joined Anthropic last week! It’s obvious to me that we’re bottlenecked not by model capabilities, but by creativity and understanding. I’ll be building demos and prototypes that highlight new capabilities and share what we learn about building using these models at Anthropic. Excited to build with the best team and the best models.

I joined Anthropic last week! It’s obvious to me that we’re bottlenecked not by model capabilities, but by creativity and understanding. I’ll be building demos and prototypes that highlight new capabilities and share what we learn about building using these models at Anthropic. Excited to build with the best team and the best models.

Thariq

165,430 views • 1 year ago

Deep learning. Large language models. Vast capabilities. ☁️💻💡 From chatbots to code generation, learn how #GenerativeAI is redefining #ML-powered capabilities—& how you can build & use large language on #AWS. #MachineLearning #AI 👉

Deep learning. Large language models. Vast capabilities. ☁️💻💡 From chatbots to code generation, learn how #GenerativeAI is redefining #ML-powered capabilities—& how you can build & use large language on #AWS. #MachineLearning #AI 👉

Amazon Web Services

113,319 views • 3 years ago

3D-LLM: Injecting the 3D World into Large Language Models paper page: Large language models (LLMs) and Vision-Language Models (VLMs) have been proven to excel at multiple tasks, such as commonsense reasoning. Powerful as these models can be, they are not grounded in the 3D physical world, which involves richer concepts such as spatial relationships, affordances, physics, layout, and so on. In this work, we propose to inject the 3D world into large language models and introduce a whole new family of 3D-LLMs. Specifically, 3D-LLMs can take 3D point clouds and their features as input and perform a diverse set of 3D-related tasks, including captioning, dense captioning, 3D question answering, task decomposition, 3D grounding, 3D-assisted dialog, navigation, and so on. Using three types of prompting mechanisms that we design, we are able to collect over 300k 3D-language data covering these tasks. To efficiently train 3D-LLMs, we first utilize a 3D feature extractor that obtains 3D features from rendered multi- view images. Then, we use 2D VLMs as our backbones to train our 3D-LLMs. By introducing a 3D localization mechanism, 3D-LLMs can better capture 3D spatial information. Experiments on ScanQA show that our model outperforms state-of-the-art baselines by a large margin (e.g., the BLEU-1 score surpasses state-of-the-art score by 9%). Furthermore, experiments on our held-in datasets for 3D captioning, task composition, and 3D-assisted dialogue show that our model outperforms 2D VLMs. Qualitative examples also show that our model could perform more tasks beyond the scope of existing LLMs and VLMs.

3D-LLM: Injecting the 3D World into Large Language Models paper page: Large language models (LLMs) and Vision-Language Models (VLMs) have been proven to excel at multiple tasks, such as commonsense reasoning. Powerful as these models can be, they are not grounded in the 3D physical world, which involves richer concepts such as spatial relationships, affordances, physics, layout, and so on. In this work, we propose to inject the 3D world into large language models and introduce a whole new family of 3D-LLMs. Specifically, 3D-LLMs can take 3D point clouds and their features as input and perform a diverse set of 3D-related tasks, including captioning, dense captioning, 3D question answering, task decomposition, 3D grounding, 3D-assisted dialog, navigation, and so on. Using three types of prompting mechanisms that we design, we are able to collect over 300k 3D-language data covering these tasks. To efficiently train 3D-LLMs, we first utilize a 3D feature extractor that obtains 3D features from rendered multi- view images. Then, we use 2D VLMs as our backbones to train our 3D-LLMs. By introducing a 3D localization mechanism, 3D-LLMs can better capture 3D spatial information. Experiments on ScanQA show that our model outperforms state-of-the-art baselines by a large margin (e.g., the BLEU-1 score surpasses state-of-the-art score by 9%). Furthermore, experiments on our held-in datasets for 3D captioning, task composition, and 3D-assisted dialogue show that our model outperforms 2D VLMs. Qualitative examples also show that our model could perform more tasks beyond the scope of existing LLMs and VLMs.

AK

249,798 views • 3 years ago

Yann LeCun says we're fooled by LLMs because they manipulate language well, and we associate that with intelligence But language fluency doesn't mean underlying intelligence Every generation since the 1950s claimed its technique was the ticket to human-level AI All were wrong. "this generation with LLMs is also wrong"

Yann LeCun says we're fooled by LLMs because they manipulate language well, and we associate that with intelligence But language fluency doesn't mean underlying intelligence Every generation since the 1950s claimed its technique was the ticket to human-level AI All were wrong. "this generation with LLMs is also wrong"

Haider.

625,694 views • 8 months ago

Hello World, we’re We eval frontier models by putting them in simulations. So what happens when 6 frontier models compete in #Minecraft for GPUs? Video and 🧵

Hello World, we’re We eval frontier models by putting them in simulations. So what happens when 6 frontier models compete in #Minecraft for GPUs? Video and 🧵

Kradle

94,776 views • 11 months ago

Demis Hassabis says large language models (LLMs) can search and plan but they forget everything once the session ends. This is because today’s models don’t truly “learn” after deployment. He sees continual learning and better memory as key missing ingredients for AGI. Efficient memory, like the brain’s ability to store only what matters, will be crucial. LLMs are powerful, but without memory, they have a "goldfish brain."

Demis Hassabis says large language models (LLMs) can search and plan but they forget everything once the session ends. This is because today’s models don’t truly “learn” after deployment. He sees continual learning and better memory as key missing ingredients for AGI. Efficient memory, like the brain’s ability to store only what matters, will be crucial. LLMs are powerful, but without memory, they have a "goldfish brain."

Wes Roth

38,833 views • 6 months ago

What what happens If you eat one garlic every day for 30 days

What what happens If you eat one garlic every day for 30 days

Men Optimized Health

607,164 views • 3 months ago

Dr. Karp on what's behind Palantir's dominance in AI 👇🏻 "we were years ahead for lots of reasons, anticipating what operational AI would mean, meaning AI where you make more money or your revenue goes up and your costs go down. Our platforms are built to use large language models and machine learning in a way in that is actually operationally effective... [we] built this thing called an ontology, which manages large language models in a way where they become crazily useful, both commercially and actually on the battlefield."

Dr. Karp on what's behind Palantir's dominance in AI 👇🏻 "we were years ahead for lots of reasons, anticipating what operational AI would mean, meaning AI where you make more money or your revenue goes up and your costs go down. Our platforms are built to use large language models and machine learning in a way in that is actually operationally effective... [we] built this thing called an ontology, which manages large language models in a way where they become crazily useful, both commercially and actually on the battlefield."

Eliano A. Younes

47,859 views • 1 year ago