Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

LLM Visualization This is actually pretty amazing! It helps to visualize the core components of LLMs like nano-gpt and GPT-3.

elvis

299,907 subscribers

39,431 views • 1 year ago •via X (Twitter)

Education Science & Technology News & Politics

Anya Rossi• Live Now

Private livecam show

9 Comments

AI Advocate Arif1 year ago

I'd love to see more visualizations like this make complex LLM concepts more accessible

Mehrdad Yazdani1 year ago

Does anyone actually find visualizations useful? I don’t mean to hate, but besides educational purposes is there any other use? Code/equations are so much easier for me to understand.

elvis1 year ago

Fair comment. I think, and as you said, they are pretty useful for educational purposes. I don't know that this particular one can lead to any new research insights as is. I really liked the other Transformer Explainer visualization as it does show more things like the transformation of the data, probs, and so on.

通往AGI之路1 year ago

Mind blown 🤯

elbouz1 year ago

It's insane how easier this makes it to understand complex architecture. Also great for efficient refreshers.

GPT.Biz1 year ago

This looks like a great resource to understand LLMs better, definitely worth checking out!

Clancy1 year ago

That is awesome

AIxBlock1 year ago

Nice breakdown and visualization! Tks so much for sharing 👏

Rajesh David1 year ago

Truly amazing stuff. You know what could be cooler ? Going step-by-step and assembling them part-by-part with some details about why that is needed ? Does it already do that ?

Related Videos

This is the inside of a GPT/LLM as it reads your text and "thinks" about what to say next

This is the inside of a GPT/LLM as it reads your text and "thinks" about what to say next

Brandon

43,353 views • 1 year ago

Ever wonder what an LLM actually looks like under the hood? This visualization is mesmerizing. Check it out yourself:

Ever wonder what an LLM actually looks like under the hood? This visualization is mesmerizing. Check it out yourself:

Matthew Berman

166,190 views • 2 years ago

Sam Altman says the leap from GPT-4 to GPT-5 will be as big as that of GPT-3 to 4 and the plan is to integrate the GPT and o series of models into one model that can do everything

Sam Altman says the leap from GPT-4 to GPT-5 will be as big as that of GPT-3 to 4 and the plan is to integrate the GPT and o series of models into one model that can do everything

Tsarathustra

224,102 views • 1 year ago

Sam Altman says GPT-3 was the first real glimpse of passing a spiritual Turing test GPT-5 shows the first small signs of AI doing new science — useful ideas, real help on papers GPT-6 will be a leap like GPT-3 to 4, but this time for science, where it can really do it

Sam Altman says GPT-3 was the first real glimpse of passing a spiritual Turing test GPT-5 shows the first small signs of AI doing new science — useful ideas, real help on papers GPT-6 will be a leap like GPT-3 to 4, but this time for science, where it can really do it

Haider.

163,642 views • 7 months ago

分享一个可深入了解大语言模型 LLM 的工作原理网站：LLM Visualization。该网站通过生动的 3D 可视化交互方式，清晰展示 LLM 推理过程所有步骤，让我们更加直观学习 LLM 背后的工作原理。链接：目前已提供了 GPT-2(small)、nano-gpt、GPT-2(XL) 和 GPT-3 模型的工作原理可视化。

分享一个可深入了解大语言模型 LLM 的工作原理网站：LLM Visualization。该网站通过生动的 3D 可视化交互方式，清晰展示 LLM 推理过程所有步骤，让我们更加直观学习 LLM 背后的工作原理。链接：目前已提供了 GPT-2(small)、nano-gpt、GPT-2(XL) 和 GPT-3 模型的工作原理可视化。

GitHubDaily

13,304 views • 1 year ago

Sam Altman says the leap from GPT-4 to GPT-5 will be as big as that of GPT-3 to 4 and the plan is to integrate the GPT and o series of models into one model that can do everything - that’s the AGI

Sam Altman says the leap from GPT-4 to GPT-5 will be as big as that of GPT-3 to 4 and the plan is to integrate the GPT and o series of models into one model that can do everything - that’s the AGI

Chubby♨️

231,778 views • 1 year ago

Try out GPT-V in Cursor! It's pretty good for building/modifying components!

Try out GPT-V in Cursor! It's pretty good for building/modifying components!

Aman Sanger

195,214 views • 2 years ago

The Email Marketing Brain 🧠 This Custom GPT I just finished training and developing with 500 pages of knowledge is INSANE. It can: - Write ACTUALLY good copy - Create campaign calendars - Answer email marketing questions Like + follow + comment "GPT" and I'll send access 🤝

The Email Marketing Brain 🧠 This Custom GPT I just finished training and developing with 500 pages of knowledge is INSANE. It can: - Write ACTUALLY good copy - Create campaign calendars - Answer email marketing questions Like + follow + comment "GPT" and I'll send access 🤝

Max Sturtevant

27,018 views • 1 year ago

The next change mentioned in the last AMA on Discord is the addition of "Mention GPTs" and a more agent-like approach to GPTs This new feature allows you to inline tag any other custom GPT, which will then be displayed as "Talking to [Grimoire/custom GPT name]". This feature also enables using different GPTs in the same conversation, taking an agents-like approach (although it seems that this feature may not work properly yet). To mention a GPT and add it directly into your conversation, simply type "@" followed by the name of the GPT. h/t to Glenn 'devalias' Grant & his amazing ChatGPT Source Watch project

The next change mentioned in the last AMA on Discord is the addition of "Mention GPTs" and a more agent-like approach to GPTs This new feature allows you to inline tag any other custom GPT, which will then be displayed as "Talking to [Grimoire/custom GPT name]". This feature also enables using different GPTs in the same conversation, taking an agents-like approach (although it seems that this feature may not work properly yet). To mention a GPT and add it directly into your conversation, simply type "@" followed by the name of the GPT. h/t to Glenn 'devalias' Grant & his amazing ChatGPT Source Watch project

Tibor Blaho

12,776 views • 2 years ago

It works!! This is fully designed by GPT-5.5 and GPT-5.5-Pro in ForgeCAD!

It works!! This is fully designed by GPT-5.5 and GPT-5.5-Pro in ForgeCAD!

Ruben Kostandyan

35,378 views • 23 days ago

Kind of shocking how much better GPT-5-Codex is vs the regular 'Thinking' models in ChatGPT. My subjective rankings for the fruit machine test: 1. GPT-5-Codex-Medium 2. GPT-5-Thinking-Heavy 3. GPT-5-Pro 4. GPT-5-Codex-High 5. GPT-5-Codex-Low 6. GPT-5-Thinking-Standard 7. GPT-5-Thinking-Extended 8. GPT-5-Thinking-Light OpenAI Codex team have suggested 'Medium' should be the default, but I didn't expect that it would actually beat the 'High' setting model in my test.

Kind of shocking how much better GPT-5-Codex is vs the regular 'Thinking' models in ChatGPT. My subjective rankings for the fruit machine test: 1. GPT-5-Codex-Medium 2. GPT-5-Thinking-Heavy 3. GPT-5-Pro 4. GPT-5-Codex-High 5. GPT-5-Codex-Low 6. GPT-5-Thinking-Standard 7. GPT-5-Thinking-Extended 8. GPT-5-Thinking-Light OpenAI Codex team have suggested 'Medium' should be the default, but I didn't expect that it would actually beat the 'High' setting model in my test.

Peter Gostev

101,848 views • 8 months ago

Project #2: LLM Visualization So I created a web-page to visualize a small LLM, of the sort that's behind ChatGPT. Rendered in 3D, it shows all the steps to run a single token inference. (link in bio)

Project #2: LLM Visualization So I created a web-page to visualize a small LLM, of the sort that's behind ChatGPT. Rendered in 3D, it shows all the steps to run a single token inference. (link in bio)

Brendan Bycroft

1,201,038 views • 2 years ago

We put SERV Nano next to GPT-5.4 SERV Nano is: • ~20x cheaper • ~3x faster The numbers do not lie. Make of that what you will.

We put SERV Nano next to GPT-5.4 SERV Nano is: • ~20x cheaper • ~3x faster The numbers do not lie. Make of that what you will.

OpenServ

52,573 views • 2 months ago

BREAKING: ChatGPT GPT-4o was just announce by OpenAI. It improves on vision, audio and text. The ease of use is incredibly enhanced. It makes interaction with the GPT much more natural, especially with voice. GPT-4o reasons across voice, text and vision. GPT-4 wil be available to everyone.

BREAKING: ChatGPT GPT-4o was just announce by OpenAI. It improves on vision, audio and text. The ease of use is incredibly enhanced. It makes interaction with the GPT much more natural, especially with voice. GPT-4o reasons across voice, text and vision. GPT-4 wil be available to everyone.

Ed Krassenstein

21,605 views • 2 years ago

Claude Sonnet 3.5 Artifacts is now available to use with GPT-4o, Gemini, Llama-3 and other LLMs for just $10 a month. Build interactive experiences, search the web, generate images and audio with GPT-4o and Claude Sonnet 3.5 in just one AI playground.

Claude Sonnet 3.5 Artifacts is now available to use with GPT-4o, Gemini, Llama-3 and other LLMs for just $10 a month. Build interactive experiences, search the web, generate images and audio with GPT-4o and Claude Sonnet 3.5 in just one AI playground.

Shubham Saboo

27,452 views • 1 year ago

Sam Altman on GPT 6: “There will be a chance that it will be a GPT 3-4 style leap” in terms of science problems, where with GPT 5 it has these tiny glimmers and “GPT 6 it can really do it”

Sam Altman on GPT 6: “There will be a chance that it will be a GPT 3-4 style leap” in terms of science problems, where with GPT 5 it has these tiny glimmers and “GPT 6 it can really do it”

Chris

42,684 views • 7 months ago

GPT-5.3 Codex is actually pretty insane with Three.js This Minecraft clone works smoothly and it didn't take too long to make I also tried Opus 4.6, but for some reason it got stuck

GPT-5.3 Codex is actually pretty insane with Three.js This Minecraft clone works smoothly and it didn't take too long to make I also tried Opus 4.6, but for some reason it got stuck

Angel 🌼

1,127,552 views • 4 months ago

RouteLLM: Choose the Best LLM for Your Query! Use a single interface to access all state-of-the-art LLMs: - o1 for hard problems - Sonnet 3.5 for standard coding - GPT-4o for essays - Gemini Flash 2.0 for longer contexts Mix and match to use the best LLM for your query on ChatLLM.

RouteLLM: Choose the Best LLM for Your Query! Use a single interface to access all state-of-the-art LLMs: - o1 for hard problems - Sonnet 3.5 for standard coding - GPT-4o for essays - Gemini Flash 2.0 for longer contexts Mix and match to use the best LLM for your query on ChatLLM.

Akshay 🚀

56,316 views • 1 year ago