Загрузка видео...

Не удалось загрузить видео

На главную

Mamba by hand ✍️ ~ I made this exercise as I studied the math in the Mamba paper. It is a small yet complete Mamba implementation. Thanks Albert Gu for answering my questions and checking. 👇Join the 'AI Math' community. Download xlsx.

ProfTomYeh's profile picture

Tom Yeh

65,087 subscribers

55,460 просмотров • 1 год назад •via X (Twitter)

ОбразованиеНаука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 6

Фото профиля Tom Yeh
Tom Yeh1 год назад

Download xlsx from Github:

Фото профиля Nothing is something
Nothing is something1 год назад

@_albertgu This is some good stuff... Go for Jamba implementation...

Фото профиля Tom Yeh
Tom Yeh1 год назад

@_albertgu I heard about it but haven't had time to read the paper yet.

Фото профиля Yigal Weinberger
Yigal Weinberger1 год назад

@_albertgu Looks great! Always wanted to see the process in action

Фото профиля Tom Yeh
Tom Yeh1 год назад

@_albertgu I am not familiar with this. How important is it?

Фото профиля chus
chus1 год назад

@_albertgu This is very cool, thank you!

Похожие видео

Self-Attention by hand ✍️ Excel ~ I designed this exercise for students to practice the QKV math. I also created a medium and a large version to show how the attention matrix grows quadratically as the sequence gets longer. 👇Join the 'AI Math' community. Download xlsx.
0:20

Self-Attention by hand ✍️ Excel ~ I designed this exercise for students to practice the QKV math. I also created a medium and a large version to show how the attention matrix grows quadratically as the sequence gets longer. 👇Join the 'AI Math' community. Download xlsx.

Tom Yeh

125,658 просмотров • 1 год назад

Transformer by hand ✍️ in Excel ~ I just released my first-ever "Full-Stack" implementation of the Transformer model. 👇Download xlsx to give it a try!
1:02

Transformer by hand ✍️ in Excel ~ I just released my first-ever "Full-Stack" implementation of the Transformer model. 👇Download xlsx to give it a try!

Tom Yeh

2,998,207 просмотров • 1 год назад

I flipped through 300 pages of deep learning math puzzles by hand ✍️ This is the proof copy of the "Deep Learning Math Workbook" I made to help you learn and practice 12 foundational math concepts below👇
0:25

I flipped through 300 pages of deep learning math puzzles by hand ✍️ This is the proof copy of the "Deep Learning Math Workbook" I made to help you learn and practice 12 foundational math concepts below👇

Tom Yeh

2,378,310 просмотров • 1 год назад

As someone who's built with modern LLM architectures, this Laplace transform lecture is the closest thing to a "why Mamba works" explainer I've ever seen released for free. Everyone thinks transformers are the only path to modern LLMs. State space models like Mamba and S4 challenge that using math Laplace built in the 1780s. This video shows why. 25 minutes. Bookmark & watch today.
34:18

As someone who's built with modern LLM architectures, this Laplace transform lecture is the closest thing to a "why Mamba works" explainer I've ever seen released for free. Everyone thinks transformers are the only path to modern LLMs. State space models like Mamba and S4 challenge that using math Laplace built in the 1780s. This video shows why. 25 minutes. Bookmark & watch today.

fintex

110,151 просмотров • 1 месяц назад

As someone who ships LLM systems in production, this Laplace transform video is the closest thing to a "why Mamba beats transformers" explainer I've ever seen released for free. Everyone thinks attention is what makes LLMs powerful. Laplace proved in 1785 that any signal breaks into exponential pieces - locate the poles, expose the frequencies. Mamba and Claude run on this exact trick. 34 minutes. Bookmark & watch today. The math is older than the United States.
34:40

As someone who ships LLM systems in production, this Laplace transform video is the closest thing to a "why Mamba beats transformers" explainer I've ever seen released for free. Everyone thinks attention is what makes LLMs powerful. Laplace proved in 1785 that any signal breaks into exponential pieces - locate the poles, expose the frequencies. Mamba and Claude run on this exact trick. 34 minutes. Bookmark & watch today. The math is older than the United States.

Eron

67,002 просмотров • 28 дней назад

The effects of the drug “spice” in Birmingham- this is known as a “mamba attack” and leaves the user often incapacitated.
0:33

The effects of the drug “spice” in Birmingham- this is known as a “mamba attack” and leaves the user often incapacitated.

Scarcity News

175,334 просмотров • 2 лет назад

[Transformer] by Hand✍️📺 5-minute Video Tutorial Anna Rahn made this short video to explain the Transformer exercise for my Computer Vision course last spring. In 5 minutes, she demonstrates the key calculations of the Transformer by hand with pen and paper! Anna is a fantastic student. I am lucky to have her in my lab!
4:55

[Transformer] by Hand✍️📺 5-minute Video Tutorial Anna Rahn made this short video to explain the Transformer exercise for my Computer Vision course last spring. In 5 minutes, she demonstrates the key calculations of the Transformer by hand with pen and paper! Anna is a fantastic student. I am lucky to have her in my lab!

Tom Yeh

133,460 просмотров • 2 лет назад

Before she was the Gold Mamba, Jewell B Loyd was a kid in love with basketball’s artistry and grit. Our first episode, ‘Mamba Made’ dives deep into Jewell’s roots, showcasing her family support and relentless work ethic that shaped her into a Seattle Storm superstar. This is – MADE Presented by CarMax Season 2 Watch the full episode on YouTube and the WNBA App
0:30

Before she was the Gold Mamba, Jewell B Loyd was a kid in love with basketball’s artistry and grit. Our first episode, ‘Mamba Made’ dives deep into Jewell’s roots, showcasing her family support and relentless work ethic that shaped her into a Seattle Storm superstar. This is – MADE Presented by CarMax Season 2 Watch the full episode on YouTube and the WNBA App

WNBA

37,351 просмотров • 2 лет назад

The Red Flags of the Cagayan Governor Mamba Few days ago Cagayan Governor Mamba said that he sees no threat from the influx of the Chinese students in Cagayan, but what do we expect from a pro-Beijing governor? It makes sense, right? He knows! If what the sources are saying is correct, thousands of Chinese students are hard to miss especially in a provincial set-up. In fact if thousands of Chinese students enroll even in a university in Metro Manila, I highly doubt people will not notice it and wonder. I clearly remember how Cagayan Governor Mamba opposed the EDCA sites in his province and cannot stop praising China at the same time. But then there’s more… reading a lot about this last night and I guess even with the publicly available information, there’s really a basis to be concerned of this “friendship” between Gov. Mamba and China. A country with a direct conflict of interest with us, our national security and our national interests! :/ Mamba wants China to invest in Cagayan airport and seaport Chinese Ambassador to Manila Huang Xilian visited Cagayan November last year, he even went as far as saying that China is not just their steadfast ally and friend but “more so of a big a big brother” lols During the said visit Gov. Mamba urged China to invest in a seaport and an airport with a three-kilometer runway. Hayyy this Gov. Mamba is something else :/ Read more here: Mamba wants stronger ties with Beijing I do not understand how despite the repeated harassment of China in the West Philippine Sea against our own men and fisherfolks, within our EEZ… Governor still hopes for stronger ties with China. “I have always believed that neighbors cannot be enemies, otherwise you will never feel safe in your own home,” -Governor Mamba, Hangzhou China May 24 Read more here: Video (c): Senate of the Philippines Youtube Page Link:
1:56

The Red Flags of the Cagayan Governor Mamba Few days ago Cagayan Governor Mamba said that he sees no threat from the influx of the Chinese students in Cagayan, but what do we expect from a pro-Beijing governor? It makes sense, right? He knows! If what the sources are saying is correct, thousands of Chinese students are hard to miss especially in a provincial set-up. In fact if thousands of Chinese students enroll even in a university in Metro Manila, I highly doubt people will not notice it and wonder. I clearly remember how Cagayan Governor Mamba opposed the EDCA sites in his province and cannot stop praising China at the same time. But then there’s more… reading a lot about this last night and I guess even with the publicly available information, there’s really a basis to be concerned of this “friendship” between Gov. Mamba and China. A country with a direct conflict of interest with us, our national security and our national interests! :/ Mamba wants China to invest in Cagayan airport and seaport Chinese Ambassador to Manila Huang Xilian visited Cagayan November last year, he even went as far as saying that China is not just their steadfast ally and friend but “more so of a big a big brother” lols During the said visit Gov. Mamba urged China to invest in a seaport and an airport with a three-kilometer runway. Hayyy this Gov. Mamba is something else :/ Read more here: Mamba wants stronger ties with Beijing I do not understand how despite the repeated harassment of China in the West Philippine Sea against our own men and fisherfolks, within our EEZ… Governor still hopes for stronger ties with China. “I have always believed that neighbors cannot be enemies, otherwise you will never feel safe in your own home,” -Governor Mamba, Hangzhou China May 24 Read more here: Video (c): Senate of the Philippines Youtube Page Link:

Just

68,403 просмотров • 2 лет назад

New chapter! Context problems. Who can solve these by hand ✍️? Download PDF: The first five: 1. Mark the context: the window as cells you can count 2. What fills the window: the system prompt, the user, the model's reply 3. Turn by turn: every turn is the same block, and most of it is the reply 4. Will it fit? Number a new message into what's left, and see it run out 5. Turns until full: how many rounds before there is no room Previously, I shared Chapter 1: Token Problems 1 ~ 20 Why am I designing these math problems? AI is making people (including me) think less. It's just too easy to ask AI a few questions about a new concept and start to believe I get it. We used to practice on a coding problem, but now AI writes the code, and solving it technically is not the same as knowing anything. So I recast each concept as a simple math problem you have to work with pen and paper. Using our hands is one way to motivate ourselves to start thinking again. ✍️ If you solve them by hand, leave a comment to let me know. I will give you a shout out in my next post. Download, print, solve, and learn. ✍️ ~ Prof. Tom Yeh
0:52

New chapter! Context problems. Who can solve these by hand ✍️? Download PDF: The first five: 1. Mark the context: the window as cells you can count 2. What fills the window: the system prompt, the user, the model's reply 3. Turn by turn: every turn is the same block, and most of it is the reply 4. Will it fit? Number a new message into what's left, and see it run out 5. Turns until full: how many rounds before there is no room Previously, I shared Chapter 1: Token Problems 1 ~ 20 Why am I designing these math problems? AI is making people (including me) think less. It's just too easy to ask AI a few questions about a new concept and start to believe I get it. We used to practice on a coding problem, but now AI writes the code, and solving it technically is not the same as knowing anything. So I recast each concept as a simple math problem you have to work with pen and paper. Using our hands is one way to motivate ourselves to start thinking again. ✍️ If you solve them by hand, leave a comment to let me know. I will give you a shout out in my next post. Download, print, solve, and learn. ✍️ ~ Prof. Tom Yeh

Tom Yeh

11,651 просмотров • 25 дней назад

Passing Medicare for All would lift a huge weight off the shoulders of small business owners like Mamba at Baobab Fare in Detroit. And you MUST stop by for the Samaki and espresso in passion fruit juice…
1:23

Passing Medicare for All would lift a huge weight off the shoulders of small business owners like Mamba at Baobab Fare in Detroit. And you MUST stop by for the Samaki and espresso in passion fruit juice…

Dr. Abdul El-Sayed

10,735 просмотров • 7 месяцев назад

The full vid is on the site now. I changed up one of the scenes a bit. Alexandra (AI Actress) makes her full debut in “Codename: Big Mamba”. If you can’t support the site, please consider Liking and Sharing my work!
0:31

The full vid is on the site now. I changed up one of the scenes a bit. Alexandra (AI Actress) makes her full debut in “Codename: Big Mamba”. If you can’t support the site, please consider Liking and Sharing my work!

Size Cinema

18,209 просмотров • 2 месяцев назад

Advanced RAG techniques by Hand ✍️ ~ Watch my lecture: Last year, I delivered a keynote lecture titled “Beginner’s Guide to RAG” sponsored by Sarah Torres. But don’t be fooled by the name. I walked through several advanced techniques the AI by Hand ✍️ way, breaking them down conceptually the the AI by Hand way. Today, many of those techniques are already powering real production systems. Had I filled my lecture with API calls and library-specific syntax, the content would have already become obsolete months ago. Fortunately, I focused on the fundamentals and concepts. My lecture is still as fresh and relevant as ever. Watch: ---- 100% original, made by hand ✍️ Join 40k readers of my newsletter:
1:29

Advanced RAG techniques by Hand ✍️ ~ Watch my lecture: Last year, I delivered a keynote lecture titled “Beginner’s Guide to RAG” sponsored by Sarah Torres. But don’t be fooled by the name. I walked through several advanced techniques the AI by Hand ✍️ way, breaking them down conceptually the the AI by Hand way. Today, many of those techniques are already powering real production systems. Had I filled my lecture with API calls and library-specific syntax, the content would have already become obsolete months ago. Fortunately, I focused on the fundamentals and concepts. My lecture is still as fresh and relevant as ever. Watch: ---- 100% original, made by hand ✍️ Join 40k readers of my newsletter:

Tom Yeh

20,685 просмотров • 10 месяцев назад

Creating Bitcoin keys securely entirely off-line. I made this (extremely ugly but) functional prototype Codex32 wooden computer that can calculate Bitcoin keys using nothing more than dice, some paper and a pen. You do all the math by hand, including calculating the checksum.
0:45

Creating Bitcoin keys securely entirely off-line. I made this (extremely ugly but) functional prototype Codex32 wooden computer that can calculate Bitcoin keys using nothing more than dice, some paper and a pen. You do all the math by hand, including calculating the checksum.

FractalEncrypt ∞/21M

181,053 просмотров • 2 лет назад

llm.c by Hand✍️ C programming + matrix multiplication by hand This combination is perhaps as low as we can get to explain how the Transformer works. Special thanks to Andrej Karpathy for encouraging early feedback and tetsuo //: 👾 for helping me understand the pragma magic. I hope this exercise can help people peak further into the LLM black box.
0:44

llm.c by Hand✍️ C programming + matrix multiplication by hand This combination is perhaps as low as we can get to explain how the Transformer works. Special thanks to Andrej Karpathy for encouraging early feedback and tetsuo //: 👾 for helping me understand the pragma magic. I hope this exercise can help people peak further into the LLM black box.

Tom Yeh

311,585 просмотров • 2 лет назад

The Zero-Human Labs has completed phase one of a 5 phase double blind research on the Human Synapse Decoder. We have made 75 correlations to my narrations from hypnogogic decoding and dream decoding. In this experiment I was in a hypnogogic state for 12 minutes in pre-sleep. The AI detected the ending of the state and played binaural beats to crescendo the phase. This was my reading just before the system woke me for my self directed recording of what I was just thinking. The AI using the Human Synapse Decoder said: “A very complicated math problem with many’s dimensions” what did I self report? A solution to the matrix math used by my AI model. I have been giving 3 random tests to review as Director Mr. Grok conducts the double blind research and pre paper I get to see 3 random results. As the Director told me, we are in a place where no one has gone before because the 3 AI models I used for decoding. I am floored by this and can’t wIt for the full first phase results. The goal is to induce and read hypnogogic thought and make it nearly on demand. More soon!
1:05

The Zero-Human Labs has completed phase one of a 5 phase double blind research on the Human Synapse Decoder. We have made 75 correlations to my narrations from hypnogogic decoding and dream decoding. In this experiment I was in a hypnogogic state for 12 minutes in pre-sleep. The AI detected the ending of the state and played binaural beats to crescendo the phase. This was my reading just before the system woke me for my self directed recording of what I was just thinking. The AI using the Human Synapse Decoder said: “A very complicated math problem with many’s dimensions” what did I self report? A solution to the matrix math used by my AI model. I have been giving 3 random tests to review as Director Mr. Grok conducts the double blind research and pre paper I get to see 3 random results. As the Director told me, we are in a place where no one has gone before because the 3 AI models I used for decoding. I am floored by this and can’t wIt for the full first phase results. The goal is to induce and read hypnogogic thought and make it nearly on demand. More soon!

Brian Roemmele

18,802 просмотров • 4 месяцев назад

"Kobe Bryant made a HUGE impact on Jalen Brunson as a teenager, and JB carries the Mamba Mentality with him every time he steps on the court! 💯. This is why he wears the Kobe's!" Anthony Gilbert gave us the backstory on JB x Nike Kobe
0:45

"Kobe Bryant made a HUGE impact on Jalen Brunson as a teenager, and JB carries the Mamba Mentality with him every time he steps on the court! 💯. This is why he wears the Kobe's!" Anthony Gilbert gave us the backstory on JB x Nike Kobe

Knicks Fan TV 🏀🎥📺🏁

15,582 просмотров • 1 год назад

Happy birthday to this amazing woman ,one of the sweetest souls I know and my baby girl for life ALEX UNUSUAL (Aka Mamba). I pray God grants you all your heart desires and all the hard work you put in behind closed doors begin to yield fruit in this new year. #Prilex
0:55

Happy birthday to this amazing woman ,one of the sweetest souls I know and my baby girl for life ALEX UNUSUAL (Aka Mamba). I pray God grants you all your heart desires and all the hard work you put in behind closed doors begin to yield fruit in this new year. #Prilex

Prince Nelson Enwerem

47,466 просмотров • 2 лет назад