Загрузка видео...

Не удалось загрузить видео

На главную

And here we go - running Llama 3.2 3B on Raspberry Pi 5 with AI HAT+ 2. This thing is not going to break any speed records, but it’s incredible that we can now get such a powerful model on such a constrained system. Just a little over 3...

tunguz's profile picture

Bojan Tunguz

291,792 subscribers

27,108 просмотров • 6 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Raspberry Pi power meets industrial smarts with SECO Pi Vision 10.1 CM5. Pi Vision 10.1 CM5 is a rugged, ready-to-roll platform built around Raspberry Pi Compute Module 5. It’s tailor-made for IoT developers and system integrators. This isn’t just any old human–machine interface. It’s a Raspberry Pi gone pro.
1:27

Raspberry Pi power meets industrial smarts with SECO Pi Vision 10.1 CM5. Pi Vision 10.1 CM5 is a rugged, ready-to-roll platform built around Raspberry Pi Compute Module 5. It’s tailor-made for IoT developers and system integrators. This isn’t just any old human–machine interface. It’s a Raspberry Pi gone pro.

Raspberry Pi

16,618 просмотров • 9 месяцев назад

POTUS: Ukraine just agreed to a ceasefire "a little while ago. Now we have to go to Russia and hopefully President Putin will agree to that also and we can get this show on the road... We want to get that war over with."
1:08

POTUS: Ukraine just agreed to a ceasefire "a little while ago. Now we have to go to Russia and hopefully President Putin will agree to that also and we can get this show on the road... We want to get that war over with."

Rapid Response 47

308,416 просмотров • 1 год назад

President Trump on Iran: “We want a system that can lead to many years of peace. And if we can't have that, we might as well get it over with right now.”
0:44

President Trump on Iran: “We want a system that can lead to many years of peace. And if we can't have that, we might as well get it over with right now.”

Chief Nerd

55,973 просмотров • 5 месяцев назад

DeepSeek R1 671B is ridiculously good, but running at 158 tokens per second is something out of this world. A model *this good* running *this fast* is 3 years ahead of this time. The secret: DeepSeek in this short video isn't running on GPUs. It's running on custom-made chips! This is running on SambaNova and their SN40L chips, which are designed and optimized for running AI workflows. SambaNova is sponsoring my work. We designed GPUs to run games and later realized we could use them for AI. This is very different from creating a chip specifically for AI from the ground up. Just think about this for a second: One single SNL40 chip can simultaneously hold 100+ models (trillions of parameters) in memory! An agentic workflow that uses multiple models simultaneously won't need to swap models from memory even once! By the way, the Llama family of models *screams* on the SambaNova Cloud. Here are some numbers from my latest tests: • Llama 3.3 70B: 367.32 t/s • Llama 3.2 1B: 2381.82 t/s • Llama 3.2 3B: 1335.71 t/s • Llama 3.1 8B: 929.58 t/s • Llama 3.1 70B: 369.16 t/s • Llama 3.1 405B: 103.37 t/s You can access all of these models for free!
1:34

DeepSeek R1 671B is ridiculously good, but running at 158 tokens per second is something out of this world. A model *this good* running *this fast* is 3 years ahead of this time. The secret: DeepSeek in this short video isn't running on GPUs. It's running on custom-made chips! This is running on SambaNova and their SN40L chips, which are designed and optimized for running AI workflows. SambaNova is sponsoring my work. We designed GPUs to run games and later realized we could use them for AI. This is very different from creating a chip specifically for AI from the ground up. Just think about this for a second: One single SNL40 chip can simultaneously hold 100+ models (trillions of parameters) in memory! An agentic workflow that uses multiple models simultaneously won't need to swap models from memory even once! By the way, the Llama family of models *screams* on the SambaNova Cloud. Here are some numbers from my latest tests: • Llama 3.3 70B: 367.32 t/s • Llama 3.2 1B: 2381.82 t/s • Llama 3.2 3B: 1335.71 t/s • Llama 3.1 8B: 929.58 t/s • Llama 3.1 70B: 369.16 t/s • Llama 3.1 405B: 103.37 t/s You can access all of these models for free!

Santiago

131,019 просмотров • 1 год назад

What can you do with Llama quality and Groq speed? Instant. That's what. 3 months back: Llama 8B running at 750 Tokens/sec Now: Llama 70B model running at 3,200 Tokens/sec We're still going to get a liiiiiiitle bit faster, but this is our V1 14nm LPU - how fast will V2 be? 😉
0:39

What can you do with Llama quality and Groq speed? Instant. That's what. 3 months back: Llama 8B running at 750 Tokens/sec Now: Llama 70B model running at 3,200 Tokens/sec We're still going to get a liiiiiiitle bit faster, but this is our V1 14nm LPU - how fast will V2 be? 😉

Jonathan Ross

179,815 просмотров • 1 год назад

You don’t need a $10,000 mac to use Openclaw locally. Just get an $80 raspberry pi 5 and a $3 SD card and you are good to go. You can even use the free ChatGPT version, which is incredibly generous. The productivity boost is insane.
1:50

You don’t need a $10,000 mac to use Openclaw locally. Just get an $80 raspberry pi 5 and a $3 SD card and you are good to go. You can even use the free ChatGPT version, which is incredibly generous. The productivity boost is insane.

Michael Asiedu

236,975 просмотров • 5 месяцев назад

It’s been 18 years since Ronnie O’Sullivan made this incredible 147 maximum break. That shot on the black to split the red and pink from such a difficult angle was simply fantastic 🤩
3:23

It’s been 18 years since Ronnie O’Sullivan made this incredible 147 maximum break. That shot on the black to split the red and pink from such a difficult angle was simply fantastic 🤩

I ❤️ Snooker

40,888 просмотров • 4 месяцев назад

AI Bedtimestory You can soon create personal audio/image stories like this from a single input ⚡️ It's been more than 2 years since we launched Bedtimestory. Some +100.000 hyper personal stories later, and here we are. But it's just not limited to bedtimestories... 🧵
6:05

AI Bedtimestory You can soon create personal audio/image stories like this from a single input ⚡️ It's been more than 2 years since we launched Bedtimestory. Some +100.000 hyper personal stories later, and here we are. But it's just not limited to bedtimestories... 🧵

Linus ✦ Ekenstam

14,029 просмотров • 1 год назад

I just added the new Llama 3.2 1B and 3B models to LitGPT, the open-source LLM library I help develop (focused on efficiency and code readability). LitGPT allows you to fine-tune and use these models on the cloud or a laptop. So, if you are looking for something to play with this weekend: # 1) Finetune the model litgpt finetune_lora meta-llama/Llama-3.2-1B \ --data JSON \ --data.json_path my_custom_dataset.json \ --train.epochs 1 \ --out_dir out/llama-3.2-finetuned \ --precision bf16-true # 2) Chat with the model litgpt chat out/llama-3.2-finetuned/final # 3) Serve the model via an API endpoint litgpt serve out/llama-3.2-finetuned/final
1:48

I just added the new Llama 3.2 1B and 3B models to LitGPT, the open-source LLM library I help develop (focused on efficiency and code readability). LitGPT allows you to fine-tune and use these models on the cloud or a laptop. So, if you are looking for something to play with this weekend: # 1) Finetune the model litgpt finetune_lora meta-llama/Llama-3.2-1B \ --data JSON \ --data.json_path my_custom_dataset.json \ --train.epochs 1 \ --out_dir out/llama-3.2-finetuned \ --precision bf16-true # 2) Chat with the model litgpt chat out/llama-3.2-finetuned/final # 3) Serve the model via an API endpoint litgpt serve out/llama-3.2-finetuned/final

Sebastian Raschka

65,529 просмотров • 1 год назад

Christopher Nolan on reuniting with Elliot Page years after INCEPTION: “It was really fun. Elliot’s just terrific, and I just thought this was such a great part for him. We had such a great time years ago on Inception. It’s nice to reunite with people.”
0:20

Christopher Nolan on reuniting with Elliot Page years after INCEPTION: “It was really fun. Elliot’s just terrific, and I just thought this was such a great part for him. We had such a great time years ago on Inception. It’s nice to reunite with people.”

Christopher Nolan Updates

6,907,052 просмотров • 1 месяц назад

Here is my 2d animation reel for ENA DREAM BBQ ‼️‼️ Chapter 1!! Many thanks to Joel and everyone for having me help out on such a cool project, it’s been a pleasure working with such a talented crew!! On we go towards chapter 2!
0:45

Here is my 2d animation reel for ENA DREAM BBQ ‼️‼️ Chapter 1!! Many thanks to Joel and everyone for having me help out on such a cool project, it’s been a pleasure working with such a talented crew!! On we go towards chapter 2!

FERCI 🇵🇪

153,999 просмотров • 1 год назад

“Let me get this straight: We go to a country, we capture their leader, we bomb it, & then we say we run this country now — and that's not war. But when they send cocaine over here, that people are willingly snorting — that is war. That doesn't make any sense.”
4:28

“Let me get this straight: We go to a country, we capture their leader, we bomb it, & then we say we run this country now — and that's not war. But when they send cocaine over here, that people are willingly snorting — that is war. That doesn't make any sense.”

Kat Timpf

5,712,464 просмотров • 7 месяцев назад

Anthropic has created an AI model that “can get into almost any software in the world,” former AI company founder and CEO Matt Shumer says — but the company is not releasing it to the public: “I have never seen something like this — a company that is about to IPO and having such a moral compass.” Shumer shares what makes the AI model so powerful and potentially dangerous.
4:55

Anthropic has created an AI model that “can get into almost any software in the world,” former AI company founder and CEO Matt Shumer says — but the company is not releasing it to the public: “I have never seen something like this — a company that is about to IPO and having such a moral compass.” Shumer shares what makes the AI model so powerful and potentially dangerous.

CBS Mornings

98,892 просмотров • 4 месяцев назад

“Now we just get on podcasts and tell everybody that we have a source and we know what Dave Doeren is going to do, like, it's such BS.” Full comments from Dave Doeren on his return for next season, rumors about his retirement this season.
1:00

“Now we just get on podcasts and tell everybody that we have a source and we know what Dave Doeren is going to do, like, it's such BS.” Full comments from Dave Doeren on his return for next season, rumors about his retirement this season.

Pack Pride

67,168 просмотров • 8 месяцев назад

🤷‍♂️ Seattle Sounders head coach Brian Schmetzer isn’t ready to hit the panic button on the club after a historic 5 straight losses. “We’re still successful. I understand everybody is calling for more signing and one hand I might say we probably should. But on the other hand, if your resources are such, we’re not going to go out right now in this window and replace 5 guys to a group that started of 7-3-3. We’re just not going to do that.” Do you agree with Coach?
0:24

🤷‍♂️ Seattle Sounders head coach Brian Schmetzer isn’t ready to hit the panic button on the club after a historic 5 straight losses. “We’re still successful. I understand everybody is calling for more signing and one hand I might say we probably should. But on the other hand, if your resources are such, we’re not going to go out right now in this window and replace 5 guys to a group that started of 7-3-3. We’re just not going to do that.” Do you agree with Coach?

Noah Riffe

17,934 просмотров • 20 дней назад

That’s a wrap on #Andor, one of the Top 3 Star Wars things ever made. Truly, I say that with confidence. And I think it’s going to age even better. This is the type of thing we need more of in not just Star Wars, but anything franchise-related. Incredible.
5:06

That’s a wrap on #Andor, one of the Top 3 Star Wars things ever made. Truly, I say that with confidence. And I think it’s going to age even better. This is the type of thing we need more of in not just Star Wars, but anything franchise-related. Incredible.

Jeff D. Lowe

92,955 просмотров • 1 год назад

It’s true, there is a crises… unfortunately it’s not one that makes headlines. It’s not one that is politically correct. And it’s one many like to pretend doesn’t matter. But the longer we keep pretending there isn’t a serious problem here—the worse it’s going to get. Men matter. Boys matter. Our fathers, brothers, friends and family matter. If you believe that young men can’t get left behind, sign here: Thank you Jamil Jivani for being such an incredible voice on this real crises effecting our boys and men.
2:06

It’s true, there is a crises… unfortunately it’s not one that makes headlines. It’s not one that is politically correct. And it’s one many like to pretend doesn’t matter. But the longer we keep pretending there isn’t a serious problem here—the worse it’s going to get. Men matter. Boys matter. Our fathers, brothers, friends and family matter. If you believe that young men can’t get left behind, sign here: Thank you Jamil Jivani for being such an incredible voice on this real crises effecting our boys and men.

Jasmin Laine

20,226 просмотров • 8 месяцев назад

SKY NEWS: The Kremlin is claiming that Ukraine is trying to get a nuclear weapon via Britain and France. ZELENSKY: With pleasure! But I didn’t receive any such proposals. SKY NEWS: So we can put that to bed — that’s not happening at all. ZELENSKY: No, it’s not happening.
0:22

SKY NEWS: The Kremlin is claiming that Ukraine is trying to get a nuclear weapon via Britain and France. ZELENSKY: With pleasure! But I didn’t receive any such proposals. SKY NEWS: So we can put that to bed — that’s not happening at all. ZELENSKY: No, it’s not happening.

Kate from Kharkiv

134,942 просмотров • 5 месяцев назад

“I hate TikTok. It’s the most poisonous thing on earth. ... I don’t love social media. I think it’s incredibly toxic. It’s not good for you as a person, but it’s such a tool that we have to use now.” - Matt Rife
2:46

“I hate TikTok. It’s the most poisonous thing on earth. ... I don’t love social media. I think it’s incredibly toxic. It’s not good for you as a person, but it’s such a tool that we have to use now.” - Matt Rife

Club Shay Shay

46,526 просмотров • 5 месяцев назад