Загрузка видео...

Не удалось загрузить видео

На главную

Using a trillion parameter LLM and 16 core MacBook Pro to send an email

beffjezos's profile picture

Beff (e/acc)

237,474 subscribers

208,511 просмотров • 8 месяцев назад •via X (Twitter)

Наука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Grok 5 is currently training at the Supercomputer Colossus 2. Grok 5 trains with 6 trillion parameter and a much larger 10 trillion parameter model.
0:10

Grok 5 is currently training at the Supercomputer Colossus 2. Grok 5 trains with 6 trillion parameter and a much larger 10 trillion parameter model.

Testlabor

27,507 просмотров • 2 месяцев назад

Can a VLM see without a vision encoder? We trained one for $100, inspired by Gemma 4 12B. Latency on an M3 Pro MacBook: 112 ms -> 1.1 ms for the image path 30% lower end-to-end image+LLM The architecture is just: patchify the image -> linear projection with pos embeddings -> LLM Writeup:
0:12

Can a VLM see without a vision encoder? We trained one for $100, inspired by Gemma 4 12B. Latency on an M3 Pro MacBook: 112 ms -> 1.1 ms for the image path 30% lower end-to-end image+LLM The architecture is just: patchify the image -> linear projection with pos embeddings -> LLM Writeup:

Andi Marafioti

59,886 просмотров • 16 дней назад

Comparing an old, cheap laptop with a MacBook Pro.... No bias at all!
0:11

Comparing an old, cheap laptop with a MacBook Pro.... No bias at all!

Amir

729,395 просмотров • 1 год назад

My commission sheet Feel free to shoot a dm or send me an email!
0:15

My commission sheet Feel free to shoot a dm or send me an email!

Rebecca Doodles

27,929 просмотров • 1 год назад

Tested the new MacBook Pro M4 Pro vs. the Mac mini M1 in LM Studio, running Llama 3.2 3B 4-bit MLX. Results: M1 (8-Core) ------> 25 tok/sec M4 Pro (14-Core) -> 104 tok/sec 🤯 – 4x faster!
0:10

Tested the new MacBook Pro M4 Pro vs. the Mac mini M1 in LM Studio, running Llama 3.2 3B 4-bit MLX. Results: M1 (8-Core) ------> 25 tok/sec M4 Pro (14-Core) -> 104 tok/sec 🤯 – 4x faster!

01000010

111,446 просмотров • 1 год назад

The prompt: "Create a 360 draggable macbook pro"
0:15

The prompt: "Create a 360 draggable macbook pro"

John Lindquist

73,672 просмотров • 7 месяцев назад

Send a trillion dollars to Ukraine at this point
0:12

Send a trillion dollars to Ukraine at this point

Quality Learing Center

86,828 просмотров • 6 дней назад

Razer shows off their new Razer Blade 16 with an RTX 5090 GPU crammed inside its super slim frame! And at 0.59” thick at its thinnest point, it beats even the Macbook Pro! #CES2025 #razer
0:14

Razer shows off their new Razer Blade 16 with an RTX 5090 GPU crammed inside its super slim frame! And at 0.59” thick at its thinnest point, it beats even the Macbook Pro! #CES2025 #razer

Newegg

15,138 просмотров • 1 год назад

This guy built his own Apple Vision Pro using an iPhone and Meta Quest Pro to recreate EyeSight. Source:
0:16

This guy built his own Apple Vision Pro using an iPhone and Meta Quest Pro to recreate EyeSight. Source:

Nathie

41,397 просмотров • 1 год назад

3. Send a confidential email. You can make your email confidential by disabling the copying, printing, and forwarding functions. To activate them, click on the padlock symbol when sending a new email.
0:15

3. Send a confidential email. You can make your email confidential by disabling the copying, printing, and forwarding functions. To activate them, click on the padlock symbol when sending a new email.

Manish Kumar

197,097 просмотров • 1 год назад

I’m givin away a BRAND new M4 MacBook Pro 🔥🔥
0:18

I’m givin away a BRAND new M4 MacBook Pro 🔥🔥

Joey Urbinati

51,889 просмотров • 1 год назад

Unboxing the M4 Pro MacBook Pro with nano-texture 😮‍💨
0:17

Unboxing the M4 Pro MacBook Pro with nano-texture 😮‍💨

Apple Hub

192,391 просмотров • 1 год назад

Still need to do some cable management, but this is a huge upgrade to my setup. I put my M3 MacBook Air on a SVALT dock (heatsink + fan) and thermal throttling is completely gone. Now when I’m home it basically performs like a MacBook Pro 🔥
0:10

Still need to do some cable management, but this is a huge upgrade to my setup. I put my M3 MacBook Air on a SVALT dock (heatsink + fan) and thermal throttling is completely gone. Now when I’m home it basically performs like a MacBook Pro 🔥

Fabrizio Rinaldi

351,407 просмотров • 1 год назад

Imagine typing your website's URL, and getting an email template back? All this using your own brand, logo, colors, styling, and built using React + Tailwind. Go try it out:
0:18

Imagine typing your website's URL, and getting an email template back? All this using your own brand, logo, colors, styling, and built using React + Tailwind. Go try it out:

Zeno Rocha

114,960 просмотров • 11 месяцев назад

$IREN CEO Daniel Roberts: "2 hours ago we got an email from a trillion dollar hyperscaler that said: 'we weren't interested in Sweetwater (the 1.4 GW site) and now they are'." 🔥
0:11

$IREN CEO Daniel Roberts: "2 hours ago we got an email from a trillion dollar hyperscaler that said: 'we weren't interested in Sweetwater (the 1.4 GW site) and now they are'." 🔥

𝐀𝐠𝐫𝐢𝐩𝐩𝐚 𝐈𝐧𝐯𝐞𝐬𝐭𝐦𝐞𝐧𝐭𝐬

113,710 просмотров • 1 год назад

Holy shit... Microsoft open sourced an inference framework that runs a 100B parameter LLM on a single CPU. It's called BitNet. And it does what was supposed to be impossible. No GPU. No cloud. No $10K hardware setup. Just your laptop running a 100-billion parameter model at human reading speed. Here's how it works: Every other LLM stores weights in 32-bit or 16-bit floats. BitNet uses 1.58 bits. Weights are ternary just -1, 0, or +1. That's it. No floats. No expensive matrix math. Pure integer operations your CPU was already built for. The result: - 100B model runs on a single CPU at 5-7 tokens/second - 2.37x to 6.17x faster than llama.cpp on x86 - 82% lower energy consumption on x86 CPUs - 1.37x to 5.07x speedup on ARM (your MacBook) - Memory drops by 16-32x vs full-precision models The wildest part: Accuracy barely moves. BitNet b1.58 2B4T their flagship model was trained on 4 trillion tokens and benchmarks competitively against full-precision models of the same size. The quantization isn't destroying quality. It's just removing the bloat. What this actually means: - Run AI completely offline. Your data never leaves your machine - Deploy LLMs on phones, IoT devices, edge hardware - No more cloud API bills for inference - AI in regions with no reliable internet The model supports ARM and x86. Works on your MacBook, your Linux box, your Windows machine. 27.4K GitHub stars. 2.2K forks. Built by Microsoft Research. 100% Open Source. MIT License.
0:13

Holy shit... Microsoft open sourced an inference framework that runs a 100B parameter LLM on a single CPU. It's called BitNet. And it does what was supposed to be impossible. No GPU. No cloud. No $10K hardware setup. Just your laptop running a 100-billion parameter model at human reading speed. Here's how it works: Every other LLM stores weights in 32-bit or 16-bit floats. BitNet uses 1.58 bits. Weights are ternary just -1, 0, or +1. That's it. No floats. No expensive matrix math. Pure integer operations your CPU was already built for. The result: - 100B model runs on a single CPU at 5-7 tokens/second - 2.37x to 6.17x faster than llama.cpp on x86 - 82% lower energy consumption on x86 CPUs - 1.37x to 5.07x speedup on ARM (your MacBook) - Memory drops by 16-32x vs full-precision models The wildest part: Accuracy barely moves. BitNet b1.58 2B4T their flagship model was trained on 4 trillion tokens and benchmarks competitively against full-precision models of the same size. The quantization isn't destroying quality. It's just removing the bloat. What this actually means: - Run AI completely offline. Your data never leaves your machine - Deploy LLMs on phones, IoT devices, edge hardware - No more cloud API bills for inference - AI in regions with no reliable internet The model supports ARM and x86. Works on your MacBook, your Linux box, your Windows machine. 27.4K GitHub stars. 2.2K forks. Built by Microsoft Research. 100% Open Source. MIT License.

Guri Singh

2,180,357 просмотров • 3 месяцев назад

Send love and luck and create a custom St. Patrick’s Day card to send anywhere in Ireland and around the world, using the online An Post AI Card Creator. We will print and post to Ireland or Worldwide for €4. Try it now for a limited time only: #SendLove
0:15

Send love and luck and create a custom St. Patrick’s Day card to send anywhere in Ireland and around the world, using the online An Post AI Card Creator. We will print and post to Ireland or Worldwide for €4. Try it now for a limited time only: #SendLove

An Post

45,261 просмотров • 2 лет назад

Thrilled to have been part of an incredibly talented team designing and bringing the new iPhone 16 Pro page to life ❤️
0:17

Thrilled to have been part of an incredibly talented team designing and bringing the new iPhone 16 Pro page to life ❤️

Anton Repponen

87,527 просмотров • 1 год назад

Today, we're shipping the new Resend email editor, extended by AI. What I love about this is that you can BYOA (Bring Your Own Agent). There's a built-in LLM that can help you draft an email based on an URL. But you can just MCP into the editor too.
0:16

Today, we're shipping the new Resend email editor, extended by AI. What I love about this is that you can BYOA (Bring Your Own Agent). There's a built-in LLM that can help you draft an email based on an URL. But you can just MCP into the editor too.

Zeno Rocha

57,869 просмотров • 2 месяцев назад