Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Using a trillion parameter LLM and 16 core MacBook Pro to send an email

beffjezos's profile picture

Beff (e/acc)

232,917 subscribers

208,502 görüntüleme • 8 ay önce •via X (Twitter)

Bilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Grok 5 is currently training at the Supercomputer Colossus 2. Grok 5 trains with 6 trillion parameter and a much larger 10 trillion parameter model.
0:10

Grok 5 is currently training at the Supercomputer Colossus 2. Grok 5 trains with 6 trillion parameter and a much larger 10 trillion parameter model.

Testlabor

27,499 görüntüleme • 2 ay önce

Comparing an old, cheap laptop with a MacBook Pro.... No bias at all!
0:11

Comparing an old, cheap laptop with a MacBook Pro.... No bias at all!

Amir

729,380 görüntüleme • 1 yıl önce

My commission sheet Feel free to shoot a dm or send me an email!
0:15

My commission sheet Feel free to shoot a dm or send me an email!

Rebecca Doodles

27,929 görüntüleme • 1 yıl önce

Tested the new MacBook Pro M4 Pro vs. the Mac mini M1 in LM Studio, running Llama 3.2 3B 4-bit MLX. Results: M1 (8-Core) ------> 25 tok/sec M4 Pro (14-Core) -> 104 tok/sec 🤯 – 4x faster!
0:10

Tested the new MacBook Pro M4 Pro vs. the Mac mini M1 in LM Studio, running Llama 3.2 3B 4-bit MLX. Results: M1 (8-Core) ------> 25 tok/sec M4 Pro (14-Core) -> 104 tok/sec 🤯 – 4x faster!

01000010

111,446 görüntüleme • 1 yıl önce

The prompt: "Create a 360 draggable macbook pro"
0:15

The prompt: "Create a 360 draggable macbook pro"

John Lindquist

73,672 görüntüleme • 7 ay önce

Razer shows off their new Razer Blade 16 with an RTX 5090 GPU crammed inside its super slim frame! And at 0.59” thick at its thinnest point, it beats even the Macbook Pro! #CES2025 #razer
0:14

Razer shows off their new Razer Blade 16 with an RTX 5090 GPU crammed inside its super slim frame! And at 0.59” thick at its thinnest point, it beats even the Macbook Pro! #CES2025 #razer

Newegg

15,138 görüntüleme • 1 yıl önce

This guy built his own Apple Vision Pro using an iPhone and Meta Quest Pro to recreate EyeSight. Source:
0:16

This guy built his own Apple Vision Pro using an iPhone and Meta Quest Pro to recreate EyeSight. Source:

Nathie 🔜 AWE

41,393 görüntüleme • 1 yıl önce

3. Send a confidential email. You can make your email confidential by disabling the copying, printing, and forwarding functions. To activate them, click on the padlock symbol when sending a new email.
0:15

3. Send a confidential email. You can make your email confidential by disabling the copying, printing, and forwarding functions. To activate them, click on the padlock symbol when sending a new email.

Manish Kumar

197,097 görüntüleme • 1 yıl önce

I’m givin away a BRAND new M4 MacBook Pro 🔥🔥
0:18

I’m givin away a BRAND new M4 MacBook Pro 🔥🔥

Joey Urbinati

51,889 görüntüleme • 1 yıl önce

Unboxing the M4 Pro MacBook Pro with nano-texture 😮‍💨
0:17

Unboxing the M4 Pro MacBook Pro with nano-texture 😮‍💨

Apple Hub

192,391 görüntüleme • 1 yıl önce

Still need to do some cable management, but this is a huge upgrade to my setup. I put my M3 MacBook Air on a SVALT dock (heatsink + fan) and thermal throttling is completely gone. Now when I’m home it basically performs like a MacBook Pro 🔥
0:10

Still need to do some cable management, but this is a huge upgrade to my setup. I put my M3 MacBook Air on a SVALT dock (heatsink + fan) and thermal throttling is completely gone. Now when I’m home it basically performs like a MacBook Pro 🔥

Fabrizio Rinaldi

351,396 görüntüleme • 1 yıl önce

This is the sound of the local AI on a MacBook Pro.
0:11

This is the sound of the local AI on a MacBook Pro.

Marco Franzon

14,905 görüntüleme • 12 gün önce

$IREN CEO Daniel Roberts: "2 hours ago we got an email from a trillion dollar hyperscaler that said: 'we weren't interested in Sweetwater (the 1.4 GW site) and now they are'." 🔥
0:11

$IREN CEO Daniel Roberts: "2 hours ago we got an email from a trillion dollar hyperscaler that said: 'we weren't interested in Sweetwater (the 1.4 GW site) and now they are'." 🔥

𝐀𝐠𝐫𝐢𝐩𝐩𝐚 𝐈𝐧𝐯𝐞𝐬𝐭𝐦𝐞𝐧𝐭𝐬

113,710 görüntüleme • 1 yıl önce

Imagine typing your website's URL, and getting an email template back? All this using your own brand, logo, colors, styling, and built using React + Tailwind. Go try it out:
0:18

Imagine typing your website's URL, and getting an email template back? All this using your own brand, logo, colors, styling, and built using React + Tailwind. Go try it out:

Zeno Rocha

114,960 görüntüleme • 11 ay önce

Holy shit... Microsoft open sourced an inference framework that runs a 100B parameter LLM on a single CPU. It's called BitNet. And it does what was supposed to be impossible. No GPU. No cloud. No $10K hardware setup. Just your laptop running a 100-billion parameter model at human reading speed. Here's how it works: Every other LLM stores weights in 32-bit or 16-bit floats. BitNet uses 1.58 bits. Weights are ternary just -1, 0, or +1. That's it. No floats. No expensive matrix math. Pure integer operations your CPU was already built for. The result: - 100B model runs on a single CPU at 5-7 tokens/second - 2.37x to 6.17x faster than llama.cpp on x86 - 82% lower energy consumption on x86 CPUs - 1.37x to 5.07x speedup on ARM (your MacBook) - Memory drops by 16-32x vs full-precision models The wildest part: Accuracy barely moves. BitNet b1.58 2B4T their flagship model was trained on 4 trillion tokens and benchmarks competitively against full-precision models of the same size. The quantization isn't destroying quality. It's just removing the bloat. What this actually means: - Run AI completely offline. Your data never leaves your machine - Deploy LLMs on phones, IoT devices, edge hardware - No more cloud API bills for inference - AI in regions with no reliable internet The model supports ARM and x86. Works on your MacBook, your Linux box, your Windows machine. 27.4K GitHub stars. 2.2K forks. Built by Microsoft Research. 100% Open Source. MIT License.
0:13

Holy shit... Microsoft open sourced an inference framework that runs a 100B parameter LLM on a single CPU. It's called BitNet. And it does what was supposed to be impossible. No GPU. No cloud. No $10K hardware setup. Just your laptop running a 100-billion parameter model at human reading speed. Here's how it works: Every other LLM stores weights in 32-bit or 16-bit floats. BitNet uses 1.58 bits. Weights are ternary just -1, 0, or +1. That's it. No floats. No expensive matrix math. Pure integer operations your CPU was already built for. The result: - 100B model runs on a single CPU at 5-7 tokens/second - 2.37x to 6.17x faster than llama.cpp on x86 - 82% lower energy consumption on x86 CPUs - 1.37x to 5.07x speedup on ARM (your MacBook) - Memory drops by 16-32x vs full-precision models The wildest part: Accuracy barely moves. BitNet b1.58 2B4T their flagship model was trained on 4 trillion tokens and benchmarks competitively against full-precision models of the same size. The quantization isn't destroying quality. It's just removing the bloat. What this actually means: - Run AI completely offline. Your data never leaves your machine - Deploy LLMs on phones, IoT devices, edge hardware - No more cloud API bills for inference - AI in regions with no reliable internet The model supports ARM and x86. Works on your MacBook, your Linux box, your Windows machine. 27.4K GitHub stars. 2.2K forks. Built by Microsoft Research. 100% Open Source. MIT License.

Guri Singh

2,180,357 görüntüleme • 3 ay önce

Send love and luck and create a custom St. Patrick’s Day card to send anywhere in Ireland and around the world, using the online An Post AI Card Creator. We will print and post to Ireland or Worldwide for €4. Try it now for a limited time only: #SendLove
0:15

Send love and luck and create a custom St. Patrick’s Day card to send anywhere in Ireland and around the world, using the online An Post AI Card Creator. We will print and post to Ireland or Worldwide for €4. Try it now for a limited time only: #SendLove

An Post

45,260 görüntüleme • 2 yıl önce

Thrilled to have been part of an incredibly talented team designing and bringing the new iPhone 16 Pro page to life ❤️
0:17

Thrilled to have been part of an incredibly talented team designing and bringing the new iPhone 16 Pro page to life ❤️

Anton Repponen

87,522 görüntüleme • 1 yıl önce

How it feels to be an LLM
0:14

How it feels to be an LLM

Beff (e/acc)

36,669 görüntüleme • 1 yıl önce

Today, we're shipping the new Resend email editor, extended by AI. What I love about this is that you can BYOA (Bring Your Own Agent). There's a built-in LLM that can help you draft an email based on an URL. But you can just MCP into the editor too.
0:16

Today, we're shipping the new Resend email editor, extended by AI. What I love about this is that you can BYOA (Bring Your Own Agent). There's a built-in LLM that can help you draft an email based on an URL. But you can just MCP into the editor too.

Zeno Rocha

57,727 görüntüleme • 2 ay önce