Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

NVIDIA just dropped Nemotron-3-Nano:4b — a tiny 2.8GB model. Guess whose hardware runs it the fastest? - RTX 4090: 226 tok/s - RTX 3090: 187 tok/s - Mac Studio M2 Ultra: 86 tok/s - Mac Mini M4: 25 tok/s Home court advantage is real. Also trying a new layout...

stevibe's profile picture

stevibe

22,227 subscribers

127,233 görüntüleme • 2 ay önce •via X (Twitter)

Haberler & PolitikaBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

.AI at Meta's Llama 4 Scout ripping 42.27 tok / sec on M2 Ultra Mac Studio
0:11

.AI at Meta's Llama 4 Scout ripping 42.27 tok / sec on M2 Ultra Mac Studio

LM Studio

19,587 görüntüleme • 1 yıl önce

Tested the new MacBook Pro M4 Pro vs. the Mac mini M1 in LM Studio, running Llama 3.2 3B 4-bit MLX. Results: M1 (8-Core) ------> 25 tok/sec M4 Pro (14-Core) -> 104 tok/sec 🤯 – 4x faster!
0:10

Tested the new MacBook Pro M4 Pro vs. the Mac mini M1 in LM Studio, running Llama 3.2 3B 4-bit MLX. Results: M1 (8-Core) ------> 25 tok/sec M4 Pro (14-Core) -> 104 tok/sec 🤯 – 4x faster!

01000010

111,446 görüntüleme • 1 yıl önce

MiniMax M2.5 casually responding at ~50 tok/s with MLX (M3 Ultra). The model was released one hour ago 🥳
0:14

MiniMax M2.5 casually responding at ~50 tok/s with MLX (M3 Ultra). The model was released one hour ago 🥳

Pedro Cuenca

170,493 görüntüleme • 4 ay önce

M4 Mac Mini AI Cluster Uses EXO Labs with Thunderbolt 5 interconnect (80Gbps) to run LLMs distributed across 4 M4 Pro Mac Minis. The cluster is small (iPhone for reference). It’s running Nemotron 70B at 8 tok/sec and scales to Llama 405B (benchmarks soon).
0:19

M4 Mac Mini AI Cluster Uses EXO Labs with Thunderbolt 5 interconnect (80Gbps) to run LLMs distributed across 4 M4 Pro Mac Minis. The cluster is small (iPhone for reference). It’s running Nemotron 70B at 8 tok/sec and scales to Llama 405B (benchmarks soon).

Alex Cheema

3,516,005 görüntüleme • 1 yıl önce

WhisperKit-0.7.0 is out! Single file inference is several times faster! The demo below is running distil-whisper large-v3 at 300 tok/s and transcribes 101 seconds of audio in 1 second on an M2 Ultra Mac Studio. Details 🧵 Code (MIT): Demo Audio Input: Demo App: (TestFlight update under review)
0:14

WhisperKit-0.7.0 is out! Single file inference is several times faster! The demo below is running distil-whisper large-v3 at 300 tok/s and transcribes 101 seconds of audio in 1 second on an M2 Ultra Mac Studio. Details 🧵 Code (MIT): Demo Audio Input: Demo App: (TestFlight update under review)

argmax

50,542 görüntüleme • 2 yıl önce

Run Llama 3.1 1B offline at 60+ tok/s. Entirely on your phone. Siri can’t save you offline, but a local model just might.
0:14

Run Llama 3.1 1B offline at 60+ tok/s. Entirely on your phone. Siri can’t save you offline, but a local model just might.

Aaron Ng

154,576 görüntüleme • 1 yıl önce

Making a bop folder on tik tok dm if interested (『S』 will be included)
0:15

Making a bop folder on tik tok dm if interested (『S』 will be included)

bopperless

37,158 görüntüleme • 5 ay önce

llama 3 70b beamed to my phone from my M1 Max ~7.6 tok/s with mlx. your own little gpt-4 at home
0:17

llama 3 70b beamed to my phone from my M1 Max ~7.6 tok/s with mlx. your own little gpt-4 at home

Aaron Ng

1,116,956 görüntüleme • 2 yıl önce

Running DeepSeek R1 on my desk Uses EXO Labs with Thunderbolt 5 interconnect (80Gbps) to run the full (671B, 8-bit) DeepSeek R1 distributed across 2 M3 Ultra 512GB Mac Studios (1TB total Unified Memory). Runs at 11 tok/sec. Theoretical max is ~20 tok/sec.
0:14

Running DeepSeek R1 on my desk Uses EXO Labs with Thunderbolt 5 interconnect (80Gbps) to run the full (671B, 8-bit) DeepSeek R1 distributed across 2 M3 Ultra 512GB Mac Studios (1TB total Unified Memory). Runs at 11 tok/sec. Theoretical max is ~20 tok/sec.

Alex Cheema

992,062 görüntüleme • 1 yıl önce

M4 Mac Mini AI cluster running Llama 3.3 70B Preliminary results show Gigabit ethernet switch (4 tok/sec) is slower than Thunderbolt-5 with EXO Labs Benchmarks including Thunderbolt-5 coming soonTM.
0:11

M4 Mac Mini AI cluster running Llama 3.3 70B Preliminary results show Gigabit ethernet switch (4 tok/sec) is slower than Thunderbolt-5 with EXO Labs Benchmarks including Thunderbolt-5 coming soonTM.

Alex Cheema

73,090 görüntüleme • 1 yıl önce

EXO 1.0 at Apple NeurIPS booth. 4 x 512GB M3 Ultra Mac Studios clustered all-to-all with RDMA over Thunderbolt 5. Runs DeepSeek v3.2 (8-bit) at 25 tok/sec with tensor parallelism.
0:15

EXO 1.0 at Apple NeurIPS booth. 4 x 512GB M3 Ultra Mac Studios clustered all-to-all with RDMA over Thunderbolt 5. Runs DeepSeek v3.2 (8-bit) at 25 tok/sec with tensor parallelism.

EXO Labs

185,728 görüntüleme • 5 ay önce

SmallThinker 3B is one of the AI models I’d want backed up on my phone. Here’s it is reasoning at 12 tok/s on my phone. If you’re ever stuck offline, you’ll want a model that can think.
0:15

SmallThinker 3B is one of the AI models I’d want backed up on my phone. Here’s it is reasoning at 12 tok/s on my phone. If you’re ever stuck offline, you’ll want a model that can think.

Aaron Ng

35,858 görüntüleme • 1 yıl önce

Running Kimi K2.5 on my desk. Runs at 24 tok/sec with 2 x 512GB M3 Ultra Mac Studios connected with Thunderbolt 5 (RDMA) using EXO Labs / MLX backend. Yes, it can run clawdbot.
0:18

Running Kimi K2.5 on my desk. Runs at 24 tok/sec with 2 x 512GB M3 Ultra Mac Studios connected with Thunderbolt 5 (RDMA) using EXO Labs / MLX backend. Yes, it can run clawdbot.

Alex Cheema

3,039,300 görüntüleme • 4 ay önce

New Dirk Tik Tok dropped today
0:14

New Dirk Tik Tok dropped today

Mavs Film Room 🐴🎥

130,235 görüntüleme • 9 ay önce

Qwen QwQ 32B fp16 on M4 Max and M2 Ultra powered by MLX! M2 Ultra - 10.2 toks/s M4 Max - 7.6 toks/s! "Create an amazing animation using p5js" o1-mini level local model! Note: use temp 0.7-0.75 for optimal results in coding. I did some tests and this
0:10

Qwen QwQ 32B fp16 on M4 Max and M2 Ultra powered by MLX! M2 Ultra - 10.2 toks/s M4 Max - 7.6 toks/s! "Create an amazing animation using p5js" o1-mini level local model! Note: use temp 0.7-0.75 for optimal results in coding. I did some tests and this

Ivan Fioravanti ᯅ

62,377 görüntüleme • 1 yıl önce

Running the full GLM 4.7 (8-bit) on 2 x 512GB M3 Ultra Mac Studios Runs at 19.8 tok/sec with EXO Labs MLX RDMA backend (h/t Awni Hannun) & tensor parallel
0:12

Running the full GLM 4.7 (8-bit) on 2 x 512GB M3 Ultra Mac Studios Runs at 19.8 tok/sec with EXO Labs MLX RDMA backend (h/t Awni Hannun) & tensor parallel

Alex Cheema

156,668 görüntüleme • 5 ay önce

tik tok tik tok tik tok
0:18

tik tok tik tok tik tok

리버

120,061 görüntüleme • 1 yıl önce

NEW TIK TOK POST xxx.poppyyyy on tik tok
0:27

NEW TIK TOK POST xxx.poppyyyy on tik tok

꧁•⊹٭𝙿𝚘𝚙𝚙𝚢 𝙲𝚘𝚡٭⊹•꧂

15,503 görüntüleme • 4 ay önce

Hailey made a tik tok with her friends and then Selena make the same tik tok
0:18

Hailey made a tik tok with her friends and then Selena make the same tik tok

tumama

38,482 görüntüleme • 1 yıl önce