Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Mistral Vibe CLI running Devstral-small-2-2512 on M3 Ultra 512GB with LM Studio as backend 🔥 First part of the video 1x and the remaining 2x Great speed overall, 27 toks/s as average tracked on LM Studio console. Details to run it below 🧵

ivanfioravanti's profile picture

Ivan Fioravanti ᯅ

20,568 subscribers

49,682 görüntüleme • 7 ay önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

This is MiniMax-M2.5 MLX running in LM Studio on an Apple Mac Studio M3 Ultra 512GB. Fast enough out of the box for hosting OpenClaw, n8n workflows, and Open WebUI for the team.
0:53

This is MiniMax-M2.5 MLX running in LM Studio on an Apple Mac Studio M3 Ultra 512GB. Fast enough out of the box for hosting OpenClaw, n8n workflows, and Open WebUI for the team.

Patrick J Kennedy

73,547 görüntüleme • 5 ay önce

I didn't expect DeepSeek v4 PRO (not Flash) to run well on the Mac Studio M3 Ultra with 512GB of RAM. This is 2 bit quantized with the same DwarfStar recipe used for Flash. 433GB GGUF file. 130 t/s prefill, 13 t/s generation. Prefill in the video is low because small prompt.
1:24

I didn't expect DeepSeek v4 PRO (not Flash) to run well on the Mac Studio M3 Ultra with 512GB of RAM. This is 2 bit quantized with the same DwarfStar recipe used for Flash. 433GB GGUF file. 130 t/s prefill, 13 t/s generation. Prefill in the video is low because small prompt.

antirez

169,897 görüntüleme • 2 ay önce

Subagents running locally and simultaneously on MacBook Pro M5 with Codex CLI + LM Studio to review code and find bugs using Qwen 3.6 Powered by the updated MLX engine with batching in beta in the app The batching speed boost is noticeable
1:40

Subagents running locally and simultaneously on MacBook Pro M5 with Codex CLI + LM Studio to review code and find bugs using Qwen 3.6 Powered by the updated MLX engine with batching in beta in the app The batching speed boost is noticeable

Adrien Grondin

75,549 görüntüleme • 1 ay önce

Run Orpheus — the state-of-the-art TTS — on your local PC! Orpheus-FastAPI is a high-performance TTS app with OpenAI-compatible API, running efficiently with LM Studio backend. And Death wrote this 1-click launcher for us! Cross platform (Mac, Linux, Windows)
0:28

Run Orpheus — the state-of-the-art TTS — on your local PC! Orpheus-FastAPI is a high-performance TTS app with OpenAI-compatible API, running efficiently with LM Studio backend. And Death wrote this 1-click launcher for us! Cross platform (Mac, Linux, Windows)

cocktail peanut

30,930 görüntüleme • 1 yıl önce

GLM-5 runs with mlx-lm on a single 512GB M3 Ultra in Q4. It's quite good in my initial testing and pretty fast as well. It generated a highly functional space invaders game using 7.1k tokens at 15.4 tok/s and 419GB memory. Thanks to Gökdeniz Gülmez and Tarjei Mandt for the port.
1:11

GLM-5 runs with mlx-lm on a single 512GB M3 Ultra in Q4. It's quite good in my initial testing and pretty fast as well. It generated a highly functional space invaders game using 7.1k tokens at 15.4 tok/s and 419GB memory. Thanks to Gökdeniz Gülmez and Tarjei Mandt for the port.

Awni Hannun

60,599 görüntüleme • 5 ay önce

DeepSeek has just released a powerful new 8B model 🔥 This means you can run it locally and for free on a laptop with zero limitations. You just need LM Studio and 4Gb of RAM. The few quick steps below:
0:24

DeepSeek has just released a powerful new 8B model 🔥 This means you can run it locally and for free on a laptop with zero limitations. You just need LM Studio and 4Gb of RAM. The few quick steps below:

Paul Couvert

370,707 görüntüleme • 1 yıl önce

i tested a fully local ai coding setup: gemma4 from Google DeepMind running through LM Studio, paired with pi which is a minimal open source coding harness this is part 1 of a two part series. here we cover the why and the complete hands-on setup 0:00 - Running a coding agent fully local 0:47 - Why Pi as the coding agent harness 1:39 - Why Gemma 4 and which variant to pick 2:44 - Architecture: Pi, LM Studio and Gemma 4 3:45 - LM Studio setup and model download 5:01 - Starting the local server 5:19 - API sanity check with curl 6:08 - Installing the Pi coding agent 6:20 - Configuring models.json for local models 8:20 - First run: selecting the model in Pi 8:58 - Fixing the context length error 10:16 - Testing the working setup 10:50 - What is coming in Part 2
11:32

i tested a fully local ai coding setup: gemma4 from Google DeepMind running through LM Studio, paired with pi which is a minimal open source coding harness this is part 1 of a two part series. here we cover the why and the complete hands-on setup 0:00 - Running a coding agent fully local 0:47 - Why Pi as the coding agent harness 1:39 - Why Gemma 4 and which variant to pick 2:44 - Architecture: Pi, LM Studio and Gemma 4 3:45 - LM Studio setup and model download 5:01 - Starting the local server 5:19 - API sanity check with curl 6:08 - Installing the Pi coding agent 6:20 - Configuring models.json for local models 8:20 - First run: selecting the model in Pi 8:58 - Fixing the context length error 10:16 - Testing the working setup 10:50 - What is coming in Part 2

Nidhi Singh

16,289 görüntüleme • 1 ay önce

oMLX last version seems having some issues in decoding. 🧐 Here a test with Qwen3.6-35B-A3B-MLX-6bit on M5 Max using. 🥇 LM Studio MLX 1.8.5 → 100.9 toks/s 🥈 mlx-vlm 0.6.2 → 100.1 toks/s 🥉 oMLX 0.4.2 dev3 → 58.7 toks/s 👀 Avg Gen TPS: oMLX 58.7 → LM Studio 100.9 (+71.8%) I have to thank pymike00 that raised this oMLX issue after seeing my video on using it with Codex. I bet there is a bug in oMLX chat and server at the moment, because internal benchmarks are ok, video attached. I bet Jun Kim will fix this soon 💪
0:27

oMLX last version seems having some issues in decoding. 🧐 Here a test with Qwen3.6-35B-A3B-MLX-6bit on M5 Max using. 🥇 LM Studio MLX 1.8.5 → 100.9 toks/s 🥈 mlx-vlm 0.6.2 → 100.1 toks/s 🥉 oMLX 0.4.2 dev3 → 58.7 toks/s 👀 Avg Gen TPS: oMLX 58.7 → LM Studio 100.9 (+71.8%) I have to thank pymike00 that raised this oMLX issue after seeing my video on using it with Codex. I bet there is a bug in oMLX chat and server at the moment, because internal benchmarks are ok, video attached. I bet Jun Kim will fix this soon 💪

Ivan Fioravanti ᯅ

19,931 görüntüleme • 1 ay önce

The top question I got was does Halo support local LLM running on a Mac. Here's an example of the app using gemma-4-26b-a4b-qat via LM Studio running on a base M5/32GB. It's giving an average of 40 tok/s and in my brief testing is able to execute all tool calls correctly. Very usable with this app.
0:37

The top question I got was does Halo support local LLM running on a Mac. Here's an example of the app using gemma-4-26b-a4b-qat via LM Studio running on a base M5/32GB. It's giving an average of 40 tok/s and in my brief testing is able to execute all tool calls correctly. Very usable with this app.

Tanmay

11,351 görüntüleme • 17 gün önce

Using Starlink and a MacBook to play Blades in the Dark with DeepSeek V4 Flash as GM running on ds4 on a remote M3 Ultra and exposed through tailscale as a service in the middle of mountains. We are living in the best era of humankind! Hey... 👋🏻 not bad the speed eh?
0:50

Using Starlink and a MacBook to play Blades in the Dark with DeepSeek V4 Flash as GM running on ds4 on a remote M3 Ultra and exposed through tailscale as a service in the middle of mountains. We are living in the best era of humankind! Hey... 👋🏻 not bad the speed eh?

Ivan Fioravanti ᯅ

12,842 görüntüleme • 19 gün önce

NVIDIA sent us 2 DGX Sparks. For a while we wondered what we would do with them. The memory bandwidth is 273GB/s making it 3x slower than an M3 Ultra (819GB/s) for batch_size=1 inference. But it has 4x more FLOPS (100 TFLOPS compared to 26 TFLOPS). So we thought, what if we could combine the DGX Spark & M3 Ultra, and make use of both the massive compute on the DGX Spark and the massive memory-bandwidth on the M3 Ultra. We came up with a way to split inference across both devices and achieve a speedup of up to 4x for long prompts compared to the M3 Ultra on its own. Full details in the blog post linked below.
1:13

NVIDIA sent us 2 DGX Sparks. For a while we wondered what we would do with them. The memory bandwidth is 273GB/s making it 3x slower than an M3 Ultra (819GB/s) for batch_size=1 inference. But it has 4x more FLOPS (100 TFLOPS compared to 26 TFLOPS). So we thought, what if we could combine the DGX Spark & M3 Ultra, and make use of both the massive compute on the DGX Spark and the massive memory-bandwidth on the M3 Ultra. We came up with a way to split inference across both devices and achieve a speedup of up to 4x for long prompts compared to the M3 Ultra on its own. Full details in the blog post linked below.

Alex Cheema

281,225 görüntüleme • 9 ay önce

My action part of a new short about the Wayfinder character! Very glad to have had the opportunity to work on this project with industry ultra-heroes like Joaquim Dos Santos , @barryjkelly , malcolm , Nas Pasha and other cool guys, as well as Studio Mir 스튜디오미르 !
0:20

My action part of a new short about the Wayfinder character! Very glad to have had the opportunity to work on this project with industry ultra-heroes like Joaquim Dos Santos , @barryjkelly , malcolm , Nas Pasha and other cool guys, as well as Studio Mir 스튜디오미르 !

bbwb anim

282,421 görüntüleme • 2 yıl önce

CREAM was Recorded on December 3, 1990, in Paisley Park, Studio A, and released on September 9, 1991, as the second single off #DiamondsAndPearls. Subsequently, it hit #1 on the Billboard Hot 100. “Cream Take 2 reveals not only the strength of the song but also the power of Prince’s producing, as he instinctively knew what to add to “Cream” to make it a classic.“ It puts me right back with headphones, in the studio with him,” - Tommy Barbarella. Stream both versions and let us know your thoughts below! #Prince #NPGRecords
0:29

CREAM was Recorded on December 3, 1990, in Paisley Park, Studio A, and released on September 9, 1991, as the second single off #DiamondsAndPearls. Subsequently, it hit #1 on the Billboard Hot 100. “Cream Take 2 reveals not only the strength of the song but also the power of Prince’s producing, as he instinctively knew what to add to “Cream” to make it a classic.“ It puts me right back with headphones, in the studio with him,” - Tommy Barbarella. Stream both versions and let us know your thoughts below! #Prince #NPGRecords

Prince

81,404 görüntüleme • 2 yıl önce

On 25 July 1968, months after the first version of “While My Guitar Gently Weeps” was recorded at George’s home, he and Paul recorded the first studio acoustic version in Abbey Road’s Studio 2. Later, on 5 September, Eric Clapton joined on guitar for takes 17 to 45 and Take 25 was chosen as the master for ‘The White Album.’ You can hear 'Take 27 - Third Version' on Anthology 4 🍏
0:39

On 25 July 1968, months after the first version of “While My Guitar Gently Weeps” was recorded at George’s home, he and Paul recorded the first studio acoustic version in Abbey Road’s Studio 2. Later, on 5 September, Eric Clapton joined on guitar for takes 17 to 45 and Take 25 was chosen as the master for ‘The White Album.’ You can hear 'Take 27 - Third Version' on Anthology 4 🍏

The Beatles

71,258 görüntüleme • 9 ay önce

For a Microdrama studio, the game isn't only a great script. It's shipping enough of them, fast enough, to find your winner as soon as possible. So we built a workflow inside Agent One that makes the production pipeline 5X faster - whether you're running a studio or an agency taking on series projects. Time, cost, exact steps - all in the video and the thread.
10:15

For a Microdrama studio, the game isn't only a great script. It's shipping enough of them, fast enough, to find your winner as soon as possible. So we built a workflow inside Agent One that makes the production pipeline 5X faster - whether you're running a studio or an agency taking on series projects. Time, cost, exact steps - all in the video and the thread.

Invideo

33,007 görüntüleme • 1 ay önce

On this #screenshotsaturday, releasing the Silent Hill Origins modern camera mod as part of v0.04 of PS2 Cam Acolyte. You can customize the distance, etc. and it has some new controls to make dual stick gameplay easier (i.e. L2 to run). More details...🧵
0:37

On this #screenshotsaturday, releasing the Silent Hill Origins modern camera mod as part of v0.04 of PS2 Cam Acolyte. You can customize the distance, etc. and it has some new controls to make dual stick gameplay easier (i.e. L2 to run). More details...🧵

Withering Realms

14,751 görüntüleme • 1 yıl önce

[Day 2] The BIGGEST misconception of AI animation. I won 3rd place in a Japanese AI film contest with my first anime. One-man studio. No funding. Just obsession. Now I’m making my second one to join a contest by Morphic and Watch the full video below and read on 🧵
1:55

[Day 2] The BIGGEST misconception of AI animation. I won 3rd place in a Japanese AI film contest with my first anime. One-man studio. No funding. Just obsession. Now I’m making my second one to join a contest by Morphic and Watch the full video below and read on 🧵

Tú Michael 🇻🇳

17,426 görüntüleme • 8 ay önce

First video about MTPLX it works! 🔥 Gonna do my context benchmarks and some coding on it ASAP! In my very first test here: 🥇 M3 Ultra on the right: 33 --> 68 tps 🥈 M5 Max on the left: 27 --> 55 tps But M5 Max has 2 external monitors connected and is doing ton of stuff in parallel. Amazing job by Youssof Al Toukhi here!
2:12

First video about MTPLX it works! 🔥 Gonna do my context benchmarks and some coding on it ASAP! In my very first test here: 🥇 M3 Ultra on the right: 33 --> 68 tps 🥈 M5 Max on the left: 27 --> 55 tps But M5 Max has 2 external monitors connected and is doing ton of stuff in parallel. Amazing job by Youssof Al Toukhi here!

Ivan Fioravanti ᯅ

14,267 görüntüleme • 2 ay önce

Linear scaling achieved with multiple DeepSeek v3.1 instances. 4x macs = 4x throughput. 2x M3 Ultra Mac Studios = 1x DeepSeek @ 14 tok/sec 4x M3 Ultra Mac Studios = 2x DeepSeek @ 28 tok/sec DeepSeek V3.1 is a 671B parameter model - so at its native 8-bit quantization, it requires ~700GB of memory to run the model. EXO puts half of the layers on each device, combining their memory. EXO uses MLX distributed with TB5 interconnect, optimized for Apple Silicon. If we need higher throughput, adding two more devices lets us serve more users at once. EXO Labs handles all of this seamlessly - adding more devices to the cluster for linear scaling as we need it. The new EXO 1.0 will be open-source soonTM
0:29

Linear scaling achieved with multiple DeepSeek v3.1 instances. 4x macs = 4x throughput. 2x M3 Ultra Mac Studios = 1x DeepSeek @ 14 tok/sec 4x M3 Ultra Mac Studios = 2x DeepSeek @ 28 tok/sec DeepSeek V3.1 is a 671B parameter model - so at its native 8-bit quantization, it requires ~700GB of memory to run the model. EXO puts half of the layers on each device, combining their memory. EXO uses MLX distributed with TB5 interconnect, optimized for Apple Silicon. If we need higher throughput, adding two more devices lets us serve more users at once. EXO Labs handles all of this seamlessly - adding more devices to the cluster for linear scaling as we need it. The new EXO 1.0 will be open-source soonTM

Matt Beton

158,485 görüntüleme • 10 ay önce