正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Mistral Vibe CLI running Devstral-small-2-2512 on M3 Ultra 512GB with LM Studio as backend 🔥 First part of the video 1x and the remaining 2x Great speed overall, 27 toks/s as average tracked on LM Studio console. Details to run it below 🧵

Ivan Fioravanti ᯅ

20,568 subscribers

49,682 次观看 • 8 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

This is MiniMax-M2.5 MLX running in LM Studio on an Apple Mac Studio M3 Ultra 512GB. Fast enough out of the box for hosting OpenClaw, n8n workflows, and Open WebUI for the team.

This is MiniMax-M2.5 MLX running in LM Studio on an Apple Mac Studio M3 Ultra 512GB. Fast enough out of the box for hosting OpenClaw, n8n workflows, and Open WebUI for the team.

Patrick J Kennedy

76,574 次观看 • 6 个月前

I didn't expect DeepSeek v4 PRO (not Flash) to run well on the Mac Studio M3 Ultra with 512GB of RAM. This is 2 bit quantized with the same DwarfStar recipe used for Flash. 433GB GGUF file. 130 t/s prefill, 13 t/s generation. Prefill in the video is low because small prompt.

I didn't expect DeepSeek v4 PRO (not Flash) to run well on the Mac Studio M3 Ultra with 512GB of RAM. This is 2 bit quantized with the same DwarfStar recipe used for Flash. 433GB GGUF file. 130 t/s prefill, 13 t/s generation. Prefill in the video is low because small prompt.

antirez

171,478 次观看 • 3 个月前

Subagents running locally and simultaneously on MacBook Pro M5 with Codex CLI + LM Studio to review code and find bugs using Qwen 3.6 Powered by the updated MLX engine with batching in beta in the app The batching speed boost is noticeable

Subagents running locally and simultaneously on MacBook Pro M5 with Codex CLI + LM Studio to review code and find bugs using Qwen 3.6 Powered by the updated MLX engine with batching in beta in the app The batching speed boost is noticeable

Adrien Grondin

75,549 次观看 • 3 个月前

Run Orpheus — the state-of-the-art TTS — on your local PC! Orpheus-FastAPI is a high-performance TTS app with OpenAI-compatible API, running efficiently with LM Studio backend. And Death wrote this 1-click launcher for us! Cross platform (Mac, Linux, Windows)

Run Orpheus — the state-of-the-art TTS — on your local PC! Orpheus-FastAPI is a high-performance TTS app with OpenAI-compatible API, running efficiently with LM Studio backend. And Death wrote this 1-click launcher for us! Cross platform (Mac, Linux, Windows)

cocktail peanut

30,930 次观看 • 1 年前

GLM-5 runs with mlx-lm on a single 512GB M3 Ultra in Q4. It's quite good in my initial testing and pretty fast as well. It generated a highly functional space invaders game using 7.1k tokens at 15.4 tok/s and 419GB memory. Thanks to Gökdeniz Gülmez and Tarjei Mandt for the port.

GLM-5 runs with mlx-lm on a single 512GB M3 Ultra in Q4. It's quite good in my initial testing and pretty fast as well. It generated a highly functional space invaders game using 7.1k tokens at 15.4 tok/s and 419GB memory. Thanks to Gökdeniz Gülmez and Tarjei Mandt for the port.

Awni Hannun

60,599 次观看 • 6 个月前

DeepSeek has just released a powerful new 8B model 🔥 This means you can run it locally and for free on a laptop with zero limitations. You just need LM Studio and 4Gb of RAM. The few quick steps below:

DeepSeek has just released a powerful new 8B model 🔥 This means you can run it locally and for free on a laptop with zero limitations. You just need LM Studio and 4Gb of RAM. The few quick steps below:

Paul Couvert

370,822 次观看 • 1 年前

i tested a fully local ai coding setup: gemma4 from Google DeepMind running through LM Studio, paired with pi which is a minimal open source coding harness this is part 1 of a two part series. here we cover the why and the complete hands-on setup 0:00 - Running a coding agent fully local 0:47 - Why Pi as the coding agent harness 1:39 - Why Gemma 4 and which variant to pick 2:44 - Architecture: Pi, LM Studio and Gemma 4 3:45 - LM Studio setup and model download 5:01 - Starting the local server 5:19 - API sanity check with curl 6:08 - Installing the Pi coding agent 6:20 - Configuring models.json for local models 8:20 - First run: selecting the model in Pi 8:58 - Fixing the context length error 10:16 - Testing the working setup 10:50 - What is coming in Part 2

i tested a fully local ai coding setup: gemma4 from Google DeepMind running through LM Studio, paired with pi which is a minimal open source coding harness this is part 1 of a two part series. here we cover the why and the complete hands-on setup 0:00 - Running a coding agent fully local 0:47 - Why Pi as the coding agent harness 1:39 - Why Gemma 4 and which variant to pick 2:44 - Architecture: Pi, LM Studio and Gemma 4 3:45 - LM Studio setup and model download 5:01 - Starting the local server 5:19 - API sanity check with curl 6:08 - Installing the Pi coding agent 6:20 - Configuring models.json for local models 8:20 - First run: selecting the model in Pi 8:58 - Fixing the context length error 10:16 - Testing the working setup 10:50 - What is coming in Part 2

Nidhi Singh

16,289 次观看 • 2 个月前

oMLX last version seems having some issues in decoding. 🧐 Here a test with Qwen3.6-35B-A3B-MLX-6bit on M5 Max using. 🥇 LM Studio MLX 1.8.5 → 100.9 toks/s 🥈 mlx-vlm 0.6.2 → 100.1 toks/s 🥉 oMLX 0.4.2 dev3 → 58.7 toks/s 👀 Avg Gen TPS: oMLX 58.7 → LM Studio 100.9 (+71.8%) I have to thank pymike00 that raised this oMLX issue after seeing my video on using it with Codex. I bet there is a bug in oMLX chat and server at the moment, because internal benchmarks are ok, video attached. I bet Jun Kim will fix this soon 💪

oMLX last version seems having some issues in decoding. 🧐 Here a test with Qwen3.6-35B-A3B-MLX-6bit on M5 Max using. 🥇 LM Studio MLX 1.8.5 → 100.9 toks/s 🥈 mlx-vlm 0.6.2 → 100.1 toks/s 🥉 oMLX 0.4.2 dev3 → 58.7 toks/s 👀 Avg Gen TPS: oMLX 58.7 → LM Studio 100.9 (+71.8%) I have to thank pymike00 that raised this oMLX issue after seeing my video on using it with Codex. I bet there is a bug in oMLX chat and server at the moment, because internal benchmarks are ok, video attached. I bet Jun Kim will fix this soon 💪

Ivan Fioravanti ᯅ

20,066 次观看 • 2 个月前

The top question I got was does Halo support local LLM running on a Mac. Here's an example of the app using gemma-4-26b-a4b-qat via LM Studio running on a base M5/32GB. It's giving an average of 40 tok/s and in my brief testing is able to execute all tool calls correctly. Very usable with this app.

The top question I got was does Halo support local LLM running on a Mac. Here's an example of the app using gemma-4-26b-a4b-qat via LM Studio running on a base M5/32GB. It's giving an average of 40 tok/s and in my brief testing is able to execute all tool calls correctly. Very usable with this app.

Tanmay

11,682 次观看 • 2 个月前

Using Starlink and a MacBook to play Blades in the Dark with DeepSeek V4 Flash as GM running on ds4 on a remote M3 Ultra and exposed through tailscale as a service in the middle of mountains. We are living in the best era of humankind! Hey... 👋🏻 not bad the speed eh?

Using Starlink and a MacBook to play Blades in the Dark with DeepSeek V4 Flash as GM running on ds4 on a remote M3 Ultra and exposed through tailscale as a service in the middle of mountains. We are living in the best era of humankind! Hey... 👋🏻 not bad the speed eh?

Ivan Fioravanti ᯅ

12,875 次观看 • 2 个月前

NVIDIA sent us 2 DGX Sparks. For a while we wondered what we would do with them. The memory bandwidth is 273GB/s making it 3x slower than an M3 Ultra (819GB/s) for batch_size=1 inference. But it has 4x more FLOPS (100 TFLOPS compared to 26 TFLOPS). So we thought, what if we could combine the DGX Spark & M3 Ultra, and make use of both the massive compute on the DGX Spark and the massive memory-bandwidth on the M3 Ultra. We came up with a way to split inference across both devices and achieve a speedup of up to 4x for long prompts compared to the M3 Ultra on its own. Full details in the blog post linked below.

NVIDIA sent us 2 DGX Sparks. For a while we wondered what we would do with them. The memory bandwidth is 273GB/s making it 3x slower than an M3 Ultra (819GB/s) for batch_size=1 inference. But it has 4x more FLOPS (100 TFLOPS compared to 26 TFLOPS). So we thought, what if we could combine the DGX Spark & M3 Ultra, and make use of both the massive compute on the DGX Spark and the massive memory-bandwidth on the M3 Ultra. We came up with a way to split inference across both devices and achieve a speedup of up to 4x for long prompts compared to the M3 Ultra on its own. Full details in the blog post linked below.

Alex Cheema

281,225 次观看 • 10 个月前

My action part of a new short about the Wayfinder character! Very glad to have had the opportunity to work on this project with industry ultra-heroes like Joaquim Dos Santos , @barryjkelly , malcolm , Nas Pasha and other cool guys, as well as Studio Mir 스튜디오미르 !

My action part of a new short about the Wayfinder character! Very glad to have had the opportunity to work on this project with industry ultra-heroes like Joaquim Dos Santos , @barryjkelly , malcolm , Nas Pasha and other cool guys, as well as Studio Mir 스튜디오미르 !

bbwb anim

283,055 次观看 • 2 年前

CREAM was Recorded on December 3, 1990, in Paisley Park, Studio A, and released on September 9, 1991, as the second single off #DiamondsAndPearls. Subsequently, it hit #1 on the Billboard Hot 100. “Cream Take 2 reveals not only the strength of the song but also the power of Prince’s producing, as he instinctively knew what to add to “Cream” to make it a classic.“ It puts me right back with headphones, in the studio with him,” - Tommy Barbarella. Stream both versions and let us know your thoughts below! #Prince #NPGRecords

CREAM was Recorded on December 3, 1990, in Paisley Park, Studio A, and released on September 9, 1991, as the second single off #DiamondsAndPearls. Subsequently, it hit #1 on the Billboard Hot 100. “Cream Take 2 reveals not only the strength of the song but also the power of Prince’s producing, as he instinctively knew what to add to “Cream” to make it a classic.“ It puts me right back with headphones, in the studio with him,” - Tommy Barbarella. Stream both versions and let us know your thoughts below! #Prince #NPGRecords

Prince

81,404 次观看 • 3 年前

Cotton 2: Magical Night Dreams for the arcade (Success/Tecmo/1997). Nice entry in the Cotton series of shooters, running on the Sega's ST-V arcade hardware. Outstanding first boss and great artwork overall. Also available on the Saturn back then, and PS4/Switch/Steam - either as standalone or part of the Cotton Guardian Force Saturn Tribute bundle.

Cotton 2: Magical Night Dreams for the arcade (Success/Tecmo/1997). Nice entry in the Cotton series of shooters, running on the Sega's ST-V arcade hardware. Outstanding first boss and great artwork overall. Also available on the Saturn back then, and PS4/Switch/Steam - either as standalone or part of the Cotton Guardian Force Saturn Tribute bundle.

Dante retro dev 💾

20,862 次观看 • 2 个月前

On 25 July 1968, months after the first version of “While My Guitar Gently Weeps” was recorded at George’s home, he and Paul recorded the first studio acoustic version in Abbey Road’s Studio 2. Later, on 5 September, Eric Clapton joined on guitar for takes 17 to 45 and Take 25 was chosen as the master for ‘The White Album.’ You can hear 'Take 27 - Third Version' on Anthology 4 🍏

On 25 July 1968, months after the first version of “While My Guitar Gently Weeps” was recorded at George’s home, he and Paul recorded the first studio acoustic version in Abbey Road’s Studio 2. Later, on 5 September, Eric Clapton joined on guitar for takes 17 to 45 and Take 25 was chosen as the master for ‘The White Album.’ You can hear 'Take 27 - Third Version' on Anthology 4 🍏

The Beatles

71,258 次观看 • 11 个月前

For a Microdrama studio, the game isn't only a great script. It's shipping enough of them, fast enough, to find your winner as soon as possible. So we built a workflow inside Agent One that makes the production pipeline 5X faster - whether you're running a studio or an agency taking on series projects. Time, cost, exact steps - all in the video and the thread.

For a Microdrama studio, the game isn't only a great script. It's shipping enough of them, fast enough, to find your winner as soon as possible. So we built a workflow inside Agent One that makes the production pipeline 5X faster - whether you're running a studio or an agency taking on series projects. Time, cost, exact steps - all in the video and the thread.

Invideo

34,201 次观看 • 3 个月前

On this #screenshotsaturday, releasing the Silent Hill Origins modern camera mod as part of v0.04 of PS2 Cam Acolyte. You can customize the distance, etc. and it has some new controls to make dual stick gameplay easier (i.e. L2 to run). More details...🧵

On this #screenshotsaturday, releasing the Silent Hill Origins modern camera mod as part of v0.04 of PS2 Cam Acolyte. You can customize the distance, etc. and it has some new controls to make dual stick gameplay easier (i.e. L2 to run). More details...🧵

Withering Realms

14,751 次观看 • 1 年前

[Day 2] The BIGGEST misconception of AI animation. I won 3rd place in a Japanese AI film contest with my first anime. One-man studio. No funding. Just obsession. Now I’m making my second one to join a contest by Morphic and Watch the full video below and read on 🧵

[Day 2] The BIGGEST misconception of AI animation. I won 3rd place in a Japanese AI film contest with my first anime. One-man studio. No funding. Just obsession. Now I’m making my second one to join a contest by Morphic and Watch the full video below and read on 🧵

Tú Michael 🇻🇳

17,426 次观看 • 9 个月前

First video about MTPLX it works! 🔥 Gonna do my context benchmarks and some coding on it ASAP! In my very first test here: 🥇 M3 Ultra on the right: 33 --> 68 tps 🥈 M5 Max on the left: 27 --> 55 tps But M5 Max has 2 external monitors connected and is doing ton of stuff in parallel. Amazing job by Youssof Al Toukhi here!

First video about MTPLX it works! 🔥 Gonna do my context benchmarks and some coding on it ASAP! In my very first test here: 🥇 M3 Ultra on the right: 33 --> 68 tps 🥈 M5 Max on the left: 27 --> 55 tps But M5 Max has 2 external monitors connected and is doing ton of stuff in parallel. Amazing job by Youssof Al Toukhi here!

Ivan Fioravanti ᯅ

14,267 次观看 • 4 个月前