Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Running four simultaneous OpenCode agents works well with mlx_lm.server continuous batching and MiniMax M2.1 on an M3 Ultra:

awnihannun's profile picture

Awni Hannun

44,794 subscribers

95,013 görüntüleme • 5 ay önce •via X (Twitter)

Haberler & PolitikaSağlık & İyilik
LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Running Minimax M2.1 (MiniMax (official)) with OpenCode (OpenCode) and mlx_lm.server. Works quite well on an M3 Ultra. Once the KV cache is warm the prompt processing is pretty quick. And token generation is very fast.
0:41

Running Minimax M2.1 (MiniMax (official)) with OpenCode (OpenCode) and mlx_lm.server. Works quite well on an M3 Ultra. Once the KV cache is warm the prompt processing is pretty quick. And token generation is very fast.

Awni Hannun

32,329 görüntüleme • 5 ay önce

Running four high-level OpenCode agents + subagents with mlx_lm.server continuous batching and MiniMax M2.5 (6-bit). Fits easily on a 512GB M3 Ultra. Generation is quite fast. But prefill is still slow compared to cloud servers.
0:26

Running four high-level OpenCode agents + subagents with mlx_lm.server continuous batching and MiniMax M2.5 (6-bit). Fits easily on a 512GB M3 Ultra. Generation is quite fast. But prefill is still slow compared to cloud servers.

Awni Hannun

25,535 görüntüleme • 3 ay önce

MiniMax M2.1 in 4-bit cruises on an M3 Ultra with mlx-lm. Generated a space invaders game using 5098 tokens at 47.2 tok/sec:
0:23

MiniMax M2.1 in 4-bit cruises on an M3 Ultra with mlx-lm. Generated a space invaders game using 5098 tokens at 47.2 tok/sec:

Awni Hannun

93,826 görüntüleme • 5 ay önce

I wasn't expecting such an intelligence model on my local machine. Minimax 2.1 on MLX🔥 git clone cd mlx-lm && pip install -e . mlx_lm.server --model mlx-community/MiniMax-M2.1-4bit
1:14

I wasn't expecting such an intelligence model on my local machine. Minimax 2.1 on MLX🔥 git clone cd mlx-lm && pip install -e . mlx_lm.server --model mlx-community/MiniMax-M2.1-4bit

mzba

30,377 görüntüleme • 5 ay önce

I did it! It works! Using GLM-4.7-4bit with mlx_lm.server and opencode to fix real code locally! 🔥 Here single M3 Ultra 512GB, nex step phase will be 2 using Tensor Parallelism and then apply same changes to exo. Prefill is slow on a single machine, but generation is good.
1:44

I did it! It works! Using GLM-4.7-4bit with mlx_lm.server and opencode to fix real code locally! 🔥 Here single M3 Ultra 512GB, nex step phase will be 2 using Tensor Parallelism and then apply same changes to exo. Prefill is slow on a single machine, but generation is good.

Ivan Fioravanti ᯅ

44,000 görüntüleme • 5 ay önce

This is MiniMax-M2.5 MLX running in LM Studio on an Apple Mac Studio M3 Ultra 512GB. Fast enough out of the box for hosting OpenClaw, n8n workflows, and Open WebUI for the team.
0:53

This is MiniMax-M2.5 MLX running in LM Studio on an Apple Mac Studio M3 Ultra 512GB. Fast enough out of the box for hosting OpenClaw, n8n workflows, and Open WebUI for the team.

Patrick J Kennedy

73,547 görüntüleme • 3 ay önce

OpenCode + GLM-4.7-Flash 8bit. llama-server vs mlx_lm.server. Using one M3 Ultra for each host. Same prompts, you can check duration for each step in the video. Amazing experience on both side! Local coding AI model are becoming reality! 🔥
2:21

OpenCode + GLM-4.7-Flash 8bit. llama-server vs mlx_lm.server. Using one M3 Ultra for each host. Same prompts, you can check duration for each step in the video. Amazing experience on both side! Local coding AI model are becoming reality! 🔥

Ivan Fioravanti ᯅ

47,063 görüntüleme • 4 ay önce

A long time coming but new mlx-lm is here with better batching support in the server and Gemma 4. pip install -U mlx-lm Here is a video where a single M3 Ultra serves 5 opencode sessions with Gemma 4 26B that process ~130k tokens in ~1.5 minutes.
2:03

A long time coming but new mlx-lm is here with better batching support in the server and Gemma 4. pip install -U mlx-lm Here is a video where a single M3 Ultra serves 5 opencode sessions with Gemma 4 26B that process ~130k tokens in ~1.5 minutes.

Angelos Katharopoulos

66,059 görüntüleme • 2 ay önce

Next mlx-vlm release will ship with continuous batching support on the server 🚀 What's coming: → Continuous batching — new requests join the active batch immediately, no waiting. Mixed image + text batches supported → OpenAI-compatible API — field-for-field match with mlx-lm, reasoning/content split for thinking models, tag-aware streaming → Multi-turn tool calling — full tool use support across streaming and non-streaming, works with Gemma4 and other templates → Vision feature caching — cache image embeddings across turns. Gemma4: 228x speedup, Qwen3.5: 23x on cache hit All running locally on Apple Silicon. Check our this demo running 4 concurrent requests (mixed image + text) to gemma-4-26B-A4B-IT by Google Gemma in bf16 using Pi + MLX-VLM server on my M3 Ultra. One of the requests ingests a 8K resolution image!
0:52

Next mlx-vlm release will ship with continuous batching support on the server 🚀 What's coming: → Continuous batching — new requests join the active batch immediately, no waiting. Mixed image + text batches supported → OpenAI-compatible API — field-for-field match with mlx-lm, reasoning/content split for thinking models, tag-aware streaming → Multi-turn tool calling — full tool use support across streaming and non-streaming, works with Gemma4 and other templates → Vision feature caching — cache image embeddings across turns. Gemma4: 228x speedup, Qwen3.5: 23x on cache hit All running locally on Apple Silicon. Check our this demo running 4 concurrent requests (mixed image + text) to gemma-4-26B-A4B-IT by Google Gemma in bf16 using Pi + MLX-VLM server on my M3 Ultra. One of the requests ingests a 8K resolution image!

Prince Canuma

82,085 görüntüleme • 1 ay önce

Notion Lite, one-shot by M2.1 on MiniMax Agent ✨ Fully playable:
0:24

Notion Lite, one-shot by M2.1 on MiniMax Agent ✨ Fully playable:

Skyler Miao

14,918 görüntüleme • 5 ay önce

MiniMax M2.1 vs Opus 4.5 vs GLM-4.7 built an interactive 3D solar system from scratch. Running on 3 Claude Code in parallel. The winner is: 🥇 GLM-4.7! 🥈 Opus 4.5 (slowest) 🥉 M2.1 (fastest) GLM-4.7 design capabilities are another level vs 4.6!
0:48

MiniMax M2.1 vs Opus 4.5 vs GLM-4.7 built an interactive 3D solar system from scratch. Running on 3 Claude Code in parallel. The winner is: 🥇 GLM-4.7! 🥈 Opus 4.5 (slowest) 🥉 M2.1 (fastest) GLM-4.7 design capabilities are another level vs 4.6!

Ivan Fioravanti ᯅ

81,630 görüntüleme • 5 ay önce

INCREDIBLE SPEED running Claude Code w/ local models on my own GPUs at home > SGLang serving MiniMax-M2.1 > on 8x RTX 3090s > nvtop showing live GPU load > Claude Code generating code + docs > end-2-end on my AI cluster MiniMax-M2.1 is my favorite model to run locally nowadays
3:28

INCREDIBLE SPEED running Claude Code w/ local models on my own GPUs at home > SGLang serving MiniMax-M2.1 > on 8x RTX 3090s > nvtop showing live GPU load > Claude Code generating code + docs > end-2-end on my AI cluster MiniMax-M2.1 is my favorite model to run locally nowadays

Ahmad

592,866 görüntüleme • 4 ay önce

A perfect coding model for MLX on Apple silicon.. Qwen delivered again. Runs quite fast on an M3 Ultra. Running the 4-bit quantized with mlx-lm:
0:50

A perfect coding model for MLX on Apple silicon.. Qwen delivered again. Runs quite fast on an M3 Ultra. Running the 4-bit quantized with mlx-lm:

Awni Hannun

186,641 görüntüleme • 10 ay önce

We ran the same prompt and identical starting context on MiniMax-M2.1 and Claude Sonnet 4.5. MiniMax-M2.1 by MiniMax (official) reached a usable result faster, required fewer structural fixes, and produced a more consistent visual and interaction flow from the first pass. To test this properly, we asked both models to build a complex single-page web animation with real-world visual and physics constraints. Comparison video below 👇
0:36

We ran the same prompt and identical starting context on MiniMax-M2.1 and Claude Sonnet 4.5. MiniMax-M2.1 by MiniMax (official) reached a usable result faster, required fewer structural fixes, and produced a more consistent visual and interaction flow from the first pass. To test this properly, we asked both models to build a complex single-page web animation with real-world visual and physics constraints. Comparison video below 👇

GitHub Projects Community

29,252 görüntüleme • 5 ay önce

You can use a 100% open source and MUCH cheaper/free alternative to Claude Code and Opus 4.5 OpenCode + MiniMax M2.1 can even build a 3D website using pure vibe coding. Steps are really simple: 1. Install OpenCode using the command 'npm i -g opencode-ai' 2. Get your MiniMax API key here: 3. Configure the MiniMax (official) mode Just type "opencode connect minimax" Coding plans start at $2… 10x cheaper than Claude Code (yes). You can also invite friends so they can get 10% off and you’ll get 10% API credits. (You can also use it locally if you have the config) And you're ready to build and iterate almost endlessly since the model is both way faster and cheaper than Opus in CC.
12:07

You can use a 100% open source and MUCH cheaper/free alternative to Claude Code and Opus 4.5 OpenCode + MiniMax M2.1 can even build a 3D website using pure vibe coding. Steps are really simple: 1. Install OpenCode using the command 'npm i -g opencode-ai' 2. Get your MiniMax API key here: 3. Configure the MiniMax (official) mode Just type "opencode connect minimax" Coding plans start at $2… 10x cheaper than Claude Code (yes). You can also invite friends so they can get 10% off and you’ll get 10% API credits. (You can also use it locally if you have the config) And you're ready to build and iterate almost endlessly since the model is both way faster and cheaper than Opus in CC.

Paul Couvert

42,443 görüntüleme • 5 ay önce

GLM-4.7-8bit (350GB) running at 19 toks/s on two M3 Ultra 512GB using Tensor Parallelism with EXO - MLX, versus 14 toks/s with single node. 🚀 Now context benchmarking & then OpenCode tests 🔥 Note: this is from sources, I had to change things to run it.
0:50

GLM-4.7-8bit (350GB) running at 19 toks/s on two M3 Ultra 512GB using Tensor Parallelism with EXO - MLX, versus 14 toks/s with single node. 🚀 Now context benchmarking & then OpenCode tests 🔥 Note: this is from sources, I had to change things to run it.

Ivan Fioravanti ᯅ

327,687 görüntüleme • 5 ay önce

i built an ipod inspired yt music desktop client using MiniMax (official) and opencode in 1 night 100% rust. check it out
0:45

i built an ipod inspired yt music desktop client using MiniMax (official) and opencode in 1 night 100% rust. check it out

shydev

15,971 görüntüleme • 4 ay önce

🔥DeepSeek-v3-0324-8bit (~700GB) running on 2 x M3 Ultra 512GB ~12 tokens/sec Here the video!
0:25

🔥DeepSeek-v3-0324-8bit (~700GB) running on 2 x M3 Ultra 512GB ~12 tokens/sec Here the video!

Ivan Fioravanti ᯅ

19,761 görüntüleme • 1 yıl önce

Yo LinkedIn, idk why you are paying $100k to developers i just rebuilt it with a single prompt using MiniMax M2.1 with BLACKBOX AI
0:39

Yo LinkedIn, idk why you are paying $100k to developers i just rebuilt it with a single prompt using MiniMax M2.1 with BLACKBOX AI

Karthik

426,081 görüntüleme • 5 ay önce

ICYMI: CyOps Arena is now live, co-hosted with MiniMax (official). With a $5,000 prize pool and 80% off MiniMax M3 model token pricing, there's never been a better time to start building. New to CyOps? Watch this quick tutorial and get your first project up and running in minutes 👇
1:02

ICYMI: CyOps Arena is now live, co-hosted with MiniMax (official). With a $5,000 prize pool and 80% off MiniMax M3 model token pricing, there's never been a better time to start building. New to CyOps? Watch this quick tutorial and get your first project up and running in minutes 👇

Cysic

12,366 görüntüleme • 1 gün önce