正在加载视频...

视频加载失败

返回首页

Running mlx optimized models is easy 🙂

ai_christianson's profile picture

Andrew I. Christianson

1,810 subscribers

33,437 次观看 • 1 年前 •via X (Twitter)

健康养生科学技术教育
LIVE

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Run the latest Ministral 3 models by Mistral AI on macOS. Running privately on-device and optimized for Apple Silicon with MLX.
0:20

Run the latest Ministral 3 models by Mistral AI on macOS. Running privately on-device and optimized for Apple Silicon with MLX.

Locally AI - Local AI Chat

34,901 次观看 • 8 个月前

The new Qwen 3.5 by Qwen running on-device on iPhone 17 Pro. Qwen 3.5 beats models 4 times its size, has strong visual understanding, and can toggle reasoning on or off. The 2B 6-bit model here is running with MLX optimized for Apple Silicon.
0:25

The new Qwen 3.5 by Qwen running on-device on iPhone 17 Pro. Qwen 3.5 beats models 4 times its size, has strong visual understanding, and can toggle reasoning on or off. The 2B 6-bit model here is running with MLX optimized for Apple Silicon.

Adrien Grondin

3,558,786 次观看 • 6 个月前

Alibaba’s Qwen 3.5 is now running fully on-device on the iPhone 17 Pro. It outperforms models 4x its size, delivers strong visual understanding, and lets you switch reasoning on or off. This demo uses the 2B 6-bit version, optimized with MLX for Apple Silicon.
0:24

Alibaba’s Qwen 3.5 is now running fully on-device on the iPhone 17 Pro. It outperforms models 4x its size, delivers strong visual understanding, and lets you switch reasoning on or off. This demo uses the 2B 6-bit version, optimized with MLX for Apple Silicon.

Hugging Models

203,055 次观看 • 5 个月前

🔴 The Pain: Running local MLX models is incredibly fast and private. But let's be real - testing tool calling via terminal is clunky, and there's zero good UI for it. 🟢 The Fix: rapid-mlx share Just ONE command gives you a polished web chat + seamless tool calling (works beautifully with gemma-4-12b-qat). We are proud to be the ONLY MLX inference engine in the community shipping this. ⚡️ 👇 Try it now: brew install raullenchai/rapid-mlx/rapid-mlx
0:40

🔴 The Pain: Running local MLX models is incredibly fast and private. But let's be real - testing tool calling via terminal is clunky, and there's zero good UI for it. 🟢 The Fix: rapid-mlx share Just ONE command gives you a polished web chat + seamless tool calling (works beautifully with gemma-4-12b-qat). We are proud to be the ONLY MLX inference engine in the community shipping this. ⚡️ 👇 Try it now: brew install raullenchai/rapid-mlx/rapid-mlx

raullen

22,765 次观看 • 3 个月前

Update: Qwen3.5:9b head-to-head (MLX, Apple Silicon optimized) Mac Studio M2 Ultra: 89.74 tok/s Mac Mini M4: 20.82 tok/s MLX basically doubles the speed on both machines.
1:02

Update: Qwen3.5:9b head-to-head (MLX, Apple Silicon optimized) Mac Studio M2 Ultra: 89.74 tok/s Mac Mini M4: 20.82 tok/s MLX basically doubles the speed on both machines.

stevibe

134,256 次观看 • 6 个月前

Day 1 of 3 MLX Releases: Introducing MLX-Audio 🚀🔥 A text-to-speech (TTS) and Speech-to-Speech (STS) library built on Apple's MLX framework, providing efficient speech synthesis on Apple Silicon. Features ⚡️Fast inference on Apple Silicon (M series chips) 🤖Multiple language support 🗣️Voice customization options 🚀Quantization support for optimized performance Supported models: 🪶Kokoro - A multilingual TTS model with 82M params that supports various languages and voice styles. With more models coming soon. Get started: > pip install mlx-audio Please leave us a star and send a PR :)
4:07

Day 1 of 3 MLX Releases: Introducing MLX-Audio 🚀🔥 A text-to-speech (TTS) and Speech-to-Speech (STS) library built on Apple's MLX framework, providing efficient speech synthesis on Apple Silicon. Features ⚡️Fast inference on Apple Silicon (M series chips) 🤖Multiple language support 🗣️Voice customization options 🚀Quantization support for optimized performance Supported models: 🪶Kokoro - A multilingual TTS model with 82M params that supports various languages and voice styles. With more models coming soon. Get started: > pip install mlx-audio Please leave us a star and send a PR :)

Prince Canuma

123,553 次观看 • 1 年前

Rapid-MLX 0.13.0 is out 🚀 Rapid-MLX 0.13.0 is officially here! 🚀 Run massive models locally on your Mac with sub-second replies and side-by-side dictation + chat. 100% on-device. 100% MLX. Get it now via DMG or CLI: - - curl -fsSL | bash
0:58

Rapid-MLX 0.13.0 is out 🚀 Rapid-MLX 0.13.0 is officially here! 🚀 Run massive models locally on your Mac with sub-second replies and side-by-side dictation + chat. 100% on-device. 100% MLX. Get it now via DMG or CLI: - - curl -fsSL | bash

Rapid-MLX · local AI on your Mac

31,461 次观看 • 14 天前

I’ve been using the new MacBook Pro M5 since launch and it’s a beast, especially compared to my old M1! It’s good for running the smaller AI models locally but also everything you do is just so fast. Here’s Gemma 3 QAT 12B running with MLX:
0:35

I’ve been using the new MacBook Pro M5 since launch and it’s a beast, especially compared to my old M1! It’s good for running the smaller AI models locally but also everything you do is just so fast. Here’s Gemma 3 QAT 12B running with MLX:

Adrien Grondin

101,950 次观看 • 9 个月前

M5 Max + ACE-Step v1.5 + MLX = 20 seconds to generate incredible music, commercial ready and locally generated 🤯 There is a native MLX backend in the repo, super easy to use! 🧵 Audio on!
1:27

M5 Max + ACE-Step v1.5 + MLX = 20 seconds to generate incredible music, commercial ready and locally generated 🤯 There is a native MLX backend in the repo, super easy to use! 🧵 Audio on!

Ivan Fioravanti ᯅ

15,919 次观看 • 5 个月前

phone bank with us🙂 it’s easy to get started🙂 and it’s fun🙂 now is the perfect time🙂
0:34

phone bank with us🙂 it’s easy to get started🙂 and it’s fun🙂 now is the perfect time🙂

Dr. Abdul El-Sayed

46,094 次观看 • 2 个月前

Llama 3 running locally on iPhone with MLX Built by exo intern team Mohamed Baioumy h/t Awni Hannun MLX & Prince Canuma for the port
0:24

Llama 3 running locally on iPhone with MLX Built by exo intern team Mohamed Baioumy h/t Awni Hannun MLX & Prince Canuma for the port

Alex Cheema

295,873 次观看 • 2 年前

Kimi K2.6 was released 1h ago, and it looks amazing! Here it's running with MLX (mlx-vlm) on two M3 Ultras (full 1T param VLM) 🔥
0:23

Kimi K2.6 was released 1h ago, and it looks amazing! Here it's running with MLX (mlx-vlm) on two M3 Ultras (full 1T param VLM) 🔥

Pedro Cuenca

65,768 次观看 • 4 个月前

Hunter Solo 2 Phase Locus of the Wailing Grief: I suggest using this strat to anyone running Solo Flawless, pretty easy 3 phase even if not optimized.
3:48

Hunter Solo 2 Phase Locus of the Wailing Grief: I suggest using this strat to anyone running Solo Flawless, pretty easy 3 phase even if not optimized.

Saltagreppo

124,294 次观看 • 2 年前

A perfect coding model for MLX on Apple silicon.. Qwen delivered again. Runs quite fast on an M3 Ultra. Running the 4-bit quantized with mlx-lm:
0:50

A perfect coding model for MLX on Apple silicon.. Qwen delivered again. Runs quite fast on an M3 Ultra. Running the 4-bit quantized with mlx-lm:

Awni Hannun

186,772 次观看 • 1 年前

QWEN 3.5 4b MLX running locally with a milk avatar Model by ToxSam
0:29

QWEN 3.5 4b MLX running locally with a milk avatar Model by ToxSam

tensorfish

125,990 次观看 • 6 个月前

Running Qwen3 8B thinking on an iPhone Air with MLX. The model is quantized to 4-bit and runs pretty well.
0:45

Running Qwen3 8B thinking on an iPhone Air with MLX. The model is quantized to 4-bit and runs pretty well.

Awni Hannun

215,597 次观看 • 11 个月前

As part of our goal to make MLX a great research tool, we're expanding support to new languages like Swift and C, making experimentation on Apple silicon easier for ML researchers. Video generating text with Mistral 7B and MLX Swift 👇 MLX is an array framework for machine learning research on Apple silicon. MLX is intended for research and not for production deployment of models in apps.
0:56

As part of our goal to make MLX a great research tool, we're expanding support to new languages like Swift and C, making experimentation on Apple silicon easier for ML researchers. Video generating text with Mistral 7B and MLX Swift 👇 MLX is an array framework for machine learning research on Apple silicon. MLX is intended for research and not for production deployment of models in apps.

Awni Hannun

88,781 次观看 • 2 年前

Being girl is not easy right now 🙂🤕
0:34

Being girl is not easy right now 🙂🤕

Gautam (Parody)

10,256 次观看 • 7 个月前