正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

No-one: But can you do 16 generations on your M4 laptop simultaneously? MLX LM:

Awni Hannun

44,815 subscribers

46,777 次观看 • 1 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Got continuous batching working with SSMs in mlx-lm. Here's four OpenCode agents simultaneously running Nvidia's Nemotron Nano on 64GB M4 Max. This is a nice model for smaller machines since it's MoE + hybrid attention (small cache).

Got continuous batching working with SSMs in mlx-lm. Here's four OpenCode agents simultaneously running Nvidia's Nemotron Nano on 64GB M4 Max. This is a nice model for smaller machines since it's MoE + hybrid attention (small cache).

Awni Hannun

35,231 次观看 • 8 个月前

One of the coolest uses of LM Studio and AI at AMD is using LM Link to have a Framework Desktop be a remote inference server for a laptop, including something little like Framework Laptop 12. It feels native on the laptop, but gets the desktop’s performance.

One of the coolest uses of LM Studio and AI at AMD is using LM Link to have a Framework Desktop be a remote inference server for a laptop, including something little like Framework Laptop 12. It feels native on the laptop, but gets the desktop’s performance.

Framework

39,175 次观看 • 7 个月前

LM Studio 0.3.4 ships with Apple MLX 🚢🍎 Run on-device LLMs super fast, 100% locally and offline on your Apple Silicon Mac! Includes: > run Llama 3.2 1B at ~250 tok/sec (!) on M3 > enforce structured JSON responses > use via chat UI, or from your own code > run multiple models simultaneously > download any model from Hugging Face Video at 1x speed.

LM Studio 0.3.4 ships with Apple MLX 🚢🍎 Run on-device LLMs super fast, 100% locally and offline on your Apple Silicon Mac! Includes: > run Llama 3.2 1B at ~250 tok/sec (!) on M3 > enforce structured JSON responses > use via chat UI, or from your own code > run multiple models simultaneously > download any model from Hugging Face Video at 1x speed.

LM Studio

171,841 次观看 • 2 年前

Mac owners don't miss this: MLX LM is now integrated directly within Hugging Face 🤯 ⬇️ Run 4,400+ LLMs locally on Apple Silicon at max speed, no cloud, no wait.

Mac owners don't miss this: MLX LM is now integrated directly within Hugging Face 🤯 ⬇️ Run 4,400+ LLMs locally on Apple Silicon at max speed, no cloud, no wait.

Victor M

204,678 次观看 • 1 年前

You can solo mine with your Braiins Mini Miner, but DOES IT RUN DOOM?! Mine and game simultaneously.

You can solo mine with your Braiins Mini Miner, but DOES IT RUN DOOM?! Mine and game simultaneously.

Braiins

49,639 次观看 • 2 年前

Chatterbox Turbo by Resemble AI now on MLX 🚀🎉 You can now run it locally on your Mac and it supports voice cloning and emotion control. I'm getting 3.8x faster than real-time. > pip install -U mlx-audio Model collection 👇🏽

Chatterbox Turbo by Resemble AI now on MLX 🚀🎉 You can now run it locally on your Mac and it supports voice cloning and emotion control. I'm getting 3.8x faster than real-time. > pip install -U mlx-audio Model collection 👇🏽

Prince Canuma

24,953 次观看 • 9 个月前

🚨 BREAKING: Apple just acquired Meta's SAM team! On-device segmentation now ships natively in macOS 26.x This is what it looks like when you run SAM3 on MLX locally. Every car. Every fire. Real-time. M2 laptop. No cloud.

🚨 BREAKING: Apple just acquired Meta's SAM team! On-device segmentation now ships natively in macOS 26.x This is what it looks like when you run SAM3 on MLX locally. Every car. Every fire. Real-time. M2 laptop. No cloud.

Maziyar PANAHI

329,986 次观看 • 6 个月前

Elevenlabs-level TTS on your laptop. I'm always skeptical about new AI models hyped up sounding too good to be true. But this...is crazy good. And now, you can run the gradio app by tyler on your laptop with 1 click. Meet Elon Musk, from Silicon Valley.

Elevenlabs-level TTS on your laptop. I'm always skeptical about new AI models hyped up sounding too good to be true. But this...is crazy good. And now, you can run the gradio app by tyler on your laptop with 1 click. Meet Elon Musk, from Silicon Valley.

cocktail peanut

225,020 次观看 • 2 年前

You can now toggle device view in v0. Preview your generations on desktop, tablet, and mobile.

You can now toggle device view in v0. Preview your generations on desktop, tablet, and mobile.

v0

43,513 次观看 • 1 年前

This tool lets you face-swap on a live webcam in real-time using just one photo. zoom calls, omegle, livestreams.. you can be literally anyone. 93k stars on github. runs on your laptop. 100% free.

This tool lets you face-swap on a live webcam in real-time using just one photo. zoom calls, omegle, livestreams.. you can be literally anyone. 93k stars on github. runs on your laptop. 100% free.

How To Prompt

42,880 次观看 • 3 个月前

you can do it too, no one will judge you

you can do it too, no one will judge you

Yuna 🎀✨ VA & Artist

20,458 次观看 • 1 年前

Principle 9: “You are responsible for becoming whole.” Jung never promised comfort. He promised responsibility. No one can individuate for you. But if you do the work, your life becomes internally aligned, and you prosper.

Principle 9: “You are responsible for becoming whole.” Jung never promised comfort. He promised responsibility. No one can individuate for you. But if you do the work, your life becomes internally aligned, and you prosper.

Lorwen C Nagle, PhD

51,666 次观看 • 9 个月前

Your boss says if you're late one more time you're fired, but you see her on the way in. What do you do?

Your boss says if you're late one more time you're fired, but you see her on the way in. What do you do?

Anthony

112,934 次观看 • 3 个月前

Pretty sure you still have your gloves on heard… no one is a chicken but you 😂😂

Pretty sure you still have your gloves on heard… no one is a chicken but you 😂😂

Glasgow Clan Updates🏒

21,502 次观看 • 8 个月前