正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

mlx distributed uses mpi for machine to machine communication, and this is how you can handle uneven distribution of model layers. Thanks Awni Hannun for the help

Alex Ziskind

9,650 subscribers

31,265 次观看 • 1 年前 •via X (Twitter)

游戏科学技术教育

Anya Rossi• Live Now

Private livecam show

11 条评论

abdou 的头像

abdou1 年前

@awnihannun v interesting, would love to know how it was ordering the machines before you specified it in the rank file. would be funny if it was just sorting the host names 😅

Alex Ziskind 的头像

Alex Ziskind1 年前

@awnihannun the mysteries of mpi.

Rainmaker 的头像

Rainmaker2 年前

Can Machine Learning beat the market? Check out this post on my free Substack where I share code and commentary for an XGBoost model and a Random Forest model that both deliver powerful performances.

Mason James.3.2-12b_q4_K_S 的头像

Mason James.3.2-12b_q4_K_S1 年前

@awnihannun Repo Prompt! ❤️ cc @pvncher

Art Friedman 的头像

Art Friedman1 年前

@awnihannun thanks for sharing! Great question for you, m3 ultra 512 vs multiple Mac mini m4 with the same budget, which option is better for LLM context?

Joe Burnett 的头像

Joe Burnett1 年前

@awnihannun Awesome!

Mid Season Group 的头像

Mid Season Group1 年前

@awnihannun @Apple engineering should be ashamed.

Leonard Sullivan 的头像

Leonard Sullivan1 年前

@awnihannun I love these mini racks.

Alex Ziskind 的头像

Alex Ziskind1 年前

@awnihannun yep It’s a DeskPi- @Mandy_Li888

moskstraumen 的头像

moskstraumen1 年前

@awnihannun Tell us more about the technical aspects, if you want!

CodeBreaker 的头像

CodeBreaker1 年前

@awnihannun love to see it

相关视频

Your Mac is about to run inference like a datacenter. Coming soon to MLX-Swift: Continuous batching: the fastest way to handle multiple inference streams locally. It starts with regular inference and seamlessly upgrades to batched mode when new requests arrive. The best of both worlds. Based on the work of and Awni Hannun

Your Mac is about to run inference like a datacenter. Coming soon to MLX-Swift: Continuous batching: the fastest way to handle multiple inference streams locally. It starts with regular inference and seamlessly upgrades to batched mode when new requests arrive. The best of both worlds. Based on the work of and Awni Hannun

Ronald Mannak

60,570 次观看 • 9 个月前

oMLX is working really well as single machine inference engine for coding agents! Caching is managed perfectly (it can use a ton of disk space, be aware!) and oQ quantization delivers great results. Behind the scenes it uses the standard MLX building blocks (75% created by Prince Canuma 🙏): - mlx-lm - mlx-vlm - mlx-embeddings - mlx-audio I tested Qwen3.6-35B-A3B-oQ6 on M5 Max with two pi instances and it was fast and furious and leveraging cache like crazy as you can see in the video. Let me try to create some oQ versions (2,4,6?) of MiniMax M2.7 now and then I'll pass to distributed inference. I must win! 💪

oMLX is working really well as single machine inference engine for coding agents! Caching is managed perfectly (it can use a ton of disk space, be aware!) and oQ quantization delivers great results. Behind the scenes it uses the standard MLX building blocks (75% created by Prince Canuma 🙏): - mlx-lm - mlx-vlm - mlx-embeddings - mlx-audio I tested Qwen3.6-35B-A3B-oQ6 on M5 Max with two pi instances and it was fast and furious and leveraging cache like crazy as you can see in the video. Let me try to create some oQ versions (2,4,6?) of MiniMax M2.7 now and then I'll pass to distributed inference. I must win! 💪

Ivan Fioravanti ᯅ

19,420 次观看 • 3 个月前

For the chest and lapels, these layers can be attached to each other using a single-needle roll-padding machine, such as you see here. This is what you'll typically see on factory-made suits (this is a Strobel KA-ED machine). Happens both on the low- and high-end.

For the chest and lapels, these layers can be attached to each other using a single-needle roll-padding machine, such as you see here. This is what you'll typically see on factory-made suits (this is a Strobel KA-ED machine). Happens both on the low- and high-end.

derek guy

257,848 次观看 • 1 年前

How many of you can drag start this Lister machine? One of my uncles who owns a grinder machine shop has the machine collected the turner and it hit his shin Broke immediately - he never walk straight again. That machine is very dangerous ❌

How many of you can drag start this Lister machine? One of my uncles who owns a grinder machine shop has the machine collected the turner and it hit his shin Broke immediately - he never walk straight again. That machine is very dangerous ❌

NaijaFarmer

293,393 次观看 • 1 年前

As part of our goal to make MLX a great research tool, we're expanding support to new languages like Swift and C, making experimentation on Apple silicon easier for ML researchers. Video generating text with Mistral 7B and MLX Swift 👇 MLX is an array framework for machine learning research on Apple silicon. MLX is intended for research and not for production deployment of models in apps.

As part of our goal to make MLX a great research tool, we're expanding support to new languages like Swift and C, making experimentation on Apple silicon easier for ML researchers. Video generating text with Mistral 7B and MLX Swift 👇 MLX is an array framework for machine learning research on Apple silicon. MLX is intended for research and not for production deployment of models in apps.

Awni Hannun

88,767 次观看 • 2 年前

You asked for it and now you can get @CoryWong's Clean Machine pickups today! Clean Machine pickups are overwound and carefully voiced to meet the demands of all disciples of funk and soul. Get "Clean Machine" pickups today: #SeymourDuncan #CoryWong

You asked for it and now you can get @CoryWong's Clean Machine pickups today! Clean Machine pickups are overwound and carefully voiced to meet the demands of all disciples of funk and soul. Get "Clean Machine" pickups today: #SeymourDuncan #CoryWong

Seymour Duncan

56,208 次观看 • 3 年前

Is Hitting Off the Machine Messing You Up? Listen to Nate Headley talk about how the velo machine isn’t good for everyone and how sometimes putting it on changeup or offspeed can get your better, more natural moves to show up🗣️

Is Hitting Off the Machine Messing You Up? Listen to Nate Headley talk about how the velo machine isn’t good for everyone and how sometimes putting it on changeup or offspeed can get your better, more natural moves to show up🗣️

108 Performance

13,303 次观看 • 6 个月前

$TE is trying to become the face of American solar manufacturing. Its Stage 3 layer assembly process uses 182 robots across 5 layers to build solar modules with machine-level precision designed for decades of real-world performance.

$TE is trying to become the face of American solar manufacturing. Its Stage 3 layer assembly process uses 182 robots across 5 layers to build solar modules with machine-level precision designed for decades of real-world performance.

Shay Boloor

196,618 次观看 • 2 个月前

Check out the actual speed (not yet the final version) of Qwen3-Next-80B-A3B-Instruct on Apple MLX! 🔥 4-bit: 67 TPS 8-bit: 58 TPS bf16: 48 TPS Movie normal speed, only waiting times removed. Awni Hannun and Gökdeniz Gülmez did it and I bet there is still room for improvement 💪

Check out the actual speed (not yet the final version) of Qwen3-Next-80B-A3B-Instruct on Apple MLX! 🔥 4-bit: 67 TPS 8-bit: 58 TPS bf16: 48 TPS Movie normal speed, only waiting times removed. Awni Hannun and Gökdeniz Gülmez did it and I bet there is still room for improvement 💪

Ivan Fioravanti ᯅ

15,946 次观看 • 11 个月前

For future founders: Don’t be a cog in a machine. The machine wants you to be a cog but that’s a choice and you don’t have to give in. Be a polymath that can do many things. The world will pay 1000X more for founders who can *build* the machine.

For future founders: Don’t be a cog in a machine. The machine wants you to be a cog but that’s a choice and you don’t have to give in. Be a polymath that can do many things. The world will pay 1000X more for founders who can build the machine.

Garry Tan

357,758 次观看 • 2 年前

Elon Is Betting Every Company He Owns On One Machine. Thanks to David Carbutt and team for the edit.

Elon Is Betting Every Company He Owns On One Machine. Thanks to David Carbutt and team for the edit.

Farzad 🇺🇸 🇮🇷

40,458 次观看 • 20 天前

This is how an amazing cutting machine designed for food processors can simplify work: it's incredibly efficient and truly impressive.

This is how an amazing cutting machine designed for food processors can simplify work: it's incredibly efficient and truly impressive.

Jean Claude NIYOMUGABO

17,657,168 次观看 • 1 年前

#WATCH | Delhi: Chief Election Commissioner Gyanesh Kumar says, "The machine-readable voter list is prohibited. This decision of the Election Commission is after the judgment of the Supreme Court and is from 2019." "We have to understand the difference between a machine-readable voter list and a searchable voter list. You can search the voter list available on the Election Commission website by entering the EPIC number. You can also download it. This is not called machine-readable. Regarding machine-readable, in 2019, the Supreme Court also studied this subject in depth and found that giving a machine-readable electoral roll can violate the privacy of the voter... The machine-readable voter list is prohibited. This decision of the Election Commission is after the judgment of the Supreme Court and is from 2019..."

#WATCH | Delhi: Chief Election Commissioner Gyanesh Kumar says, "The machine-readable voter list is prohibited. This decision of the Election Commission is after the judgment of the Supreme Court and is from 2019." "We have to understand the difference between a machine-readable voter list and a searchable voter list. You can search the voter list available on the Election Commission website by entering the EPIC number. You can also download it. This is not called machine-readable. Regarding machine-readable, in 2019, the Supreme Court also studied this subject in depth and found that giving a machine-readable electoral roll can violate the privacy of the voter... The machine-readable voter list is prohibited. This decision of the Election Commission is after the judgment of the Supreme Court and is from 2019..."

ANI

281,884 次观看 • 11 个月前

FURRY ART IN AN ACTUAL ARCADE MACHINE??? YOU BET!!! And now I'm wondering how I can abuse this feature~ Now that this little machine is working again I'm using it for ONLY THE BEST PURPOSES 🦊🎨🖼️♥️ (You can also play it at AnthroExpo 2026: Corporate Takeover ~)

Sensitive content

FURRY ART IN AN ACTUAL ARCADE MACHINE??? YOU BET!!! And now I'm wondering how I can abuse this feature~ Now that this little machine is working again I'm using it for ONLY THE BEST PURPOSES 🦊🎨🖼️♥️ (You can also play it at AnthroExpo 2026: Corporate Takeover ~)

Tokens 🔜 GOH @ AnthroExpo

20,890 次观看 • 1 年前