mlx distributed uses mpi for machine to machine communication, and this is how you can handle uneven distribution of model layers. Thanks Awni Hannun for the help

@awnihannun v interesting, would love to know how it was ordering the machines before you specified it in the rank file. would be funny if it was just sorting the host names 😅

@awnihannun the mysteries of mpi.

Can Machine Learning beat the market? Check out this post on my free Substack where I share code and commentary for an XGBoost model and a Random Forest model that both deliver powerful performances.

@awnihannun Repo Prompt! ❤️ cc @pvncher

@awnihannun thanks for sharing! Great question for you, m3 ultra 512 vs multiple Mac mini m4 with the same budget, which option is better for LLM context?

@awnihannun Awesome!

@awnihannun @Apple engineering should be ashamed.

@awnihannun I love these mini racks.

@awnihannun yep It’s a DeskPi- @Mandy_Li888

@awnihannun Tell us more about the technical aspects, if you want!

@awnihannun love to see it