正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Distributed training on M4 Mac Mini cluster We implemented Google DeepMind DiLoCo on Apple Silicon to train large models with 100-1000x less bandwidth compared to DDP baseline. AI is entering a new era where a distributed network of consumer devices can train large models.

EXO Labs

50,982 subscribers

347,655 次观看 • 1 年前 •via X (Twitter)

教育科学技术

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Running DeepSeek-V3 on M4 Mac Mini AI Cluster 671B MoE model distributed across 8 M4 Pro 64GB Mac Minis. Apple Silicon with unified memory is a great fit for MoE.

Running DeepSeek-V3 on M4 Mac Mini AI Cluster 671B MoE model distributed across 8 M4 Pro 64GB Mac Minis. Apple Silicon with unified memory is a great fit for MoE.

EXO Labs

719,005 次观看 • 1 年前

M4 Mac Mini AI Cluster Uses EXO Labs with Thunderbolt 5 interconnect (80Gbps) to run LLMs distributed across 4 M4 Pro Mac Minis. The cluster is small (iPhone for reference). It’s running Nemotron 70B at 8 tok/sec and scales to Llama 405B (benchmarks soon).

M4 Mac Mini AI Cluster Uses EXO Labs with Thunderbolt 5 interconnect (80Gbps) to run LLMs distributed across 4 M4 Pro Mac Minis. The cluster is small (iPhone for reference). It’s running Nemotron 70B at 8 tok/sec and scales to Llama 405B (benchmarks soon).

Alex Cheema

3,515,929 次观看 • 1 年前

if you’re confused about how large language models work this new animation from google deepmind should clear a lot of things up

if you’re confused about how large language models work this new animation from google deepmind should clear a lot of things up

anton 🇺🇸

874,050 次观看 • 2 年前

Preparing to run the new Llama 3.3 70B on my mac cluster. Downloading model shards onto 3 x M4 Pro Mac Mini and 1 x M3 Max MacBook Pro. AI cluster is connected by Gigabit ethernet switch with EXO Labs

Preparing to run the new Llama 3.3 70B on my mac cluster. Downloading model shards onto 3 x M4 Pro Mac Mini and 1 x M3 Max MacBook Pro. AI cluster is connected by Gigabit ethernet switch with EXO Labs

Alex Cheema

181,917 次观看 • 1 年前

Day 1: Benchmarks We ran 1000+ LLM benchmarks on real consumer devices. Data includes single-device and multi-device clusters with Tokens-Per-Second (TPS) and Time-To-First-Token (TTFT). Setups tested: 3x M4 Mac Mini cluster, iPhone 15 + S24, RTX4090 & more.

Day 1: Benchmarks We ran 1000+ LLM benchmarks on real consumer devices. Data includes single-device and multi-device clusters with Tokens-Per-Second (TPS) and Time-To-First-Token (TTFT). Setups tested: 3x M4 Mac Mini cluster, iPhone 15 + S24, RTX4090 & more.

EXO Labs

254,968 次观看 • 1 年前

Presenting the world’s first autonomous, on-demand data network for specialized AI models. Turf DevNet is live on the Avalanche🔺 network🔺 Builders can now use contextual Data Feeds to train smarter AI 🧵

Presenting the world’s first autonomous, on-demand data network for specialized AI models. Turf DevNet is live on the Avalanche🔺 network🔺 Builders can now use contextual Data Feeds to train smarter AI 🧵

TURF

15,139 次观看 • 1 年前

Artificial Intelligence (#AI) models that process and interpret visual data are called large vision models. These models, like large language models, are trained on large amounts of data. #midjourney #dalle #stablediffusion (1/8) 🧵 ⤵️

Artificial Intelligence (#AI) models that process and interpret visual data are called large vision models. These models, like large language models, are trained on large amounts of data. #midjourney #dalle #stablediffusion (1/8) 🧵 ⤵️

Nuklai

13,614 次观看 • 2 年前

A teaser of DeepCoreCloud! With 100+ GPUs in a high-performance cluster, we’re bringing 24/7 AI computing to the world. Train models, deploy AI, and scale without limits! DeepCoreCloud is built for innovators. The future of AI infrastructure is almost here. Are you ready? #DeepCoreCloud #ItronixAI #GPUCluster

A teaser of DeepCoreCloud! With 100+ GPUs in a high-performance cluster, we’re bringing 24/7 AI computing to the world. Train models, deploy AI, and scale without limits! DeepCoreCloud is built for innovators. The future of AI infrastructure is almost here. Are you ready? #DeepCoreCloud #ItronixAI #GPUCluster

Itronix

19,906 次观看 • 1 年前

m4 mac mini cluster with 5 nodes running exo

m4 mac mini cluster with 5 nodes running exo

Alex Ziskind

361,960 次观看 • 1 年前

🌐 Experience the Power of Edge Computing with Hyra AI! We’re scaling at microsecond speed with Train-to-Earn: ⚡ 7.5B+ AI jobs completed 📱 2.2M+ active devices 💰 528M+ $HYRA rewards distributed Join a global movement of AI builders & earners. 🍎 iOS: 📱 Android:

🌐 Experience the Power of Edge Computing with Hyra AI! We’re scaling at microsecond speed with Train-to-Earn: ⚡ 7.5B+ AI jobs completed 📱 2.2M+ active devices 💰 528M+ $HYRA rewards distributed Join a global movement of AI builders & earners. 🍎 iOS: 📱 Android:

Hyra AI

22,236 次观看 • 1 年前

you can just ▲ ai gateway models ⬩ 1 api key to rule them all ⬩ AI SDK & @openai compat ⬩ globally redundant and distributed

you can just ▲ ai gateway models ⬩ 1 api key to rule them all ⬩ AI SDK & @openai compat ⬩ globally redundant and distributed

Guillermo Rauch

71,209 次观看 • 10 个月前

The new M4 Mac Mini is sooo mini!!

The new M4 Mac Mini is sooo mini!!

iJustine

363,209 次观看 • 1 年前

Improving tropical cyclone prediction can help communities better prepare & stay safe. Developed with Google DeepMind, we're launching Weather Lab to share our AI weather prediction models, starting with the new experimental cyclone prediction model. 🧵

Improving tropical cyclone prediction can help communities better prepare & stay safe. Developed with Google DeepMind, we're launching Weather Lab to share our AI weather prediction models, starting with the new experimental cyclone prediction model. 🧵

Google Research

68,852 次观看 • 1 年前

LLMs + Elixir: distributed tracing for targeted processes anywhere on the cluster with realtime UI. Idea to shipped, sub 30min:

LLMs + Elixir: distributed tracing for targeted processes anywhere on the cluster with realtime UI. Idea to shipped, sub 30min:

Chris McCord

12,014 次观看 • 4 个月前

🚀 From smartphones to servers, each connected node fuels the AI of tomorrow. 💡 In this new era, compute is the new oil and Hyra AI is building the pipeline with a decentralized network where your idle devices become powerful engines for AI. Explore more 👉

🚀 From smartphones to servers, each connected node fuels the AI of tomorrow. 💡 In this new era, compute is the new oil and Hyra AI is building the pipeline with a decentralized network where your idle devices become powerful engines for AI. Explore more 👉

Hyra AI

12,373 次观看 • 11 个月前

We are entering a new era of on-device automation. ✨ Watch Gemma 4 E4B navigate and drive an iOS simulator directly using Argent. Local models can handle complex interactions and software navigation autonomously.

We are entering a new era of on-device automation. ✨ Watch Gemma 4 E4B navigate and drive an iOS simulator directly using Argent. Local models can handle complex interactions and software navigation autonomously.

Google Gemma

473,079 次观看 • 22 天前

300+ devices. Millions of real-time signals. One decentralized weather oracle. We’re partnering with Nubila Network (mainnet arc) to bring hyperlocal, verifiable climate data to Nexus—fueling prediction markets, AI models, and on-chain protocols.

300+ devices. Millions of real-time signals. One decentralized weather oracle. We’re partnering with Nubila Network (mainnet arc) to bring hyperlocal, verifiable climate data to Nexus—fueling prediction markets, AI models, and on-chain protocols.

Nexus

17,911 次观看 • 9 个月前

Real-time distributed inference monitoring is live on exo intern home AI cluster It comes with out of the box support for PrometheusMonitoring metrics and Grafana dashboards Helps diagnose performance bottlenecks in your exo cluster

Real-time distributed inference monitoring is live on exo intern home AI cluster It comes with out of the box support for PrometheusMonitoring metrics and Grafana dashboards Helps diagnose performance bottlenecks in your exo cluster

Alex Cheema - e/acc

17,798 次观看 • 1 年前