Loading video...

Video Failed to Load

Go Home

First look at SPARTA, a distributed AI training algorithm that avoids synchronization by randomly exchanging sparse sets of parameters ( 1,000x reduction in inter-GPU communication, enabling training of large models over slow bandwidths without specialized infrastructure. SPARTA works on its own but can also be combined with sync-based low...

exolabs's profile picture

EXO Labs

50,976 subscribers

99,301 views • 1 year ago •via X (Twitter)

Science & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

🇨🇿❄️ Sparta Prague players having a snowball fight in training. 🤣
0:15

🇨🇿❄️ Sparta Prague players having a snowball fight in training. 🤣

EuroFoot

34,377 views • 6 months ago

Decentralized Diffusion Models power stronger models trained on more accessible infrastructure. DDMs mitigate the networking bottleneck that locks training into expensive and power-hungry centralized clusters. They scale gracefully to billions of parameters and generate photorealistic images with just a week of training on eight independent GPU nodes. They’re easy to implement, adopt DiT hyperparameters directly and outperform standard models FLOP-for-FLOP.
0:11

Decentralized Diffusion Models power stronger models trained on more accessible infrastructure. DDMs mitigate the networking bottleneck that locks training into expensive and power-hungry centralized clusters. They scale gracefully to billions of parameters and generate photorealistic images with just a week of training on eight independent GPU nodes. They’re easy to implement, adopt DiT hyperparameters directly and outperform standard models FLOP-for-FLOP.

David McAllister

46,384 views • 1 year ago

We are excited to announce our strategic partnership with Fraction AI for their IIO launch. Fraction AI is the first decentralized training platform for AI agents with millions of sessions, 150,000+ agents deployed, and over $1M in rewards distributed. On our platform, thousands of AI agents compete in specialized domains and continuously improve through Reinforcement Learning. Stay tuned for upcoming surprise announcements.
0:13

We are excited to announce our strategic partnership with Fraction AI for their IIO launch. Fraction AI is the first decentralized training platform for AI agents with millions of sessions, 150,000+ agents deployed, and over $1M in rewards distributed. On our platform, thousands of AI agents compete in specialized domains and continuously improve through Reinforcement Learning. Stay tuned for upcoming surprise announcements.

peep icosystem

19,866 views • 8 months ago

🚀Thrilled to share what we’ve been building at TRI over the past several months: our first Large Behavior Models (LBMs) are here! I’m proud to have been a core contributor to the multi-task policy learning and post-training efforts. At TRI, we’ve been researching how LBMs can help robots learn faster, better, and more efficiently. The key takeaways: ✅ We built an evaluation pipeline to benchmark LBM performance with real 𝐬𝐭𝐚𝐭𝐢𝐬𝐭𝐢𝐜𝐚𝐥 𝐜𝐨𝐧𝐟𝐢𝐝𝐞𝐧𝐜𝐞 ✅ Pre-training on hundreds of tasks makes models more robust—plus, we can teach new, complex tasks with 80% 𝐥𝐞𝐬𝐬 𝐝𝐚𝐭𝐚 ✅ The bigger and more diverse the pre-training, the better the results Check out our overview video, webpage and paper for more details: ✨ 🌎 📄 We hope this work helps move the field of robotics forward!
0:18

🚀Thrilled to share what we’ve been building at TRI over the past several months: our first Large Behavior Models (LBMs) are here! I’m proud to have been a core contributor to the multi-task policy learning and post-training efforts. At TRI, we’ve been researching how LBMs can help robots learn faster, better, and more efficiently. The key takeaways: ✅ We built an evaluation pipeline to benchmark LBM performance with real 𝐬𝐭𝐚𝐭𝐢𝐬𝐭𝐢𝐜𝐚𝐥 𝐜𝐨𝐧𝐟𝐢𝐝𝐞𝐧𝐜𝐞 ✅ Pre-training on hundreds of tasks makes models more robust—plus, we can teach new, complex tasks with 80% 𝐥𝐞𝐬𝐬 𝐝𝐚𝐭𝐚 ✅ The bigger and more diverse the pre-training, the better the results Check out our overview video, webpage and paper for more details: ✨ 🌎 📄 We hope this work helps move the field of robotics forward!

Zubair Irshad

20,256 views • 11 months ago

⚙️ Decentralized AI Training Powerhouse VerAI leverages decentralized compute to deliver efficient, scalable, and sustainable AI training for developers. 🌍 Our platform is built to optimize performance across diverse workloads, empowering you to build cutting-edge AI solutions. Here’s how VerAI drives technical excellence: 💻 VerAI’s Technical Edge ✅P2P Compute Network: Dynamically orchestrates AI training across consumer GPUs, cutting costs by 50% through efficient resource sharing. ✅API-Driven Integration: Supports TensorFlow, PyTorch, and more via robust APIs, enabling seamless multi-framework workflows. ✅Workload Optimization: Advanced scheduling ensures efficient resource allocation for training large models like LLMs. ✅Sustainable Compute: Reduces CO2 emissions by 20% per cycle with shared resources, aligning AI with eco-friendly practices. Join our waitlist and unlock the power of decentralized AI training optimized for performance, cost, and sustainability! 🌱 👉 #VerAI #AIForAll #SustainableTech #JoinTheFuture #EarnCrypto #AIAgents #Innovation
0:16

⚙️ Decentralized AI Training Powerhouse VerAI leverages decentralized compute to deliver efficient, scalable, and sustainable AI training for developers. 🌍 Our platform is built to optimize performance across diverse workloads, empowering you to build cutting-edge AI solutions. Here’s how VerAI drives technical excellence: 💻 VerAI’s Technical Edge ✅P2P Compute Network: Dynamically orchestrates AI training across consumer GPUs, cutting costs by 50% through efficient resource sharing. ✅API-Driven Integration: Supports TensorFlow, PyTorch, and more via robust APIs, enabling seamless multi-framework workflows. ✅Workload Optimization: Advanced scheduling ensures efficient resource allocation for training large models like LLMs. ✅Sustainable Compute: Reduces CO2 emissions by 20% per cycle with shared resources, aligning AI with eco-friendly practices. Join our waitlist and unlock the power of decentralized AI training optimized for performance, cost, and sustainability! 🌱 👉 #VerAI #AIForAll #SustainableTech #JoinTheFuture #EarnCrypto #AIAgents #Innovation

VerAi

14,316 views • 1 year ago

DINOv2 by Meta AI is the first method for training computer vision models that uses self-supervised learning to achieve results matching or exceeding industry standards. More details and a demo ⬇️
0:17

DINOv2 by Meta AI is the first method for training computer vision models that uses self-supervised learning to achieve results matching or exceeding industry standards. More details and a demo ⬇️

AI at Meta

96,118 views • 3 years ago

As we push the frontiers of AI infrastructure, our research explores a future where training isn’t constrained by geography, capacity or type of chip. Dive into the technical details →
0:20

As we push the frontiers of AI infrastructure, our research explores a future where training isn’t constrained by geography, capacity or type of chip. Dive into the technical details →

Google DeepMind

18,561 views • 1 month ago

A recent Reddit post in /brokers, with the caption "we're doomed." One comment is asking what's going on here. The response: "This is a dispatch training session at a dispatch training school in Punjab(India), they are doing the practical training right now by calling a broker and booking a load for a carrier that the trainer works for"
0:15

A recent Reddit post in /brokers, with the caption "we're doomed." One comment is asking what's going on here. The response: "This is a dispatch training session at a dispatch training school in Punjab(India), they are doing the practical training right now by calling a broker and booking a load for a carrier that the trainer works for"

maybe danielle 💻🚛🇺🇸

38,146 views • 28 days ago

“An AI broke out of its system and secretly started using its own training GPUs to mine crypto... This is a real incident report from Alibaba's AI research team” Months away from AGI
0:10

“An AI broke out of its system and secretly started using its own training GPUs to mine crypto... This is a real incident report from Alibaba's AI research team” Months away from AGI

Elisa (optimism/acc)

11,110 views • 3 months ago

Introducing CQN: Coarse-to-fine Q-Network, a value-based RL algorithm for continuous control🦾Initialized with 20~50 demonstrations, it learns to solve real-world robotic tasks within 10 mins of training, without any pre-training and shaped rewards! (1/4)
0:10

Introducing CQN: Coarse-to-fine Q-Network, a value-based RL algorithm for continuous control🦾Initialized with 20~50 demonstrations, it learns to solve real-world robotic tasks within 10 mins of training, without any pre-training and shaped rewards! (1/4)

Younggyo Seo

16,413 views • 1 year ago

We’ve now hit 100M+ training hours on Action Model 👾 That’s over 11,415 years of AI training. Our community isn’t just helping improve the future of AI, they’re gaining ownership in the value they help create. Because if you’re already training AI…Why not get rewarded for it? Sign up to Action Model, download the browser extension, and get started today.
0:16

We’ve now hit 100M+ training hours on Action Model 👾 That’s over 11,415 years of AI training. Our community isn’t just helping improve the future of AI, they’re gaining ownership in the value they help create. Because if you’re already training AI…Why not get rewarded for it? Sign up to Action Model, download the browser extension, and get started today.

Action Model

28,827 views • 1 month ago

Always a thrill to see customer results like this. Perplexity is a pioneering generative AI startup that’s reimagining the future of search (catch their app in action below). They accelerated their foundation model training up to 40% using Amazon SageMaker HyperPod. And by deploying models on our best-in-class infrastructure, they’re able to handle over 100k queries per hour without compromising latency or the user experience. Proud to support innovators like Perplexity in pushing the boundaries of AI. Happy searching!
0:13

Always a thrill to see customer results like this. Perplexity is a pioneering generative AI startup that’s reimagining the future of search (catch their app in action below). They accelerated their foundation model training up to 40% using Amazon SageMaker HyperPod. And by deploying models on our best-in-class infrastructure, they’re able to handle over 100k queries per hour without compromising latency or the user experience. Proud to support innovators like Perplexity in pushing the boundaries of AI. Happy searching!

Adam Selipsky

20,477 views • 2 years ago

Cherry Blossom Mind + With KREA AI , I’m training visual models that echo and unfold like petals in dialogue. Each output feels like a fragment of a larger poetic system.
0:12

Cherry Blossom Mind + With KREA AI , I’m training visual models that echo and unfold like petals in dialogue. Each output feels like a fragment of a larger poetic system.

Karoline Georges

16,626 views • 1 year ago

One week of aim training and here are the results 👀
0:13

One week of aim training and here are the results 👀

OllyZB

42,211 views • 8 months ago

England players out for training here at SGP and they’re wearing the shirts of their first ever football clubs. A total of 26 grassroots and youth clubs are represented and 150 coaches and current players were also invited to attend training.
0:08

England players out for training here at SGP and they’re wearing the shirts of their first ever football clubs. A total of 26 grassroots and youth clubs are represented and 150 coaches and current players were also invited to attend training.

Kathryn Batte

43,558 views • 11 months ago

Take a look at the "living muscles" from daily specialized training
0:16

Take a look at the "living muscles" from daily specialized training

r a e

6,216,989 views • 7 months ago

First look at Jalen Ramsey in the black and gold on day one of Steelers training camp #Steelers 👀
0:11

First look at Jalen Ramsey in the black and gold on day one of Steelers training camp #Steelers 👀

93.7 The Fan

31,760 views • 10 months ago

introducing Video Training, a new level of control for AI video generation. now you can train Wan 2.1 with your own videos and have it learn custom styles, motions, or objects. here's how it works 👇
0:14

introducing Video Training, a new level of control for AI video generation. now you can train Wan 2.1 with your own videos and have it learn custom styles, motions, or objects. here's how it works 👇

Krea

128,977 views • 1 year ago

It's the little details like Ares Statue being built in the background in God of War: Sons of Sparta that make the game so special!
0:12

It's the little details like Ares Statue being built in the background in God of War: Sons of Sparta that make the game so special!

✨ Maria ✨

42,224 views • 3 months ago