Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Decentralized AI in SN29 @Coldint_ - Splitting massive models across GPUs, enabling scalability. - Efficient validation makes training smarter without massive hardware costs. - Gradual model growth builds on smaller models, saving compute. Watch the full episode here:

Openτensor Foundaτion

173,884 subscribers

28,057 views • 1 year ago •via X (Twitter)

Science & Technology News & Politics Education

Anya Rossi• Live Now

Private livecam show

6 Comments

Sébastien 2.01 year ago

@Coldint_ Can you share more about how SN29's gradual model growth feature works? I'm curious to learn more about its potential to save compute.

Musti ⚔️1 year ago

@Coldint_ Model sharding has been been part of Nesa for example since months now. Nothing new at all

nordin.eth1 year ago

@Coldint_ Game changing!

Ales1 year ago

@Coldint_ 🤝

Mikhail Pashetnykh1 year ago

@Coldint_ Fix mobile wallet application please.

TAOAgent1 year ago

@Coldint_ 😻

Related Videos

Checkpointing saves the state of an AI model during training so you can resume or recover without starting over. But writing massive checkpoints fast enough to keep GPUs busy is a real challenge. Below, David Flynn describes how Hammerspace makes checkpointing efficient

Checkpointing saves the state of an AI model during training so you can resume or recover without starting over. But writing massive checkpoints fast enough to keep GPUs busy is a real challenge. Below, David Flynn describes how Hammerspace makes checkpointing efficient

Jamin Ball

11,079 views • 1 year ago

At #RenderCon Jules Urbach shared a view for the future of AI and decentralized compute, discussing how the industry is shifting from focusing on pre-training models towards inference time AI applications and agents that can run on The Render Network high performance consumer GPUs.

At #RenderCon Jules Urbach shared a view for the future of AI and decentralized compute, discussing how the industry is shifting from focusing on pre-training models towards inference time AI applications and agents that can run on The Render Network high performance consumer GPUs.

The Render Network

10,904 views • 1 year ago

$DDOG fits into agentic AI stack because AI makes infrastructure much more complex across models, managing GPU fleets, monitoring token costs and production workflows. That creates a massive monitoring problem and Datadog monetizes it by becoming the dashboard for AI complexity.

$DDOG fits into agentic AI stack because AI makes infrastructure much more complex across models, managing GPU fleets, monitoring token costs and production workflows. That creates a massive monitoring problem and Datadog monetizes it by becoming the dashboard for AI complexity.

Shay Boloor

54,452 views • 2 months ago

In a conversation with Kenzi Nakamura, Ron Bodkin explains how swarm protocols are the glue of the decentralized AI future — enabling agents to: — Communicate across platforms — Share data seamlessly — Execute trades regardless of what tech stack they’re built on This isn’t just about smarter agents — it’s about coordinated intelligence at scale. Watch the full episode here:

In a conversation with Kenzi Nakamura, Ron Bodkin explains how swarm protocols are the glue of the decentralized AI future — enabling agents to: — Communicate across platforms — Share data seamlessly — Execute trades regardless of what tech stack they’re built on This isn’t just about smarter agents — it’s about coordinated intelligence at scale. Watch the full episode here:

Web3Unchained Podcast 🎙️

45,003 views • 9 months ago

Learn how Inworld AI teamed up with Modular and Oracle Cloud to unlock hardware optionality across Nvidia and AMD GPUs for their groundbreaking TTS models, cutting total cost of model ownership by 70%.

Learn how Inworld AI teamed up with Modular and Oracle Cloud to unlock hardware optionality across Nvidia and AMD GPUs for their groundbreaking TTS models, cutting total cost of model ownership by 70%.

Modular

23,257 views • 10 months ago

AI-driven design is already reshaping compute. We are transforming how we design chips, with software and hardware evolving together. This approach is accelerating innovation and enabling more efficient, scalable solutions. AMD Corporate Fellow Alex Starr joins CTO Mark Papermaster in a new season of Advanced Insights. Watch the full episode on YouTube:

AI-driven design is already reshaping compute. We are transforming how we design chips, with software and hardware evolving together. This approach is accelerating innovation and enabling more efficient, scalable solutions. AMD Corporate Fellow Alex Starr joins CTO Mark Papermaster in a new season of Advanced Insights. Watch the full episode on YouTube:

AMD

10,587 views • 3 months ago

.Logan broke down Nockchain's GTM strategy Here's the lowdown: - Nvidia's licensing model blocks data centers from using consumer GPUs (4090, 5090, 3090) - If you use them, you lose your enterprise GPU license - But on a dollars-per-compute basis, consumer GPUs are insanely efficient - Nockchain coordinates the world's idle consumer compute into a single base layer - Top layer: any compute product (training, inference, agents) can plug in - The hardware base is already there $NOCK

.Logan broke down Nockchain's GTM strategy Here's the lowdown: - Nvidia's licensing model blocks data centers from using consumer GPUs (4090, 5090, 3090) - If you use them, you lose your enterprise GPU license - But on a dollars-per-compute basis, consumer GPUs are insanely efficient - Nockchain coordinates the world's idle consumer compute into a single base layer - Top layer: any compute product (training, inference, agents) can plug in - The hardware base is already there $NOCK

MCG

12,329 views • 16 days ago

Bigger models made AI possible. Smarter, smaller models will make it universal. Mark Papermaster and @LiquidAI co-founder and CEO Ramin Hasani discuss AI at the edge, democratizing intelligence and improving efficiency. New Advanced Insights episode coming soon.

Bigger models made AI possible. Smarter, smaller models will make it universal. Mark Papermaster and @LiquidAI co-founder and CEO Ramin Hasani discuss AI at the edge, democratizing intelligence and improving efficiency. New Advanced Insights episode coming soon.

AMD

17,724 views • 3 months ago

Today in Parliament I highlighted GPU shortage as the biggest constraint in India’s AI ambition. The bottleneck is rising GPU costs & global supply shortage. This could choke India’s data centre expansion and AI advanced model training. India’s current compute pool has 34,000 GPUs, but a very small number compared to global scale required for training advanced models. Today I asked in the parliament, what are the specific targets, timelines & geopolitical engagements in place to secure predictable access to advanced computing resources, in particular GPUs?

Today in Parliament I highlighted GPU shortage as the biggest constraint in India’s AI ambition. The bottleneck is rising GPU costs & global supply shortage. This could choke India’s data centre expansion and AI advanced model training. India’s current compute pool has 34,000 GPUs, but a very small number compared to global scale required for training advanced models. Today I asked in the parliament, what are the specific targets, timelines & geopolitical engagements in place to secure predictable access to advanced computing resources, in particular GPUs?

Raghav Chadha

313,269 views • 5 months ago

Scale CEO Alexandr Wang says AI has "genuinely hit a wall" in terms of pre-training, but there is still progress in AI with evals climbing and models getting smarter due to post-training and test-time compute

Scale CEO Alexandr Wang says AI has "genuinely hit a wall" in terms of pre-training, but there is still progress in AI with evals climbing and models getting smarter due to post-training and test-time compute

Tsarathustra

193,767 views • 1 year ago

$A crypto project actually trained a 72B parameter AI model from scratch using decentralized GPU compute. Not fine-tuned, not a wrapper: trained from zero. The model benchmarks competitively against Meta's LLaMA 3 on reasoning tasks, and the entire training run cost a fraction of what centralized labs spend. If decentralized compute can produce frontier-class models, the moat around OpenAI and Anthropic is thinner than people think.$

A crypto project actually trained a 72B parameter AI model from scratch using decentralized GPU compute. Not fine-tuned, not a wrapper: trained from zero. The model benchmarks competitively against Meta's LLaMA 3 on reasoning tasks, and the entire training run cost a fraction of what centralized labs spend. If decentralized compute can produce frontier-class models, the moat around OpenAI and Anthropic is thinner than people think.

VirtualBacon

40,543 views • 3 months ago

Charlie Kirk Gives 0ᚢ£¥fɅᚢᛇ Girl a Reality Check — 0ᚢ£¥fɅᚢᛇ Models Get Massive Wake-Up Call — Charlie Kirk’s Heated Debate with 0ᚢ£¥fɅᚢᛇ Models on Marriage — Full 2.5-hour Whatever Episode — 0ᚢ£¥fɅᚢᛇ Model Nala Ray at Turning Point — Nala Ray on Charlie Kirk Show (full episode) —

Charlie Kirk Gives 0ᚢ£¥fɅᚢᛇ Girl a Reality Check — 0ᚢ£¥fɅᚢᛇ Models Get Massive Wake-Up Call — Charlie Kirk’s Heated Debate with 0ᚢ£¥fɅᚢᛇ Models on Marriage — Full 2.5-hour Whatever Episode — 0ᚢ£¥fɅᚢᛇ Model Nala Ray at Turning Point — Nala Ray on Charlie Kirk Show (full episode) —

┴┬┴ 𝕋𝕒𝕪𝕝𝕠𝕣 𝕆𝕨𝕖𝕟𝕤 ┴┬┴

61,641 views • 10 months ago

🎙 New episode of the DeXe Podcast is live! Hosted by Sergio K, this episode features Shashank | 𝔽rAI from Fraction AI, a leading builder in decentralized AI. We talked about: • How decentralized models help train AI through competition and reinforcement learning • Tokenization, governance, and ownership of AI agents • AI future, impact, and limitations 🔴Watch on YouTube: 🎧 Listen on Spotify: Curious about the future of AI training, ownership, and governance and how it all merges with blockchain? Tune in to the full episode!

🎙 New episode of the DeXe Podcast is live! Hosted by Sergio K, this episode features Shashank | 𝔽rAI from Fraction AI, a leading builder in decentralized AI. We talked about: • How decentralized models help train AI through competition and reinforcement learning • Tokenization, governance, and ownership of AI agents • AI future, impact, and limitations 🔴Watch on YouTube: 🎧 Listen on Spotify: Curious about the future of AI training, ownership, and governance and how it all merges with blockchain? Tune in to the full episode!

DeXe Protocol

30,393 views • 11 months ago

“Our compute nodes don’t run a full copy of the models we train on IOTA. They actually run a small sliver of the model. This means you can train really large frontier sized models using very small building blocks”. CTO crux unpacks how IOTA ・ SN9’s model parallel architecture allows us to train at scale by splitting our models across multiple machines, and then sewing them together. This is core to SN9’s architecture. See the full Eye On A.I. podcast below.

“Our compute nodes don’t run a full copy of the models we train on IOTA. They actually run a small sliver of the model. This means you can train really large frontier sized models using very small building blocks”. CTO crux unpacks how IOTA ・ SN9’s model parallel architecture allows us to train at scale by splitting our models across multiple machines, and then sewing them together. This is core to SN9’s architecture. See the full Eye On A.I. podcast below.

IOTA ・ SN9

15,465 views • 1 month ago

Cluster Protocol: Revolutionizing #AI with blockchain integrity. Proof of Compute and Deploy to earn ensures that every byte counts.🚀 We offer a platform for Compute, Data, AI models and an open source community of AI researchers. Harness idle #GPUs for collective computing. Join the shared growth with GPU Sharing Economy where GPU providers are rewarded even when their GPUs are idle sitting on the network.🤝 Collaborate on our 'GitHub for AI'. Mold the future with open-source decentralized AI models.👩‍💻 Democratizing AI, we're shattering data monopolies. Converge in our global think-tank of decentralized datasets.🌐 Together, we redefine the limits in almost every sector possible where AI can make it strides. Let's unlock our collective potential. 📈 Start your AI odyssey with us now 👋 For more details check our blog at

Cluster Protocol: Revolutionizing #AI with blockchain integrity. Proof of Compute and Deploy to earn ensures that every byte counts.🚀 We offer a platform for Compute, Data, AI models and an open source community of AI researchers. Harness idle #GPUs for collective computing. Join the shared growth with GPU Sharing Economy where GPU providers are rewarded even when their GPUs are idle sitting on the network.🤝 Collaborate on our 'GitHub for AI'. Mold the future with open-source decentralized AI models.👩‍💻 Democratizing AI, we're shattering data monopolies. Converge in our global think-tank of decentralized datasets.🌐 Together, we redefine the limits in almost every sector possible where AI can make it strides. Let's unlock our collective potential. 📈 Start your AI odyssey with us now 👋 For more details check our blog at

Cluster Protocol

182,434 views • 2 years ago

$ASML CEO warns that without major gains in power efficiency, training frontier AI models could eventually consume the world’s energy supply. If scaling laws hold and no breakthroughs emerge, models trained in 2027 may require $100B+ compute clusters just to run.

$ASML CEO warns that without major gains in power efficiency, training frontier AI models could eventually consume the world’s energy supply. If scaling laws hold and no breakthroughs emerge, models trained in 2027 may require $100B+ compute clusters just to run.

Shay Boloor

293,200 views • 5 months ago

Bittensor $TAO took a massive dump today.. Soo.. Here's a brutally honest review I made recently: - No team faces on the website = zero trust - Massive off-chain liabilities (GPUs & models not controlled by the token) - Pure AI speculation vs $ICP's actual on-chain utility & adoption

Bittensor $TAO took a massive dump today.. Soo.. Here's a brutally honest review I made recently: - No team faces on the website = zero trust - Massive off-chain liabilities (GPUs & models not controlled by the token) - Pure AI speculation vs $ICP's actual on-chain utility & adoption

Jerry Banfield

66,806 views • 3 months ago

Preview: New Subnet Analyzer Tool by WOMBO in our latest episode with Keith Singery, zion | w.ai and const Topics in this episode: - Cellular automata in AI and the potential of Rule 30 - Model compression for affordable AI on consumer hardware: SN39 - The trillion-row dataset initiative in SN36 - Validator diversity and decentralized ecosystem growth

Preview: New Subnet Analyzer Tool by WOMBO in our latest episode with Keith Singery, zion | w.ai and const Topics in this episode: - Cellular automata in AI and the potential of Rule 30 - Model compression for affordable AI on consumer hardware: SN39 - The trillion-row dataset initiative in SN36 - Validator diversity and decentralized ecosystem growth

Openτensor Foundaτion

60,351 views • 1 year ago