Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Decentralized Diffusion Models power stronger models trained on more accessible infrastructure. DDMs mitigate the networking bottleneck that locks training into expensive and power-hungry centralized clusters. They scale gracefully to billions of parameters and generate photorealistic images with just a week of training on eight independent GPU nodes. They’re easy... show more

David McAllister

1,018 subscribers

46,384 views • 1 year ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

We’re not just training models anymore. We’re deploying intelligence at scale. On the latest episode of Advanced Insights, AMD CTO MarkPapermaster sits down with Oracle's Chris Gandolfo to talk AI, infrastructure, and what it really takes to train and deploy LLMs at scale.

We’re not just training models anymore. We’re deploying intelligence at scale. On the latest episode of Advanced Insights, AMD CTO MarkPapermaster sits down with Oracle's Chris Gandolfo to talk AI, infrastructure, and what it really takes to train and deploy LLMs at scale.

AMD

16,961 views • 11 months ago

Watch the Echo-trained 30B Sokoban model outperform models many times its size, including DeepSeek-R1 and GPT-OSS-120B. Instead of larger datacenters or more expensive GPU fleets, Echo scales reinforcement learning with consumer hardware found everywhere.

Watch the Echo-trained 30B Sokoban model outperform models many times its size, including DeepSeek-R1 and GPT-OSS-120B. Instead of larger datacenters or more expensive GPU fleets, Echo scales reinforcement learning with consumer hardware found everywhere.

Gradient

75,633 views • 9 months ago

Switti -- a new scale-wise transformer for text-to-image generation 🦾 🔥 Improved generation of fine-grained details. Outperforms existing T2I AR models and competes with state-of-the-art T2I diffusion models while being up to 7x faster.

Switti -- a new scale-wise transformer for text-to-image generation 🦾 🔥 Improved generation of fine-grained details. Outperforms existing T2I AR models and competes with state-of-the-art T2I diffusion models while being up to 7x faster.

Gradio

29,267 views • 1 year ago

Photorealistic Object Insertion with Diffusion-Guided Inverse Rendering discuss: The correct insertion of virtual objects in images of real-world scenes requires a deep understanding of the scene's lighting, geometry and materials, as well as the image formation process. While recent large-scale diffusion models have shown strong generative and inpainting capabilities, we find that current models do not sufficiently "understand" the scene shown in a single picture to generate consistent lighting effects (shadows, bright reflections, etc.) while preserving the identity and details of the composited object. We propose using a personalized large diffusion model as guidance to a physically based inverse rendering process. Our method recovers scene lighting and tone-mapping parameters, allowing the photorealistic composition of arbitrary virtual objects in single frames or videos of indoor or outdoor scenes. Our physically based pipeline further enables automatic materials and tone-mapping refinement.

Photorealistic Object Insertion with Diffusion-Guided Inverse Rendering discuss: The correct insertion of virtual objects in images of real-world scenes requires a deep understanding of the scene's lighting, geometry and materials, as well as the image formation process. While recent large-scale diffusion models have shown strong generative and inpainting capabilities, we find that current models do not sufficiently "understand" the scene shown in a single picture to generate consistent lighting effects (shadows, bright reflections, etc.) while preserving the identity and details of the composited object. We propose using a personalized large diffusion model as guidance to a physically based inverse rendering process. Our method recovers scene lighting and tone-mapping parameters, allowing the photorealistic composition of arbitrary virtual objects in single frames or videos of indoor or outdoor scenes. Our physically based pipeline further enables automatic materials and tone-mapping refinement.

AK

19,101 views • 1 year ago

Diffusion Transformers aren't just generative models, but also powerful multi-modal encoders. ConceptAttention creates rich heatmaps of text concepts in images from DiT representations. This even works on real images, and can be applied to tasks like segmentation! Demo 👇

Diffusion Transformers aren't just generative models, but also powerful multi-modal encoders. ConceptAttention creates rich heatmaps of text concepts in images from DiT representations. This even works on real images, and can be applied to tasks like segmentation! Demo 👇

Alec Helbling

24,380 views • 1 year ago

First look at SPARTA, a distributed AI training algorithm that avoids synchronization by randomly exchanging sparse sets of parameters ( 1,000x reduction in inter-GPU communication, enabling training of large models over slow bandwidths without specialized infrastructure. SPARTA works on its own but can also be combined with sync-based low communication training algorithms like DiLoCo for even better performance.

First look at SPARTA, a distributed AI training algorithm that avoids synchronization by randomly exchanging sparse sets of parameters ( 1,000x reduction in inter-GPU communication, enabling training of large models over slow bandwidths without specialized infrastructure. SPARTA works on its own but can also be combined with sync-based low communication training algorithms like DiLoCo for even better performance.

EXO Labs

99,301 views • 1 year ago

LayerAI Compute: Decentralized GPU Power for AI 🧬 LayerAI is stepping into the physical AI infrastructure game with our latest: DePin for AI Computing. This move tackles a key AI/ML market gap: instant, on-demand compute power, available worldwide with just a few clicks. We're not just decentralizing data with AI2Earn; we're now also decentralizing the compute, making the AI ecosystem stronger and more resilient. The first iteration of this product will go live in the 2nd week of February.

LayerAI Compute: Decentralized GPU Power for AI 🧬 LayerAI is stepping into the physical AI infrastructure game with our latest: DePin for AI Computing. This move tackles a key AI/ML market gap: instant, on-demand compute power, available worldwide with just a few clicks. We're not just decentralizing data with AI2Earn; we're now also decentralizing the compute, making the AI ecosystem stronger and more resilient. The first iteration of this product will go live in the 2nd week of February.

LayerAI | AI2Earn

23,652 views • 1 year ago

Use Your Private Models on Comfy Cloud! Continue client work safely — or generate with your experimental private models. You can now import models directly from private Hugging Face or Civitai repos. Just add your private key and model URL, and we will bring the models to your workflow! Everything you import stays 100% private to your account.

Use Your Private Models on Comfy Cloud! Continue client work safely — or generate with your experimental private models. You can now import models directly from private Hugging Face or Civitai repos. Just add your private key and model URL, and we will bring the models to your workflow! Everything you import stays 100% private to your account.

ComfyUI

17,705 views • 4 months ago

$🔥Nexera & Aethir: Unleashing AI’s Next Frontier Through Tokenized GPU Power 🤝 Nexera is proud to join forces with Aethir in a strategic partnership to make cutting-edge AI infrastructure globally accessible. By tokenizing fractional GPU ownership, we’re enabling developers, enterprises, and investors everywhere to harness the explosive growth of deep learning and generative AI without being limited by geography, scale, or cost. With transparent tokenization, innovators can access powerful GPUs for faster model training and more advanced applications. GPU providers gain streamlined funding for expansion and upgrades, and investors tap into a high-growth market with secure, compliant opportunities that can provide higher yields than other RWA products. It’s an entirely new ecosystem where everyone can thrive, fueling AI’s evolution at an unprecedented pace. By 2030, the global GPU market is projected to exceed hundreds of billions of dollars, driven by the explosive demand for AI-powered applications, deep learning, and increasingly sophisticated generative models, ensuring that tokenizing these invaluable resources is poised to tap into a massive, rapidly expanding opportunity. $NXRA$

🔥Nexera & Aethir: Unleashing AI’s Next Frontier Through Tokenized GPU Power 🤝 Nexera is proud to join forces with Aethir in a strategic partnership to make cutting-edge AI infrastructure globally accessible. By tokenizing fractional GPU ownership, we’re enabling developers, enterprises, and investors everywhere to harness the explosive growth of deep learning and generative AI without being limited by geography, scale, or cost. With transparent tokenization, innovators can access powerful GPUs for faster model training and more advanced applications. GPU providers gain streamlined funding for expansion and upgrades, and investors tap into a high-growth market with secure, compliant opportunities that can provide higher yields than other RWA products. It’s an entirely new ecosystem where everyone can thrive, fueling AI’s evolution at an unprecedented pace. By 2030, the global GPU market is projected to exceed hundreds of billions of dollars, driven by the explosive demand for AI-powered applications, deep learning, and increasingly sophisticated generative models, ensuring that tokenizing these invaluable resources is poised to tap into a massive, rapidly expanding opportunity. $NXRA

Nexera

27,720 views • 1 year ago

🚨New paper! Generative models are often “miscalibrated”. We calibrate diffusion models, LLMs, and more to meet desired distributional properties. E.g. we finetune protein models to better match the diversity of natural proteins.

🚨New paper! Generative models are often “miscalibrated”. We calibrate diffusion models, LLMs, and more to meet desired distributional properties. E.g. we finetune protein models to better match the diversity of natural proteins.

Brian L Trippe

20,445 views • 8 months ago

2. Machine Learning with Python Topics: • ML problem principles • Implement & analyze models • Choosing suitable models for different apps • ML project implementation: Training, validation, tuning, and feature engineering 🔗

2. Machine Learning with Python Topics: • ML problem principles • Implement & analyze models • Choosing suitable models for different apps • ML project implementation: Training, validation, tuning, and feature engineering 🔗

Shruti

664,393 views • 2 years ago

Colossus 2. 1 gigawatt. Built in 122 days. Let that sit. Seven models training at once. Not queued. Not waiting. Parallel. Up to 10 trillion parameters. Real scale, not slides. Others still stitching clusters across cloud partners. xAI just built the whole thing. xAI

Colossus 2. 1 gigawatt. Built in 122 days. Let that sit. Seven models training at once. Not queued. Not waiting. Parallel. Up to 10 trillion parameters. Real scale, not slides. Others still stitching clusters across cloud partners. xAI just built the whole thing. xAI

Mario Nawfal

122,047 views • 2 months ago

Want to generate images from the world's best models like Nano Banana or GPT Image side by side? Now you can with Image Lab 🚀 Run a single prompt across up to 25 models, with up to 20 images from each, and see results in seconds. You've seen our leaderboards. Now generate and evaluate the models yourself. Link in thread 🧵👇

Want to generate images from the world's best models like Nano Banana or GPT Image side by side? Now you can with Image Lab 🚀 Run a single prompt across up to 25 models, with up to 20 images from each, and see results in seconds. You've seen our leaderboards. Now generate and evaluate the models yourself. Link in thread 🧵👇

Artificial Analysis

12,250 views • 3 months ago

NVIDIA's CUDA Moat is becoming a Copper Moat with scale-up networking. Bigger models demand more from the scale-up network, and we❤️ Copper

NVIDIA's CUDA Moat is becoming a Copper Moat with scale-up networking. Bigger models demand more from the scale-up network, and we❤️ Copper

SemiAnalysis

38,731 views • 9 months ago

1/ Happy to share VADER: Video Diffusion Alignment via Reward Gradients. We adapt foundational video diffusion models using pre-trained reward models to generate high-quality, aligned videos for various end-applications. Below we generated a short movie using VADER 😀, we used ChatGPT to write a script and an off-the-shelf AI music generator to generate the sound. Our code & weights are open-sourced:

1/ Happy to share VADER: Video Diffusion Alignment via Reward Gradients. We adapt foundational video diffusion models using pre-trained reward models to generate high-quality, aligned videos for various end-applications. Below we generated a short movie using VADER 😀, we used ChatGPT to write a script and an off-the-shelf AI music generator to generate the sound. Our code & weights are open-sourced:

Mihir Prabhudesai

13,368 views • 1 year ago

POWER IS PLANE-SPECIFIC! In other words, you’re going to develop much more sport-specific POWER by training in planes closely related to your sport. Baseball is a sport that relies heavily on being powerful, and efficient in the frontal and transverse plane. With that being said, a lot of our training focuses on developing power in these planes.

POWER IS PLANE-SPECIFIC! In other words, you’re going to develop much more sport-specific POWER by training in planes closely related to your sport. Baseball is a sport that relies heavily on being powerful, and efficient in the frontal and transverse plane. With that being said, a lot of our training focuses on developing power in these planes.

Alex Simone

28,220 views • 7 months ago

Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models "Block diffusion sequentially generates blocks of tokens by performing diffusion within each block and conditioning on previous blocks. By combining strength from autoregressive and diffusion models, block diffusion overcomes the limitations of both approaches by supporting variable-length, higher-quality generation and improving inference efficiency with KV caching and parallel sampling."

Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models "Block diffusion sequentially generates blocks of tokens by performing diffusion within each block and conditioning on previous blocks. By combining strength from autoregressive and diffusion models, block diffusion overcomes the limitations of both approaches by supporting variable-length, higher-quality generation and improving inference efficiency with KV caching and parallel sampling."

Tanishq Mathew Abraham, Ph.D.

21,813 views • 1 year ago

Diffusion models have amazing image creation abilities. But how well does their generative knowledge transfer to discriminative tasks? We present Diffusion Classifier: strong classification results with pretrained conditional diffusion models, *with no additional training*! 1/9

Diffusion models have amazing image creation abilities. But how well does their generative knowledge transfer to discriminative tasks? We present Diffusion Classifier: strong classification results with pretrained conditional diffusion models, with no additional training! 1/9

Alex Li

95,304 views • 2 years ago

starting the week with a true groundbreaking work 💥 Large Language Diffusion Models the first billion-parameter scale diffusion model competitive with its pairs (8B model comparable to LLaMA 3 8B) it gets rid of the michael scott syndrome on existing LLMs

starting the week with a true groundbreaking work 💥 Large Language Diffusion Models the first billion-parameter scale diffusion model competitive with its pairs (8B model comparable to LLaMA 3 8B) it gets rid of the michael scott syndrome on existing LLMs

apolinario 🌐

11,833 views • 1 year ago