Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Diffusion Policies are powerful and widely used. We made them much faster. Consistency Policy bridges consistency distillation techniques to the robotics domain and enables 10-100x faster policy inference with comparable performance. Accepted at #RSS2024

_Aaditya_Prasad's profile picture

Aaditya Prasad 🇺🇸

1,200 subscribers

79,181 Aufrufe • vor 2 Jahren •via X (Twitter)

#RSS2024
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

just made it possible to evaluate generalist robotics models like Octo at 60-100x real world evaluation speeds via gpu simulation and rendering (~10x faster than original cpu sim code). All videos below are from our open source ManiSkill GPU sim!
0:12

just made it possible to evaluate generalist robotics models like Octo at 60-100x real world evaluation speeds via gpu simulation and rendering (~10x faster than original cpu sim code). All videos below are from our open source ManiSkill GPU sim!

Stone Tao

13,456 Aufrufe • vor 1 Jahr

New research from Databricks: LLMs Can Learn to Reason via Off-Policy RL Optimal Advantage-based Policy Optimization with Lagged Inference policy (OAPL) shows you don’t need strict on-policy training to improve reasoning. It matches or beats Group Relative Policy Optimization (GRPO), stays stable with large policy lag, and uses ~3× fewer training generations. For Databricks customers, it’s a simpler, practical, and equally powerful approach to RL that Databricks is pioneering internally — and bringing directly to Databricks customers, so enterprises can improve agents using the same methods we use for our in-house agents, without complex infrastructure changes.
0:13

New research from Databricks: LLMs Can Learn to Reason via Off-Policy RL Optimal Advantage-based Policy Optimization with Lagged Inference policy (OAPL) shows you don’t need strict on-policy training to improve reasoning. It matches or beats Group Relative Policy Optimization (GRPO), stays stable with large policy lag, and uses ~3× fewer training generations. For Databricks customers, it’s a simpler, practical, and equally powerful approach to RL that Databricks is pioneering internally — and bringing directly to Databricks customers, so enterprises can improve agents using the same methods we use for our in-house agents, without complex infrastructure changes.

Databricks AI Research

12,699 Aufrufe • vor 5 Monaten

When the robots come for us, at least we figured out how to stop them today. (Made with Runway Gen 3. Still impressed by the level of consistency of objects over the 10 seconds compared to previous AI videos)
0:10

When the robots come for us, at least we figured out how to stop them today. (Made with Runway Gen 3. Still impressed by the level of consistency of objects over the 10 seconds compared to previous AI videos)

Ethan Mollick

89,912 Aufrufe • vor 2 Jahren

Death Taxes Dudes being faster barefoot Project white boy has been a success. We started the summer with 5 guys that could hit 1.27 or faster on a 5 into 10 and 20+ MPH top speed. Both are up to 15 guys this week, and we’re missing a few of our faster dudes to vacation.
0:13

Death Taxes Dudes being faster barefoot Project white boy has been a success. We started the summer with 5 guys that could hit 1.27 or faster on a 5 into 10 and 20+ MPH top speed. Both are up to 15 guys this week, and we’re missing a few of our faster dudes to vacation.

Brandon Davis, CSCS

30,648 Aufrufe • vor 28 Tagen

Diffusion for virtual worlds: we've trained a new model to create 3D objects from text. And it's 50x faster than any alternative. We made each of these cute characters in just one minute with Genmo's new text-to-3D model. Build your own world at
0:16

Diffusion for virtual worlds: we've trained a new model to create 3D objects from text. And it's 50x faster than any alternative. We made each of these cute characters in just one minute with Genmo's new text-to-3D model. Build your own world at

Genmo

18,532 Aufrufe • vor 3 Jahren

This is Fast Enter Play Mode - a setting that makes it significantly faster to enter Play mode, especially after small changes that used to trigger the full domain reload. On the path to CoreCLR, we are making this mode the default for new projects in Unity 6.6 and later.
0:11

This is Fast Enter Play Mode - a setting that makes it significantly faster to enter Play mode, especially after small changes that used to trigger the full domain reload. On the path to CoreCLR, we are making this mode the default for new projects in Unity 6.6 and later.

Unity

23,632 Aufrufe • vor 1 Monat

EAGLE-3 introduces two key innovations: Training-Time Testing (TTT) and multi-level feature fusion. By removing the feature prediction constraint used in previous EAGLE versions and leveraging semantic features across multiple layers, EAGLE-3 achieves higher acceptance rates, faster generation, and lossless performance. The result? - 5.6× faster than vanilla decoding (13B) Compared to EAGLE-1, EAGLE-3 delivers a 1.8× speedup on the 13B model, with the future EAGLE-4 release expected to further improve decoding efficiency. *Inference on the video conducted on 2x RTX 3090 GPUs at fp16 precision using the Vicuna 13B model.
0:12

EAGLE-3 introduces two key innovations: Training-Time Testing (TTT) and multi-level feature fusion. By removing the feature prediction constraint used in previous EAGLE versions and leveraging semantic features across multiple layers, EAGLE-3 achieves higher acceptance rates, faster generation, and lossless performance. The result? - 5.6× faster than vanilla decoding (13B) Compared to EAGLE-1, EAGLE-3 delivers a 1.8× speedup on the 13B model, with the future EAGLE-4 release expected to further improve decoding efficiency. *Inference on the video conducted on 2x RTX 3090 GPUs at fp16 precision using the Vicuna 13B model.

Eagle

37,069 Aufrufe • vor 2 Monaten

Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models Contributions: • We introduce Diffuman4D, a novel diffusion model that generates spatio-temporally consistent and high-resolution (1024p) human videos from sparse-view video inputs. • We propose a sliding iterative denoising mechanism that enhances both the spatial and temporal consistency of generated long-term videos while maintaining efficient inference. • We design a human pose conditioning scheme to enhance the appearance quality and motion accuracy of generated human videos. • We plan to release our processed version of the DNA-Rendering dataset, which we believe will benefit future research in this area.
0:10

Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models Contributions: • We introduce Diffuman4D, a novel diffusion model that generates spatio-temporally consistent and high-resolution (1024p) human videos from sparse-view video inputs. • We propose a sliding iterative denoising mechanism that enhances both the spatial and temporal consistency of generated long-term videos while maintaining efficient inference. • We design a human pose conditioning scheme to enhance the appearance quality and motion accuracy of generated human videos. • We plan to release our processed version of the DNA-Rendering dataset, which we believe will benefit future research in this area.

MrNeRF

24,729 Aufrufe • vor 1 Jahr

1/ World models are getting popular in robotics 🤖✨ But there’s a big problem: most are slow and break physical consistency over long horizons. 2/ Today we’re releasing Interactive World Simulator: An action-conditioned world model that supports stable long-horizon interaction. 3/ Key result: ✅ 10+ minutes of interactive prediction ✅ 15 FPS ✅ on a single RTX 4090🔥 4/ Why this matters: it unlocks two critical robotics applications: 🚀 Scalable data generation for policy training 🧪 Faithful policy evaluation 5/ You can play with our world model NOW at NO git clone, NO pip install, NO python. Just click and play! NOTE ⚠️ ALL videos here are generated purely by our model in pixel space! They are **NOT** from a real camera More details coming 👇 (1/9) #Robotics #AI #MachineLearning #WorldModels #RobotLearning #ImitationLearning
0:11

1/ World models are getting popular in robotics 🤖✨ But there’s a big problem: most are slow and break physical consistency over long horizons. 2/ Today we’re releasing Interactive World Simulator: An action-conditioned world model that supports stable long-horizon interaction. 3/ Key result: ✅ 10+ minutes of interactive prediction ✅ 15 FPS ✅ on a single RTX 4090🔥 4/ Why this matters: it unlocks two critical robotics applications: 🚀 Scalable data generation for policy training 🧪 Faithful policy evaluation 5/ You can play with our world model NOW at NO git clone, NO pip install, NO python. Just click and play! NOTE ⚠️ ALL videos here are generated purely by our model in pixel space! They are **NOT** from a real camera More details coming 👇 (1/9) #Robotics #AI #MachineLearning #WorldModels #RobotLearning #ImitationLearning

Yixuan Wang

129,102 Aufrufe • vor 5 Monaten

I was truly honoured to address the thousands of farmers that turned out in a truly justified protest at the current welsh government policies that are not fair nor workable along with their policy on TB eradication which really is not working. We must stand strong and together.
0:15

I was truly honoured to address the thousands of farmers that turned out in a truly justified protest at the current welsh government policies that are not fair nor workable along with their policy on TB eradication which really is not working. We must stand strong and together.

Nigel Owens MBE

178,989 Aufrufe • vor 2 Jahren

🚀 Self-speculation brings 6.75x real speedup for LLM generation with SGLang inference! Same model drafts future tokens in Diffusion mode → then verifies them in AR (causal) mode. One model and one KV cache. Just different attention masks. Thanks to perfect alignment, we get 2× longer acceptance lengths than MTP techniques (Eagle-3, MTP, dFlash). We run 2 forward passes… but the 2× higher acceptance means we break even - and with zero overhead from extra drafter, KV cache, or LM head that comes with MTP - those are not free. Last week we released Nemotron-Labs-Diffusion + Tri-mode LLMs! We did continued pre-training on Ministral-3 models by switching attention patterns (block causal bidirectional). Result: one model that runs AR mode, Diffusion mode, and Self-Speculation. Diffusion mode already shows high benchmark accuracy - excited to see what happens when someone beats left-to-right acceptance! 🔥 Github: Paper: SGLang inference: Try the models on HF:
0:13

🚀 Self-speculation brings 6.75x real speedup for LLM generation with SGLang inference! Same model drafts future tokens in Diffusion mode → then verifies them in AR (causal) mode. One model and one KV cache. Just different attention masks. Thanks to perfect alignment, we get 2× longer acceptance lengths than MTP techniques (Eagle-3, MTP, dFlash). We run 2 forward passes… but the 2× higher acceptance means we break even - and with zero overhead from extra drafter, KV cache, or LM head that comes with MTP - those are not free. Last week we released Nemotron-Labs-Diffusion + Tri-mode LLMs! We did continued pre-training on Ministral-3 models by switching attention patterns (block causal bidirectional). Result: one model that runs AR mode, Diffusion mode, and Self-Speculation. Diffusion mode already shows high benchmark accuracy - excited to see what happens when someone beats left-to-right acceptance! 🔥 Github: Paper: SGLang inference: Try the models on HF:

Pavlo Molchanov

66,604 Aufrufe • vor 2 Monaten

We’ve seen humanoid robots walk around for a while, but when will they actually help with useful tasks in daily life? The challenge here is the diversity and complexity of real-world scenes. Our new work tackles this problem via 3D visuomotor policy learning. Using data from only 1 scene, our Improved 3D Diffusion Policy (iDP3) enables a full-sized humanoid robot to autonomously pick&place objects, pour water, and wipe tables, in the wild open world. (and all these skills are useful, right?) Web: Fully open-sourced code:
0:18

We’ve seen humanoid robots walk around for a while, but when will they actually help with useful tasks in daily life? The challenge here is the diversity and complexity of real-world scenes. Our new work tackles this problem via 3D visuomotor policy learning. Using data from only 1 scene, our Improved 3D Diffusion Policy (iDP3) enables a full-sized humanoid robot to autonomously pick&place objects, pour water, and wipe tables, in the wild open world. (and all these skills are useful, right?) Web: Fully open-sourced code:

Yanjie Ze

75,312 Aufrufe • vor 1 Jahr

The most interesting part of this robot is not the arm. It is the gripper. Instead of pushing the whole robot faster, this setup adds speed at the end effector. The gripper itself becomes a moving axis that can accelerate independently of the arm. That changes the physics of the system. • Faster cycle times without stressing the robot structure • Less inertia to fight against • Motion where it actually matters, at the tool center point It is a reminder that many performance limits in robotics are not solved by bigger motors, but by smarter mechanics. ——- Weekly robotics and AI insights. Subscribe free:
0:14

The most interesting part of this robot is not the arm. It is the gripper. Instead of pushing the whole robot faster, this setup adds speed at the end effector. The gripper itself becomes a moving axis that can accelerate independently of the arm. That changes the physics of the system. • Faster cycle times without stressing the robot structure • Less inertia to fight against • Motion where it actually matters, at the tool center point It is a reminder that many performance limits in robotics are not solved by bigger motors, but by smarter mechanics. ——- Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

46,721 Aufrufe • vor 10 Tagen

First, they sowed the grass seeds and now cover them with soil. This keeps the seeds moist, protected from birds, and helps them germinate much better – often they wouldn’t sprout otherwise. The fruit basket is cheap and easy – most people already have one at home. If you want it faster and more even, use the compost roller. Either way, the grass seeds are happy!
0:18

First, they sowed the grass seeds and now cover them with soil. This keeps the seeds moist, protected from birds, and helps them germinate much better – often they wouldn’t sprout otherwise. The fruit basket is cheap and easy – most people already have one at home. If you want it faster and more even, use the compost roller. Either way, the grass seeds are happy!

Landscape Architecture

57,966 Aufrufe • vor 3 Monaten

#WATCH | Delhi: Congress MP Priyanka Gandhi Vadra says, "We are all asking for a discussion. There are problems and major issues with the education policy. Yet, you are unwilling to discuss it; instead, you are using tear gas on the students and beating them up. For what? They are our children."
0:19

#WATCH | Delhi: Congress MP Priyanka Gandhi Vadra says, "We are all asking for a discussion. There are problems and major issues with the education policy. Yet, you are unwilling to discuss it; instead, you are using tear gas on the students and beating them up. For what? They are our children."

ANI

101,306 Aufrufe • vor 1 Monat

If you buy beef from us, you deserve to know what you are supporting. This is the foundation of our herd, and the kind of selection that leads to cattle that perform well year after year and produce beef with consistency. Our bulls are built for rough terrain and hot weather, and they are expected to hold up when conditions are not easy, because that is real ranching and that is what our country asks of them. Great beef starts right here, and we are proud of how we raise it. 🛒Easy shopping at 🇺🇸 Delivery anywhere in the USA
0:19

If you buy beef from us, you deserve to know what you are supporting. This is the foundation of our herd, and the kind of selection that leads to cattle that perform well year after year and produce beef with consistency. Our bulls are built for rough terrain and hot weather, and they are expected to hold up when conditions are not easy, because that is real ranching and that is what our country asks of them. Great beef starts right here, and we are proud of how we raise it. 🛒Easy shopping at 🇺🇸 Delivery anywhere in the USA

Santa Carota Beef

18,913 Aufrufe • vor 5 Monaten