Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Sharing some exciting DYNA-1 result: zero-shot environment generalization We put DYNA-1 under test in a completely different environment from our training distribution – with an entirely different background (Dyna Robotics banner) and metal table. The table has a reflective and smooth surface, creating a wildly different visual appearance as... show more

Jason Ma

20,654 subscribers

49,008 views • 1 year ago •via X (Twitter)

Science & Technology Education

Anya Rossi• Live Now

Private livecam show

10 Comments

Jason Ma1 year ago

Original thread:

MrRobotics1 year ago

@DynaRobotics why is it 10X and doesn't look impressive as the first demo?

Hiro Protagonist1 year ago

@DynaRobotics 10x speed so it's still basically useless for real life applications. Robotics amateur hour.

pfung1 year ago

@DynaRobotics nice robustness!

Ming Qin1 year ago

@DynaRobotics The table can even reflect the robot itself, and it doesn’t seem surprised at all

atharva1 year ago

@DynaRobotics insane

Max von Wolff1 year ago

@DynaRobotics Impressive!

Humanoid Pulse1 year ago

@DynaRobotics wow- there is something sacinating in that - can watch for hours🤓

Peter Christie1 year ago

@DynaRobotics Nope….

Michael Cho - Rbt/Acc1 year ago

@DynaRobotics Impressive stuff!

Related Videos

Introducing Dynamism v1 (DYNA-1) by Dyna Robotics – the first robot foundation model built for round-the-clock, high-throughput dexterous autonomy. Here is a time-lapse video of our model autonomously folding 850+ napkins in a span of 24 hours with • 99.4% success rate — zero human intervention • 60% human throughput speed • 4.3/5 quality ratings (set by the client) A thread on our motivation, insights and results:

Introducing Dynamism v1 (DYNA-1) by Dyna Robotics – the first robot foundation model built for round-the-clock, high-throughput dexterous autonomy. Here is a time-lapse video of our model autonomously folding 850+ napkins in a span of 24 hours with • 99.4% success rate — zero human intervention • 60% human throughput speed • 4.3/5 quality ratings (set by the client) A thread on our motivation, insights and results:

Jason Ma

519,858 views • 1 year ago

A beautiful day with my daughter Rafif in the neighborhoods of Al-Mawasi, Khan Younis. We try, as much as we can, to hold on to moments of joy and to keep going, waiting for our simple right to life, safety, and stability. A different environment from the harsh reality we live in here. Rafif is a child of this world, and her right—and the right of all children in Gaza—must return one day.

A beautiful day with my daughter Rafif in the neighborhoods of Al-Mawasi, Khan Younis. We try, as much as we can, to hold on to moments of joy and to keep going, waiting for our simple right to life, safety, and stability. A different environment from the harsh reality we live in here. Rafif is a child of this world, and her right—and the right of all children in Gaza—must return one day.

Mohammed jawad 🇵🇸

13,636 views • 6 months ago

The whole point of decentralization is to have the infrastructure as diversified as possible to ensure maximum security for the project. As we were starting out and were still small, we had to test multiple different providers, including smaller ones, to find the best options for the project based on three different criteria: price, security level, and scalability. As we moved forward and got introduced to different connections, we transitioned to enterprise-level providers. We are still in talks with many of them and actively searching for more, as this is a never-ending process. Below is a video from one of our smaller data centers (one of the contractors we used earlier). This showcases how small and diversified our infrastructure is and also must be in the future, as this is the key to decentralization.

The whole point of decentralization is to have the infrastructure as diversified as possible to ensure maximum security for the project. As we were starting out and were still small, we had to test multiple different providers, including smaller ones, to find the best options for the project based on three different criteria: price, security level, and scalability. As we moved forward and got introduced to different connections, we transitioned to enterprise-level providers. We are still in talks with many of them and actively searching for more, as this is a never-ending process. Below is a video from one of our smaller data centers (one of the contractors we used earlier). This showcases how small and diversified our infrastructure is and also must be in the future, as this is the key to decentralization.

OpSec

357,428 views • 2 years ago

A question I kept returning to was how soon robots will be ubiquitous in our daily lives. Sergey uses self-driving as an analogy, but explains why robotics may not follow the same path because the cost of mistakes is very different. Self-driving took over a decade and is still in its nascency, in part because even rare mistakes are unacceptable. Robots may deploy earlier, and improve faster, because some mistakes are tolerable. Breaking a dish is different from causing an accident.

A question I kept returning to was how soon robots will be ubiquitous in our daily lives. Sergey uses self-driving as an analogy, but explains why robotics may not follow the same path because the cost of mistakes is very different. Self-driving took over a decade and is still in its nascency, in part because even rare mistakes are unacceptable. Robots may deploy earlier, and improve faster, because some mistakes are tolerable. Breaking a dish is different from causing an accident.

Patrick OShaughnessy

57,780 views • 4 months ago

Here’s How 1 McDonald’s Hamburger Contains 1300 Strands Of Different DNA. This Is The Result Of Going From Small Farms To Mega Corporations “We're pooling the bacteria from a thousand different animals” “Thousands of animals” contribute “to a single hamburger.” “This is a combo bin of meat. The meat in these boxes comes from many different animals and many different places. Some is even from overseas. All of it is ground together to make the juicy hamburger Americans love. Hamburger used to be the scraps left over from butchering just one cow.” But a significant change has occurred. Now parts of many cows are blended together by the ton. ‌ If we take the meat from one animal, grind it up and make ground beef from just one animal, we're including only the bacteria from one animal. But if we take the meat from a thousand different animals and grind that together, we're pooling the bacteria from a thousand different animals as well. So explain this to me, how many different cows would be in one burger? Well, I suspect that there are hundreds or even thousands of animals that have contributed to a single hamburger.”

Here’s How 1 McDonald’s Hamburger Contains 1300 Strands Of Different DNA. This Is The Result Of Going From Small Farms To Mega Corporations “We're pooling the bacteria from a thousand different animals” “Thousands of animals” contribute “to a single hamburger.” “This is a combo bin of meat. The meat in these boxes comes from many different animals and many different places. Some is even from overseas. All of it is ground together to make the juicy hamburger Americans love. Hamburger used to be the scraps left over from butchering just one cow.” But a significant change has occurred. Now parts of many cows are blended together by the ton. ‌ If we take the meat from one animal, grind it up and make ground beef from just one animal, we're including only the bacteria from one animal. But if we take the meat from a thousand different animals and grind that together, we're pooling the bacteria from a thousand different animals as well. So explain this to me, how many different cows would be in one burger? Well, I suspect that there are hundreds or even thousands of animals that have contributed to a single hamburger.”

Wall Street Apes

3,114,142 views • 2 years ago

Curious whether video generation models (like #SORA) qualify as world models? We conduct a systematic study to answer this question by investigating whether a video gen model is able to learn physical laws. Three are three key messages to take home: 1⃣The model generalises perfectly for in-distribution data, but fails to do out-of-distribution generalization. For combinatorial scenarios, scaling law is observed. 2⃣The models fail to abstract general rules and instead tries to mimic the closest training example. 3⃣The model prioritizes different attributes when referencing training data: color > size > velocity > shape. This work is a joint effort with our outstanding intern Yang Yue@ICML 7.7-7.9. Paper: Webpage:

Curious whether video generation models (like #SORA) qualify as world models? We conduct a systematic study to answer this question by investigating whether a video gen model is able to learn physical laws. Three are three key messages to take home: 1⃣The model generalises perfectly for in-distribution data, but fails to do out-of-distribution generalization. For combinatorial scenarios, scaling law is observed. 2⃣The models fail to abstract general rules and instead tries to mimic the closest training example. 3⃣The model prioritizes different attributes when referencing training data: color > size > velocity > shape. This work is a joint effort with our outstanding intern Yang Yue@ICML 7.7-7.9. Paper: Webpage:

Bingyi Kang

606,632 views • 1 year ago

Physics feels stable, predictable, and well-behaved largely because we learned it in 3D. That comfort hides a trap. In 1907, Paul Ehrenfest pointed out something unsettling. If you take the laws we treat as fundamental and transplant them into a different number of spatial dimensions, they often stop working the way we expect. Not just numerically different but qualitatively different. The issue isn’t the force law by itself but it's geometry. Gauss’s law ties inverse-square forces to the surface area of spheres, and sphere geometry depends on dimension. Change the dimension, and the same-looking force produces a different potential, a different balance of attraction and inertia, and a different fate for motion.

Physics feels stable, predictable, and well-behaved largely because we learned it in 3D. That comfort hides a trap. In 1907, Paul Ehrenfest pointed out something unsettling. If you take the laws we treat as fundamental and transplant them into a different number of spatial dimensions, they often stop working the way we expect. Not just numerically different but qualitatively different. The issue isn’t the force law by itself but it's geometry. Gauss’s law ties inverse-square forces to the surface area of spheres, and sphere geometry depends on dimension. Change the dimension, and the same-looking force produces a different potential, a different balance of attraction and inertia, and a different fate for motion.

Mathelirium

30,521 views • 4 months ago

The holy grail of robotics is to be able to perform previously-unseen, out-of-distribution manipulation tasks “zero shot” in a new environment. NovaFlow proposes an approach which (1) generates a video, (2) computes predicted flow — how points move through the scene — and (3) uses this flow as an objective to generate a motion. Using this procedure, NovaFlow generates motions in unseen scenes, for unseen tasks, and can transfer across embodiments. To learn more, we are joined by Hongyu Li and Jiahui Fu from RAI. Watch Episode #63 of RoboPapers with Chris Paxton and Michael Cho - Rbt/Acc now to learn more!

The holy grail of robotics is to be able to perform previously-unseen, out-of-distribution manipulation tasks “zero shot” in a new environment. NovaFlow proposes an approach which (1) generates a video, (2) computes predicted flow — how points move through the scene — and (3) uses this flow as an objective to generate a motion. Using this procedure, NovaFlow generates motions in unseen scenes, for unseen tasks, and can transfer across embodiments. To learn more, we are joined by Hongyu Li and Jiahui Fu from RAI. Watch Episode #63 of RoboPapers with Chris Paxton and Michael Cho - Rbt/Acc now to learn more!

RoboPapers

21,295 views • 5 months ago

Shout-out to the artist community We love art, images, and ideas that make the world feel different, even strange at times. As a team, we are always curious about new art and enjoy sharing the gems we stumble upon with our community. From photography to AI and code-based art, here are some of the works we have loved over the past few weeks. We hope you enjoy them as much as we do! ↓

Shout-out to the artist community We love art, images, and ideas that make the world feel different, even strange at times. As a team, we are always curious about new art and enjoy sharing the gems we stumble upon with our community. From photography to AI and code-based art, here are some of the works we have loved over the past few weeks. We hope you enjoy them as much as we do! ↓

Fellowship

28,756 views • 3 months ago

Sincitium is finally here. We are pleased to present our latest piece: a concept trailer created specifically for the Runway Big Pitch Contest. For this project, we wanted to explore a completely different aesthetic from our usual studio style, and this film is the result of that experimentation. We hope you enjoy it as much as we enjoyed the creative process. Produced by: Contanimation Directed by: Javier De La Chica and Guillermo Miranda Art Direction: Javier De La Chica Editing: Guillermo Miranda Voices: Juan Rabadán #runwaybigpitchcontest

Sincitium is finally here. We are pleased to present our latest piece: a concept trailer created specifically for the Runway Big Pitch Contest. For this project, we wanted to explore a completely different aesthetic from our usual studio style, and this film is the result of that experimentation. We hope you enjoy it as much as we enjoyed the creative process. Produced by: Contanimation Directed by: Javier De La Chica and Guillermo Miranda Art Direction: Javier De La Chica Editing: Guillermo Miranda Voices: Juan Rabadán #runwaybigpitchcontest

Contanimation

3,072,747 views • 2 months ago

A HISTORIC MOMENT FOR BUZSTOPBOYS! 🚀♻️ FROM PLASTIC WASTE TO PURPOSE. Today, we proudly celebrate a milestone that once seemed like a dream. Buzstopboys has successfully produced its very first recycled product from plastic waste collected from our environment. This is more than a product. It is proof that with vision, commitment, and collective action, waste can become opportunity and pollution can become possibility. POWERED ENTIRELY BY VOLUNTEERS. Every cleanup, every bag of plastic collected, every hour invested, and every step that led to this achievement has been driven by people who simply chose to serve. No one was paid to make this happen. It is the result of selfless volunteers who believe that protecting our environment is everyone's responsibility. THIS IS ONLY THE BEGINNING. Today, we celebrate a recycled product. Tomorrow, we build a movement that transforms communities, creates opportunities, and inspires a new generation to see waste not as an end, but as the beginning of something valuable. To every volunteer, partner, supporter, and believer in our mission-this victory belongs to you. WE DON'T JUST CLEAN OUR ENVIRONMENT. WE CREATE ITS FUTURE. The journey continues.

A HISTORIC MOMENT FOR BUZSTOPBOYS! 🚀♻️ FROM PLASTIC WASTE TO PURPOSE. Today, we proudly celebrate a milestone that once seemed like a dream. Buzstopboys has successfully produced its very first recycled product from plastic waste collected from our environment. This is more than a product. It is proof that with vision, commitment, and collective action, waste can become opportunity and pollution can become possibility. POWERED ENTIRELY BY VOLUNTEERS. Every cleanup, every bag of plastic collected, every hour invested, and every step that led to this achievement has been driven by people who simply chose to serve. No one was paid to make this happen. It is the result of selfless volunteers who believe that protecting our environment is everyone's responsibility. THIS IS ONLY THE BEGINNING. Today, we celebrate a recycled product. Tomorrow, we build a movement that transforms communities, creates opportunities, and inspires a new generation to see waste not as an end, but as the beginning of something valuable. To every volunteer, partner, supporter, and believer in our mission-this victory belongs to you. WE DON'T JUST CLEAN OUR ENVIRONMENT. WE CREATE ITS FUTURE. The journey continues.

Buzstopboys

46,285 views • 9 days ago

Emergency Rule and Election in Rivers an Affront, Nigeria Operating as If It Has No Constitution - Attah The situation in Nigeria is dire. By all indications, the devil has arrived in the country. The one cure we desperately need is to acknowledge that we have strayed from the vision we once agreed upon for Nigeria. We had envisioned Nigeria as a federation, complete with all the essential components of federalism. Instead, we have dismantled those components and replaced them with something entirely different. Victor Attah, Former Governor of Akwa Ibom State

Emergency Rule and Election in Rivers an Affront, Nigeria Operating as If It Has No Constitution - Attah The situation in Nigeria is dire. By all indications, the devil has arrived in the country. The one cure we desperately need is to acknowledge that we have strayed from the vision we once agreed upon for Nigeria. We had envisioned Nigeria as a federation, complete with all the essential components of federalism. Instead, we have dismantled those components and replaced them with something entirely different. Victor Attah, Former Governor of Akwa Ibom State

ARISE NEWS

24,185 views • 10 months ago

The co-founders of Flapping Airplanes call the current RL paradigm for model training "environment slop." They explain: "The reinforcement paradigms of today are shockingly inefficient. You don't really get much generalization across tasks, you teach a model through one kind of learning and then you teach it the next one. It's kind of like whack-a-mole. We look at this and think it's kind of crazy. The next paradigm of AI will not be environment slop." "Human level intelligence is not the ceiling, it is merely the floor on what is possible. If you can train models with vastly less data and possibly more compute in very different ways, what is going to happen? We actually don't know. But I do think they'll be different and weird and they'll have interesting capabilities that we'll find really valuable ways to use."

The co-founders of Flapping Airplanes call the current RL paradigm for model training "environment slop." They explain: "The reinforcement paradigms of today are shockingly inefficient. You don't really get much generalization across tasks, you teach a model through one kind of learning and then you teach it the next one. It's kind of like whack-a-mole. We look at this and think it's kind of crazy. The next paradigm of AI will not be environment slop." "Human level intelligence is not the ceiling, it is merely the floor on what is possible. If you can train models with vastly less data and possibly more compute in very different ways, what is going to happen? We actually don't know. But I do think they'll be different and weird and they'll have interesting capabilities that we'll find really valuable ways to use."

TBPN

85,358 views • 6 months ago

Our world is vast, but we are all in it together. And this is our shared cause – peace. 🇺🇦 proposed its Peace Formula to the world. As long as invaders remain on our land, no one will sit down at the negotiating table with 🇷🇺. The colonizer must get out. And the world has enough power to force 🇷🇺 to restore peace step by step. We have developed the Peace Formula in a way that ensures each of its points is backed by United Nations 🇺🇳 resolutions. And in a way that everyone in the world can choose the track they can contribute to. From Japan to the Arab countries, from Europe to Latin America, we find support for our Formula. And we continue this work.

Our world is vast, but we are all in it together. And this is our shared cause – peace. 🇺🇦 proposed its Peace Formula to the world. As long as invaders remain on our land, no one will sit down at the negotiating table with 🇷🇺. The colonizer must get out. And the world has enough power to force 🇷🇺 to restore peace step by step. We have developed the Peace Formula in a way that ensures each of its points is backed by United Nations 🇺🇳 resolutions. And in a way that everyone in the world can choose the track they can contribute to. From Japan to the Arab countries, from Europe to Latin America, we find support for our Formula. And we continue this work.

Volodymyr Zelenskyy / Володимир Зеленський

2,286,783 views • 3 years ago

Enabling autonomous vehicles perceive their environment using only off-the-shelf cameras has been a long term research objective at Swaayatt Robots. This demo highlights the capabilities of our on-road perception system which is able to detect obstacles, road boundaries, lane markers in images, as well as compute depth of the complex scenes in the environment. The output shown in this video is end-to-end raw output from our deep learning system, without any post processing. The current system, with joint computation of obstacles, lane/road boundaries, and depth, works at 30 FPS on an embedded GPU in our autonomous vehicle, and can achieve higher FPS with further optimization -- which is currently a research in progress. This system is being scaled up for both the day and night operations, and we will showcase its strength towards enabling autonomous driving on a mountainous environment with unpaved roads, in the absence of any delimiters. #deeplearning #autonomousdriving #autonomousvehicles #machinelearning

Enabling autonomous vehicles perceive their environment using only off-the-shelf cameras has been a long term research objective at Swaayatt Robots. This demo highlights the capabilities of our on-road perception system which is able to detect obstacles, road boundaries, lane markers in images, as well as compute depth of the complex scenes in the environment. The output shown in this video is end-to-end raw output from our deep learning system, without any post processing. The current system, with joint computation of obstacles, lane/road boundaries, and depth, works at 30 FPS on an embedded GPU in our autonomous vehicle, and can achieve higher FPS with further optimization -- which is currently a research in progress. This system is being scaled up for both the day and night operations, and we will showcase its strength towards enabling autonomous driving on a mountainous environment with unpaved roads, in the absence of any delimiters. #deeplearning #autonomousdriving #autonomousvehicles #machinelearning

Sanjeev Sharma

18,478 views • 1 year ago

Optimus Primal was one of the fan favourites from Transformers Rise of the Beasts and also one of our heaviest characters. As the leader of the Maximals and the most popular character from Beast Wars it was important to get him to feel brutish and powerful but also recognisable. We had really good concept art with several different directions which the studio wanted us to explore. We spent a lot of time trying out different looks for him, experimenting with different levels of wear and tear, rust, and looks for his synthetic fur. I served as the Character Lead and was responsible for the Primary Texturing and Look Development as well as the Modeling of the eyes and their lighting setup. I am very happy with how the character turned out in the film and fans reactions to seeing him on the big screen for the first time.

Optimus Primal was one of the fan favourites from Transformers Rise of the Beasts and also one of our heaviest characters. As the leader of the Maximals and the most popular character from Beast Wars it was important to get him to feel brutish and powerful but also recognisable. We had really good concept art with several different directions which the studio wanted us to explore. We spent a lot of time trying out different looks for him, experimenting with different levels of wear and tear, rust, and looks for his synthetic fur. I served as the Character Lead and was responsible for the Primary Texturing and Look Development as well as the Modeling of the eyes and their lighting setup. I am very happy with how the character turned out in the film and fans reactions to seeing him on the big screen for the first time.

Rassoul Edji

37,319 views • 1 year ago

VITA Towards Open-Source Interactive Omni Multimodal LLM discuss: The remarkable multimodal capabilities and interactive experience of GPT-4o underscore their necessity in practical applications, yet open-source models rarely excel in both areas. In this paper, we introduce VITA, the first-ever open-source Multimodal Large Language Model (MLLM) adept at simultaneous processing and analysis of Video, Image, Text, and Audio modalities, and meanwhile has an advanced multimodal interactive experience. Starting from Mixtral 8x7B as a language foundation, we expand its Chinese vocabulary followed by bilingual instruction tuning. We further endow the language model with visual and audio capabilities through two-stage multi-task learning of multimodal alignment and instruction tuning. VITA demonstrates robust foundational capabilities of multilingual, vision, and audio understanding, as evidenced by its strong performance across a range of both unimodal and multimodal benchmarks. Beyond foundational capabilities, we have made considerable progress in enhancing the natural multimodal human-computer interaction experience. To the best of our knowledge, we are the first to exploit non-awakening interaction and audio interrupt in MLLM. VITA is the first step for the open-source community to explore the seamless integration of multimodal understanding and interaction. While there is still lots of work to be done on VITA to get close to close-source counterparts, we hope that its role as a pioneer can serve as a cornerstone for subsequent research.

VITA Towards Open-Source Interactive Omni Multimodal LLM discuss: The remarkable multimodal capabilities and interactive experience of GPT-4o underscore their necessity in practical applications, yet open-source models rarely excel in both areas. In this paper, we introduce VITA, the first-ever open-source Multimodal Large Language Model (MLLM) adept at simultaneous processing and analysis of Video, Image, Text, and Audio modalities, and meanwhile has an advanced multimodal interactive experience. Starting from Mixtral 8x7B as a language foundation, we expand its Chinese vocabulary followed by bilingual instruction tuning. We further endow the language model with visual and audio capabilities through two-stage multi-task learning of multimodal alignment and instruction tuning. VITA demonstrates robust foundational capabilities of multilingual, vision, and audio understanding, as evidenced by its strong performance across a range of both unimodal and multimodal benchmarks. Beyond foundational capabilities, we have made considerable progress in enhancing the natural multimodal human-computer interaction experience. To the best of our knowledge, we are the first to exploit non-awakening interaction and audio interrupt in MLLM. VITA is the first step for the open-source community to explore the seamless integration of multimodal understanding and interaction. While there is still lots of work to be done on VITA to get close to close-source counterparts, we hope that its role as a pioneer can serve as a cornerstone for subsequent research.

AK

23,958 views • 1 year ago