Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Two months ago, at an RSS workshop panel, I said that general real2sim reconstruction is still far from solved, especially for articulated objects, which will be a major bottleneck for robotics. But now that has totally changed with Astra; using several photos as input, we can easily reconstruct vivid... show more

Siyuan Huang

5,273 subscribers

19,361 Aufrufe • vor 1 Monat •via X (Twitter)

Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Here’s something you didn’t know LLMs can do – reconstruct articulated objects! Introducing Real2Code – our new real2sim approach that scalably reconstructs complex, multi-part articulated objects.

Here’s something you didn’t know LLMs can do – reconstruct articulated objects! Introducing Real2Code – our new real2sim approach that scalably reconstructs complex, multi-part articulated objects.

Mandi Zhao

91,951 Aufrufe • vor 2 Jahren

Hardware is a big constraint in robotics, that's why we don't think the answer will be increasingly larger VLM models as action backbones. We tried to solve that issue with WorldDiT, which is at the pareto frontier for size-performance. Now I want to see how far we can scale it without losing this tradeoff. Here's a simulation demo.

Hardware is a big constraint in robotics, that's why we don't think the answer will be increasingly larger VLM models as action backbones. We tried to solve that issue with WorldDiT, which is at the pareto frontier for size-performance. Now I want to see how far we can scale it without losing this tradeoff. Here's a simulation demo.

Bidhan Roy

11,405 Aufrufe • vor 3 Monaten

[ ANNOUNCEMENT FOR THE RORIIPUPPER ARKNIGHTS X PERSONA 3 R COLLAB GLOBAL GIVEAWAY ] Scarf and I are months ahead of schedule, but that's because we want the event to be special and fun. Here is a preview of a prototype of the site that we will be using for the Arknights x Persona3R giveaway that we are going to hold. The instructions for how to join the giveaway are not final and may be changed later as we may add more things to give away and better requirements to prevent cheaters as much as we can. Here is also a preview of the raffle/roulette animation that will decide the winners for the giveaway. I know we're six months early, however we're just so hyped and we have a lot of ideas art and animation wise for it. For now, this is what we can show y'all.

[ ANNOUNCEMENT FOR THE RORIIPUPPER ARKNIGHTS X PERSONA 3 R COLLAB GLOBAL GIVEAWAY ] Scarf and I are months ahead of schedule, but that's because we want the event to be special and fun. Here is a preview of a prototype of the site that we will be using for the Arknights x Persona3R giveaway that we are going to hold. The instructions for how to join the giveaway are not final and may be changed later as we may add more things to give away and better requirements to prevent cheaters as much as we can. Here is also a preview of the raffle/roulette animation that will decide the winners for the giveaway. I know we're six months early, however we're just so hyped and we have a lot of ideas art and animation wise for it. For now, this is what we can show y'all.

Roriipupper腰王

54,528 Aufrufe • vor 2 Monaten

I’ve been eyeing this robotics platform by Vicarius Surgical for a long time and I am vi-curious to see what it can do. I like that the engineers/designers solved the surgical robotics problem in a different way. I wonder how strong it is and does it scale

I’ve been eyeing this robotics platform by Vicarius Surgical for a long time and I am vi-curious to see what it can do. I like that the engineers/designers solved the surgical robotics problem in a different way. I wonder how strong it is and does it scale

Jonathan DeLong, MD

112,338 Aufrufe • vor 3 Jahren

For 41 years, to find shortest paths in a graph, the Dijkstra’s algorithm, was seen as the best possible way. Not any longer: Now a team from Tsinghua University has beaten it. They created the first faster algorithm for directed shortest paths since 1984. • Faster than Dijkstra on large sparse graphs • Works with real, non-negative edge weights • Proves that sorting is not the main bottleneck anymore Shortest-path algorithms power maps, GPS, logistics, networking, and robotics. This result shows that even the most “finished” algorithms can still be improved. Thanks for sharing, Md Ismail Šojal 🕷️! 📍 Paper: —— Weekly robotics and AI insights. Subscribe free:

For 41 years, to find shortest paths in a graph, the Dijkstra’s algorithm, was seen as the best possible way. Not any longer: Now a team from Tsinghua University has beaten it. They created the first faster algorithm for directed shortest paths since 1984. • Faster than Dijkstra on large sparse graphs • Works with real, non-negative edge weights • Proves that sorting is not the main bottleneck anymore Shortest-path algorithms power maps, GPS, logistics, networking, and robotics. This result shows that even the most “finished” algorithms can still be improved. Thanks for sharing, Md Ismail Šojal 🕷️! 📍 Paper: —— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

95,380 Aufrufe • vor 9 Monaten

Shopify is building the foundation for agentic commerce. Universal Commerce Protocol, which we co-developed with Google, is now live. UCP will make it faster for agents and retailers to integrate. It’s open by default, so platforms and agents can use UCP to start transacting with any merchant. Major retailers are already using it. Agents can handle everything from discovery to fulfillment, and support things like discounts, subscriptions, and loyalty programs. We’ve accounted for all types of commerce.

Shopify is building the foundation for agentic commerce. Universal Commerce Protocol, which we co-developed with Google, is now live. UCP will make it faster for agents and retailers to integrate. It’s open by default, so platforms and agents can use UCP to start transacting with any merchant. Major retailers are already using it. Agents can handle everything from discovery to fulfillment, and support things like discounts, subscriptions, and loyalty programs. We’ve accounted for all types of commerce.

tobi lutke

895,742 Aufrufe • vor 9 Monaten

The USA will now establish a new military base at Mestersvig in Eastern Greenland. Very few people on earth have been there so here a few photos from when I was there two years ago. It is a wonderful place and it breaks my heart that it will be an American base but that is a treaty right that they have had since 1951.

The USA will now establish a new military base at Mestersvig in Eastern Greenland. Very few people on earth have been there so here a few photos from when I was there two years ago. It is a wonderful place and it breaks my heart that it will be an American base but that is a treaty right that they have had since 1951.

Rasmus Jarlov

41,649 Aufrufe • vor 1 Monat

Impressive demo from Sharpa! I like how you can also do the challenge. I can tell you now that the robot is better than me… #robotics #physicalai

Impressive demo from Sharpa! I like how you can also do the challenge. I can tell you now that the robot is better than me… #robotics #physicalai

Jonathan Stephens

35,321 Aufrufe • vor 1 Monat

An update for everyone who is not in our Discord... Obviously we are still early in development, and our team has been working hard to release updates for everyone to see. We have a peak at the terrain, which is this picture is based of the North Dakota drift prairie, Great care, time and effort was put into the terrain to create smooth rolling hills, the road network in this region will be challenging, just as it is in real life. From Will The current state of the TIV2 model, which will include a lot more in depth details, From Jlkillen03 The stages of damage to a Blender made house, From Kunahic And how texturing will be used for assets like the interiors! From BSP

An update for everyone who is not in our Discord... Obviously we are still early in development, and our team has been working hard to release updates for everyone to see. We have a peak at the terrain, which is this picture is based of the North Dakota drift prairie, Great care, time and effort was put into the terrain to create smooth rolling hills, the road network in this region will be challenging, just as it is in real life. From Will The current state of the TIV2 model, which will include a lot more in depth details, From Jlkillen03 The stages of damage to a Blender made house, From Kunahic And how texturing will be used for assets like the interiors! From BSP

Severity

18,960 Aufrufe • vor 7 Monaten

People as far as the eye can see...what a crowd, especially for an event that has been delayed for 4 hours. This is Indy! #Indy500

People as far as the eye can see...what a crowd, especially for an event that has been delayed for 4 hours. This is Indy! #Indy500

Zach Halverson

189,702 Aufrufe • vor 2 Jahren

The Rapture is so close now. I live every minute in anticipation of this glorious event. Are you ready for the twinkling of an eye, at the last trumpet. For the trumpet will sound, the dead will be raised imperishable, and we will be changed! So get ready for the Rapture!!!

The Rapture is so close now. I live every minute in anticipation of this glorious event. Are you ready for the twinkling of an eye, at the last trumpet. For the trumpet will sound, the dead will be raised imperishable, and we will be changed! So get ready for the Rapture!!!

Benjamin Rapture Ready

42,665 Aufrufe • vor 3 Jahren

It's 2030 and you are reviewing humanoid robots. A Tesla. A Google. An Apple. An OpenAI. A Meta. A Figure. And a bunch of Chinese-made ones. Which one is best, and why? I think the Tesla understands the world much better. Why? There were eight Teslas around me on the freeway today. Start there. No other robot company has that data. But my robot is parked at the local high school twice a day. Its cameras see humans in all of our weirdness. How we move. Where we go. Where we walk. Who we talk with. What you are wearing. Whether your hair was combed this morning. That data will lead to robotics breakthroughs. Apple might keep up with its Vision Pro data, but it is too freaked out by the privacy implications of using said data. (On the front are six cameras and a couple of TOF -- Time Of Flight -- sensors that can see everything in your home in great detail). Google has a lot of data, for sure. All my: 1. Email. 2. Calendars. 3. Photos. 4. TV watching behavior. 5. Contacts. 6. Documents and spreadsheets. 7. Files. 8. Location data. So I expect Google's robot will be attractive to many. But how do you see the others shake out over the next five years? Make some guesses. But remember what an AI pioneer told me years ago about AI: it's all about the data. The Chinese ones have huge advantages: the Chinese have more data on their citizens, and many more citizens to boot AND they can make robots cheaper than we can. But now that you know OpenAI is building its own robot you have caught wind of what I've heard from many in San Francisco and Silicon Valley: that humanoid robots are the real prize of AI and will be highly profitable for those that can make them and find customers willing to buy them. Here, too, I learned long ago never to bet against Elon Musk. Will you?

It's 2030 and you are reviewing humanoid robots. A Tesla. A Google. An Apple. An OpenAI. A Meta. A Figure. And a bunch of Chinese-made ones. Which one is best, and why? I think the Tesla understands the world much better. Why? There were eight Teslas around me on the freeway today. Start there. No other robot company has that data. But my robot is parked at the local high school twice a day. Its cameras see humans in all of our weirdness. How we move. Where we go. Where we walk. Who we talk with. What you are wearing. Whether your hair was combed this morning. That data will lead to robotics breakthroughs. Apple might keep up with its Vision Pro data, but it is too freaked out by the privacy implications of using said data. (On the front are six cameras and a couple of TOF -- Time Of Flight -- sensors that can see everything in your home in great detail). Google has a lot of data, for sure. All my: 1. Email. 2. Calendars. 3. Photos. 4. TV watching behavior. 5. Contacts. 6. Documents and spreadsheets. 7. Files. 8. Location data. So I expect Google's robot will be attractive to many. But how do you see the others shake out over the next five years? Make some guesses. But remember what an AI pioneer told me years ago about AI: it's all about the data. The Chinese ones have huge advantages: the Chinese have more data on their citizens, and many more citizens to boot AND they can make robots cheaper than we can. But now that you know OpenAI is building its own robot you have caught wind of what I've heard from many in San Francisco and Silicon Valley: that humanoid robots are the real prize of AI and will be highly profitable for those that can make them and find customers willing to buy them. Here, too, I learned long ago never to bet against Elon Musk. Will you?

Robert Scoble

33,804 Aufrufe • vor 1 Jahr

The washing machine we bought for 83K a year and half ago is now 188K 😲, and the Fridge we saw two weeks ago which was 195K is now being sold for 225K when we went to buy it 😭! And And I broke the screen of my phone which I bought for 60K 3 years ago. And I took it to a maintenance shop and screen only costs 53K 😭😭😭 I guess I will be phone less for a while! #Ethiopia #InflationNation #ToughLife #SendHelp

The washing machine we bought for 83K a year and half ago is now 188K 😲, and the Fridge we saw two weeks ago which was 195K is now being sold for 225K when we went to buy it 😭! And And I broke the screen of my phone which I bought for 60K 3 years ago. And I took it to a maintenance shop and screen only costs 53K 😭😭😭 I guess I will be phone less for a while! #Ethiopia #InflationNation #ToughLife #SendHelp

ኃይለማርያም/ ባንቴ

13,912 Aufrufe • vor 7 Monaten

I animated this months ago and it was shown at the panel tonight, so here it is for y’all.

I animated this months ago and it was shown at the panel tonight, so here it is for y’all.

Glorious720p

190,726 Aufrufe • vor 1 Jahr

In the summer of 2023, I cold emailed Jensen Huang and asked to capture a NeRF of him at SIGGRAPH. He responded in about an hour and said yes. A radiance field is, in the simplest terms, akin to a 3D photograph. A moment in time, so completely reconstructed that you can move through it and see it from angles the original cameras never occupied. NeRFs were the original method. Gaussian splatting, which debuted at that same SIGGRAPH, has since become the dominant form of radiance field. I called my late friend James, who told me we needed to begin practicing immediately. We ran capture after capture for weeks until we consistently got the capture time down to ~30 seconds with one camera. Later, in a hallway at the LA Convention Center during SIGGRAPH, I captured the portrait you're seeing now, a full 360° gaussian splat of Jensen, rendered here as a 2D flythrough. Afterward, I continued the conversation with him and members of his team to make the case for radiance fields as a foundational representation for imaging. To my surprise, they listened. Three years later, NVIDIA has several works, including NuRec, fVDB, 3DGRUT, and gsplat all utilizing radiance fields. The landscape has evolved enough that the reasoning is obvious. Gaussian splatting has begun to ship across some of the world’s largest industries, including autonomous vehicles, AEC, geospatial, media and entertainment, robotics, e-commerce, hospitality. It’s become clear that lifelike 3D is here to stay. And yet I think we will look back and be disappointed by how late we started taking 3D portraits of the people around us, just like how we have sparse 2D photos of our grandparents and great grandparents. We have billions of photographs of the people we know and love, but almost no radiance fields of them. I'll be returning to SIGGRAPH in LA where this was initially captured three years ago, with the landscape looking significantly different. Radiance fields are more under deployed than ever relative to what they can do. I'm excited for the future of imaging, and for 2D to transition into 3D. I have a few things up my sleeve that I think will make that case plainly.

In the summer of 2023, I cold emailed Jensen Huang and asked to capture a NeRF of him at SIGGRAPH. He responded in about an hour and said yes. A radiance field is, in the simplest terms, akin to a 3D photograph. A moment in time, so completely reconstructed that you can move through it and see it from angles the original cameras never occupied. NeRFs were the original method. Gaussian splatting, which debuted at that same SIGGRAPH, has since become the dominant form of radiance field. I called my late friend James, who told me we needed to begin practicing immediately. We ran capture after capture for weeks until we consistently got the capture time down to ~30 seconds with one camera. Later, in a hallway at the LA Convention Center during SIGGRAPH, I captured the portrait you're seeing now, a full 360° gaussian splat of Jensen, rendered here as a 2D flythrough. Afterward, I continued the conversation with him and members of his team to make the case for radiance fields as a foundational representation for imaging. To my surprise, they listened. Three years later, NVIDIA has several works, including NuRec, fVDB, 3DGRUT, and gsplat all utilizing radiance fields. The landscape has evolved enough that the reasoning is obvious. Gaussian splatting has begun to ship across some of the world’s largest industries, including autonomous vehicles, AEC, geospatial, media and entertainment, robotics, e-commerce, hospitality. It’s become clear that lifelike 3D is here to stay. And yet I think we will look back and be disappointed by how late we started taking 3D portraits of the people around us, just like how we have sparse 2D photos of our grandparents and great grandparents. We have billions of photographs of the people we know and love, but almost no radiance fields of them. I'll be returning to SIGGRAPH in LA where this was initially captured three years ago, with the landscape looking significantly different. Radiance fields are more under deployed than ever relative to what they can do. I'm excited for the future of imaging, and for 2D to transition into 3D. I have a few things up my sleeve that I think will make that case plainly.

Radiance Fields

18,195 Aufrufe • vor 4 Monaten

Many of you know Kenny 2RawTooReal as quick witted with an eloquent, if lethal, tongue, and as the master of impromptu gathering. All of which he is... But what I am BLESSED to know is that he is a generous and nurtuing friend with a skilled mind who has the ability to see each friend individually and care for them accordingly. Kenny is a gifted young man who God will continue to take from glory to glory. This new year in his life will be his best year thus far... And I know the best is yet to come.

Many of you know Kenny 2RawTooReal as quick witted with an eloquent, if lethal, tongue, and as the master of impromptu gathering. All of which he is... But what I am BLESSED to know is that he is a generous and nurtuing friend with a skilled mind who has the ability to see each friend individually and care for them accordingly. Kenny is a gifted young man who God will continue to take from glory to glory. This new year in his life will be his best year thus far... And I know the best is yet to come.

Zackory Kirk

118,822 Aufrufe • vor 2 Jahren

Universities and High Schools have not moved rapidly enough to guide students to have skills for the next decade. THEY HAVE FAILED. It is a massive crisis that can be averted by understanding what AI and Robotics will bring about. Solutions are knowing how to use these tools and new industries that will rise. But this situation is also on ALL OF US. No “job” is safe from founder to entry level in most industries. You and I, by what we do, will be “replaced” ultimately. What to do? AI and Robotics are tools, the next decade is owned by those who know how to use them expertly, but this is also temporary. We have to understand that what we do for “work” will change giving ultimately a greater value to those that are: Creative Flexible Always learning Willing to be wrong Love being human Love being alive Know history Covet wisdom Knowing all tech has downsides Building strong family and friends Realize many institutions have failed The first four are required for you to be able to live through this period with your sanity intact. The rest will allow you to thrive. There are no true careers at this point anymore. There are advocation and vocations which will either earn you money or give life meaning. We will learn that we are not “what we do”, just like we knew for 99% of human existence. Let that sink in. — You and I are far, far ahead of knowing this and we can do two things: 1) Laugh at the “clueless” 2) Help people understand with grace Go to Reddit if you are 1, in fact don’t follow me because you will not like this next decade and what I post. You are 2 and thank you. Even if you and I have not solved this issue, we can help people understand what is ahead and with determination and creativity bound together to solve it locally. Or human family has done this millions of times. The evidence is: you are here. The Neo Luddite movement has not even begun and it will potentially rip apart society even more than all the fashionable moment in the recent past has. These Luddites will have a good point with the wrong answers cooked up by dying academics that cling to labels, “virtues” and victim hood. It will be readymade for some governments to enter in as “big daddy” to “help us”. You will not like what they do, but you will only know when it is too late. It will include YOU “volunteering” to “leave” by 60, to “help out” CanadaPod style. “Brian, I’m 24 what do I do?”. I hope to do much more here to help. But I do know this: 1) Learn a trade or vocation because it’s valuable. It may also be free to low cost if you do it right. 2) Learn everything you can about USING AI and TRAINING YOUR AI. Your expertise will be in the top 1% for a decade. But not forever. 3) Understand Bitcoin and how it will rise while other things sink. This is a short list for now. We will know more moving forward. When you see videos like this posted below, know one thing: Many of these folks had no real family of mental and physical support. Maybe no parent or one parent. Maybe only a broke system to prepare them for—nothing. This was not their doing. Now it is not your “job” to help them, it is your survival to help them if that is what you need. See some day after the dust settles these 20 year olds will be 40 year olds and running YOUR world. And at some point you may need them more than you think you do. You will need them, as they need you now. THIS IS WHAT PAST WISDOM KNEW. The elders of the past never found the need to piss on the youth and hope for the best. THE YOUTH ARE OUR BEST, let us all find ways to change it, even if every aspect of “the system” wants us to berate them into the ground.

Universities and High Schools have not moved rapidly enough to guide students to have skills for the next decade. THEY HAVE FAILED. It is a massive crisis that can be averted by understanding what AI and Robotics will bring about. Solutions are knowing how to use these tools and new industries that will rise. But this situation is also on ALL OF US. No “job” is safe from founder to entry level in most industries. You and I, by what we do, will be “replaced” ultimately. What to do? AI and Robotics are tools, the next decade is owned by those who know how to use them expertly, but this is also temporary. We have to understand that what we do for “work” will change giving ultimately a greater value to those that are: Creative Flexible Always learning Willing to be wrong Love being human Love being alive Know history Covet wisdom Knowing all tech has downsides Building strong family and friends Realize many institutions have failed The first four are required for you to be able to live through this period with your sanity intact. The rest will allow you to thrive. There are no true careers at this point anymore. There are advocation and vocations which will either earn you money or give life meaning. We will learn that we are not “what we do”, just like we knew for 99% of human existence. Let that sink in. — You and I are far, far ahead of knowing this and we can do two things: 1) Laugh at the “clueless” 2) Help people understand with grace Go to Reddit if you are 1, in fact don’t follow me because you will not like this next decade and what I post. You are 2 and thank you. Even if you and I have not solved this issue, we can help people understand what is ahead and with determination and creativity bound together to solve it locally. Or human family has done this millions of times. The evidence is: you are here. The Neo Luddite movement has not even begun and it will potentially rip apart society even more than all the fashionable moment in the recent past has. These Luddites will have a good point with the wrong answers cooked up by dying academics that cling to labels, “virtues” and victim hood. It will be readymade for some governments to enter in as “big daddy” to “help us”. You will not like what they do, but you will only know when it is too late. It will include YOU “volunteering” to “leave” by 60, to “help out” CanadaPod style. “Brian, I’m 24 what do I do?”. I hope to do much more here to help. But I do know this: 1) Learn a trade or vocation because it’s valuable. It may also be free to low cost if you do it right. 2) Learn everything you can about USING AI and TRAINING YOUR AI. Your expertise will be in the top 1% for a decade. But not forever. 3) Understand Bitcoin and how it will rise while other things sink. This is a short list for now. We will know more moving forward. When you see videos like this posted below, know one thing: Many of these folks had no real family of mental and physical support. Maybe no parent or one parent. Maybe only a broke system to prepare them for—nothing. This was not their doing. Now it is not your “job” to help them, it is your survival to help them if that is what you need. See some day after the dust settles these 20 year olds will be 40 year olds and running YOUR world. And at some point you may need them more than you think you do. You will need them, as they need you now. THIS IS WHAT PAST WISDOM KNEW. The elders of the past never found the need to piss on the youth and hope for the best. THE YOUTH ARE OUR BEST, let us all find ways to change it, even if every aspect of “the system” wants us to berate them into the ground.

Brian Roemmele

37,681 Aufrufe • vor 1 Jahr