Two months ago, at an RSS workshop panel, I... said that general real2sim reconstruction is still far from solved, especially for articulated objects, which will be a major bottleneck for robotics. But now that has totally changed with Astra; using several photos as input, we can easily reconstruct vivid articulated scenes. The result is so impressive! Excited to see how it will shift the paradigm of real2sim2real and agentic learning for robotics and humanoids.show more

Here’s something you didn’t know LLMs can do –... reconstruct articulated objects! Introducing Real2Code – our new real2sim approach that scalably reconstructs complex, multi-part articulated objects.show more

Hardware is a big constraint in robotics, that's why... we don't think the answer will be increasingly larger VLM models as action backbones. We tried to solve that issue with WorldDiT, which is at the pareto frontier for size-performance. Now I want to see how far we can scale it without losing this tradeoff. Here's a simulation demo.show more

[ ANNOUNCEMENT FOR THE RORIIPUPPER ARKNIGHTS X PERSONA 3... R COLLAB GLOBAL GIVEAWAY ] Scarf and I are months ahead of schedule, but that's because we want the event to be special and fun. Here is a preview of a prototype of the site that we will be using for the Arknights x Persona3R giveaway that we are going to hold. The instructions for how to join the giveaway are not final and may be changed later as we may add more things to give away and better requirements to prevent cheaters as much as we can. Here is also a preview of the raffle/roulette animation that will decide the winners for the giveaway. I know we're six months early, however we're just so hyped and we have a lot of ideas art and animation wise for it. For now, this is what we can show y'all.show more

I’ve been eyeing this robotics platform by Vicarius Surgical... for a long time and I am vi-curious to see what it can do. I like that the engineers/designers solved the surgical robotics problem in a different way. I wonder how strong it is and does it scaleshow more

Shopify is building the foundation for agentic commerce. Universal... Commerce Protocol, which we co-developed with Google, is now live. UCP will make it faster for agents and retailers to integrate. It’s open by default, so platforms and agents can use UCP to start transacting with any merchant. Major retailers are already using it. Agents can handle everything from discovery to fulfillment, and support things like discounts, subscriptions, and loyalty programs. We’ve accounted for all types of commerce.show more

For 41 years, to find shortest paths in a... graph, the Dijkstra’s algorithm, was seen as the best possible way. Not any longer: Now a team from Tsinghua University has beaten it. They created the first faster algorithm for directed shortest paths since 1984. • Faster than Dijkstra on large sparse graphs • Works with real, non-negative edge weights • Proves that sorting is not the main bottleneck anymore Shortest-path algorithms power maps, GPS, logistics, networking, and robotics. This result shows that even the most “finished” algorithms can still be improved. Thanks for sharing, Md Ismail Šojal 🕷️! 📍 Paper: —— Weekly robotics and AI insights. Subscribe free:show more

The USA will now establish a new military base... at Mestersvig in Eastern Greenland. Very few people on earth have been there so here a few photos from when I was there two years ago. It is a wonderful place and it breaks my heart that it will be an American base but that is a treaty right that they have had since 1951.show more

Impressive demo from Sharpa! I like how you can... also do the challenge. I can tell you now that the robot is better than me… #robotics #physicalaishow more

An update for everyone who is not in our... Discord... Obviously we are still early in development, and our team has been working hard to release updates for everyone to see. We have a peak at the terrain, which is this picture is based of the North Dakota drift prairie, Great care, time and effort was put into the terrain to create smooth rolling hills, the road network in this region will be challenging, just as it is in real life. From Will The current state of the TIV2 model, which will include a lot more in depth details, From Jlkillen03 The stages of damage to a Blender made house, From Kunahic And how texturing will be used for assets like the interiors! From BSPshow more

People as far as the eye can see...what a... crowd, especially for an event that has been delayed for 4 hours. This is Indy! #Indy500show more

The Rapture is so close now. I live every... minute in anticipation of this glorious event. Are you ready for the twinkling of an eye, at the last trumpet. For the trumpet will sound, the dead will be raised imperishable, and we will be changed! So get ready for the Rapture!!!show more

The washing machine we bought for 83K a year... and half ago is now 188K 😲, and the Fridge we saw two weeks ago which was 195K is now being sold for 225K when we went to buy it 😭! And And I broke the screen of my phone which I bought for 60K 3 years ago. And I took it to a maintenance shop and screen only costs 53K 😭😭😭 I guess I will be phone less for a while! #Ethiopia #InflationNation #ToughLife #SendHelpshow more

It's 2030 and you are reviewing humanoid robots. A... Tesla. A Google. An Apple. An OpenAI. A Meta. A Figure. And a bunch of Chinese-made ones. Which one is best, and why? I think the Tesla understands the world much better. Why? There were eight Teslas around me on the freeway today. Start there. No other robot company has that data. But my robot is parked at the local high school twice a day. Its cameras see humans in all of our weirdness. How we move. Where we go. Where we walk. Who we talk with. What you are wearing. Whether your hair was combed this morning. That data will lead to robotics breakthroughs. Apple might keep up with its Vision Pro data, but it is too freaked out by the privacy implications of using said data. (On the front are six cameras and a couple of TOF -- Time Of Flight -- sensors that can see everything in your home in great detail). Google has a lot of data, for sure. All my: 1. Email. 2. Calendars. 3. Photos. 4. TV watching behavior. 5. Contacts. 6. Documents and spreadsheets. 7. Files. 8. Location data. So I expect Google's robot will be attractive to many. But how do you see the others shake out over the next five years? Make some guesses. But remember what an AI pioneer told me years ago about AI: it's all about the data. The Chinese ones have huge advantages: the Chinese have more data on their citizens, and many more citizens to boot AND they can make robots cheaper than we can. But now that you know OpenAI is building its own robot you have caught wind of what I've heard from many in San Francisco and Silicon Valley: that humanoid robots are the real prize of AI and will be highly profitable for those that can make them and find customers willing to buy them. Here, too, I learned long ago never to bet against Elon Musk. Will you?show more

I animated this months ago and it was shown... at the panel tonight, so here it is for y’all.show more

In the summer of 2023, I cold emailed Jensen... Huang and asked to capture a NeRF of him at SIGGRAPH. He responded in about an hour and said yes. A radiance field is, in the simplest terms, akin to a 3D photograph. A moment in time, so completely reconstructed that you can move through it and see it from angles the original cameras never occupied. NeRFs were the original method. Gaussian splatting, which debuted at that same SIGGRAPH, has since become the dominant form of radiance field. I called my late friend James, who told me we needed to begin practicing immediately. We ran capture after capture for weeks until we consistently got the capture time down to ~30 seconds with one camera. Later, in a hallway at the LA Convention Center during SIGGRAPH, I captured the portrait you're seeing now, a full 360° gaussian splat of Jensen, rendered here as a 2D flythrough. Afterward, I continued the conversation with him and members of his team to make the case for radiance fields as a foundational representation for imaging. To my surprise, they listened. Three years later, NVIDIA has several works, including NuRec, fVDB, 3DGRUT, and gsplat all utilizing radiance fields. The landscape has evolved enough that the reasoning is obvious. Gaussian splatting has begun to ship across some of the world’s largest industries, including autonomous vehicles, AEC, geospatial, media and entertainment, robotics, e-commerce, hospitality. It’s become clear that lifelike 3D is here to stay. And yet I think we will look back and be disappointed by how late we started taking 3D portraits of the people around us, just like how we have sparse 2D photos of our grandparents and great grandparents. We have billions of photographs of the people we know and love, but almost no radiance fields of them. I'll be returning to SIGGRAPH in LA where this was initially captured three years ago, with the landscape looking significantly different. Radiance fields are more under deployed than ever relative to what they can do. I'm excited for the future of imaging, and for 2D to transition into 3D. I have a few things up my sleeve that I think will make that case plainly.show more

Many of you know Kenny 2RawTooReal as quick witted... with an eloquent, if lethal, tongue, and as the master of impromptu gathering. All of which he is... But what I am BLESSED to know is that he is a generous and nurtuing friend with a skilled mind who has the ability to see each friend individually and care for them accordingly. Kenny is a gifted young man who God will continue to take from glory to glory. This new year in his life will be his best year thus far... And I know the best is yet to come.show more

🤖 From humanoids greeting guests to DJ arms spinning... records and quadrupeds roaming the halls, #NVIDIAGTC is the spot for robotics. 🔗show more