Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

🚀 First demonstration of learning-accelerated trajectory optimization in space! Our team used a neural network to warm-start trajectory optimization for the NASA's Astrobee free-flying robot on-board the International Space Station, cutting solver iterations by up to 60% while maintaining safety constraints. 🎥 Video: 📄 Paper: 📅 Submitted to iSpaRo...

drmapavone's profile picture

Marco Pavone

5,554 subscribers

11,154 Aufrufe • vor 11 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Last week we wrapped up our training at SpaceX - Crew-12 is certified for flight and ready to go to the International Space Station! We’ve now entered quarantine and are prepping our families and logistics. We’re L-13 days from launch at the NASA's Kennedy Space Center! It has truly been an honor to work with this team - I love it when a plan comes together! Photos courtesy of SpaceX
0:18

Last week we wrapped up our training at SpaceX - Crew-12 is certified for flight and ready to go to the International Space Station! We’ve now entered quarantine and are prepping our families and logistics. We’re L-13 days from launch at the NASA's Kennedy Space Center! It has truly been an honor to work with this team - I love it when a plan comes together! Photos courtesy of SpaceX

Jessica Meir

45,113 Aufrufe • vor 5 Monaten

🚀 Excited to share our #ICLR2025 work on planning with neural dynamics models! While our lab has developed diverse neural dynamics models for manipulating rigid, deformable, and granular objects, having the model alone doesn’t solve the problem—planning with it remains a challenge. 💡 Enter BaB-ND, led by Keyi and Jiangwei! We propose a scalable, GPU-accelerated branch-and-bound algorithm, inspired by neural network verification, to enable effective planning for diverse objects modeled with neural dynamics. 🔗 Project page (open-source + detailed docs!): 🎥 Watch the video to see T being pushed around obstacles, and check out Keyi’s thread for more details!
0:14

🚀 Excited to share our #ICLR2025 work on planning with neural dynamics models! While our lab has developed diverse neural dynamics models for manipulating rigid, deformable, and granular objects, having the model alone doesn’t solve the problem—planning with it remains a challenge. 💡 Enter BaB-ND, led by Keyi and Jiangwei! We propose a scalable, GPU-accelerated branch-and-bound algorithm, inspired by neural network verification, to enable effective planning for diverse objects modeled with neural dynamics. 🔗 Project page (open-source + detailed docs!): 🎥 Watch the video to see T being pushed around obstacles, and check out Keyi’s thread for more details!

Yunzhu Li

10,561 Aufrufe • vor 1 Jahr

Haven't been to a conference in a while, really excited to be at #NeurIPS2024! I'll be helping present 4 of our group's recent papers: 1. Overcoming the Sim-to-Real Gap: Leveraging Simulation to Learn to Explore for Real-World RL 2. Distributional Successor Features Enable Zero-Shot Policy Optimization 3. Learning to Cooperate with Humans using Generative Agents 4. Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learning Find more details on each paper and where to find us in this thread (1/6)
0:25

Haven't been to a conference in a while, really excited to be at #NeurIPS2024! I'll be helping present 4 of our group's recent papers: 1. Overcoming the Sim-to-Real Gap: Leveraging Simulation to Learn to Explore for Real-World RL 2. Distributional Successor Features Enable Zero-Shot Policy Optimization 3. Learning to Cooperate with Humans using Generative Agents 4. Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learning Find more details on each paper and where to find us in this thread (1/6)

Abhishek Gupta

10,803 Aufrufe • vor 1 Jahr

"Life moves pretty fast. If you don't stop and look around once in a while, you could miss it." 💫 Enjoy this nighttime orbital time-lapse taken by ARCHIVED NASA Astronauts astronaut Don Pettit from the Japanese Experiment Module on the International International Space Station. At first glance, it’s easy to only notice the stars and auroras flying by. With a second look, there’s an abundance of science and exterior instruments capturing data that benefit humanity and help us better understand our universe.
0:11

"Life moves pretty fast. If you don't stop and look around once in a while, you could miss it." 💫 Enjoy this nighttime orbital time-lapse taken by ARCHIVED NASA Astronauts astronaut Don Pettit from the Japanese Experiment Module on the International International Space Station. At first glance, it’s easy to only notice the stars and auroras flying by. With a second look, there’s an abundance of science and exterior instruments capturing data that benefit humanity and help us better understand our universe.

NASA's Johnson Space Center

58,364 Aufrufe • vor 1 Jahr

EDGS: Eliminating Densification for Efficient Convergence of 3DGS Contributions: • We show that initial triangulation based on 2D correspondences can replace the incremental refinement process, fundamentally changing how 3DGS models allocate resources. • Our method reduces the path each Gaussian must travel in parameter space. Careful initialization not only accelerates convergence but also guides optimization toward a convergence point corresponding to lower reconstruction error and thus higher reconstruction quality. • Our approach outperforms both speed-optimized and quality-focused state-of-the-art models while using only half the splats of standard 3DGS. By improving initialization rather than altering the optimization process, this method is compatible with other 3DGS acceleration techniques, making it a flexible enhancement to existing models.
0:15

EDGS: Eliminating Densification for Efficient Convergence of 3DGS Contributions: • We show that initial triangulation based on 2D correspondences can replace the incremental refinement process, fundamentally changing how 3DGS models allocate resources. • Our method reduces the path each Gaussian must travel in parameter space. Careful initialization not only accelerates convergence but also guides optimization toward a convergence point corresponding to lower reconstruction error and thus higher reconstruction quality. • Our approach outperforms both speed-optimized and quality-focused state-of-the-art models while using only half the splats of standard 3DGS. By improving initialization rather than altering the optimization process, this method is compatible with other 3DGS acceleration techniques, making it a flexible enhancement to existing models.

MrNeRF

124,131 Aufrufe • vor 1 Jahr

Diffusion models are an amazing tool for cofolding, they allow us to predict a protein and the molecule bound to it at once. But they are not exactly fast and require a lot of denoising steps to get accurate predictions. So we distilled ours. Meet DeCAF-Pearl: the first flow map model for all-atom cofolding. Instead of inching along the denoising trajectory, a flow map learns to jump across it. DeCAF-Pearl runs structure generation ~5x faster than Pearl, our SOTA model, while still maintaining the performance of the teacher model. That speed up allows us to run larger experiments and generate more synthetic data to improve our models. Getting there meant reparameterizing into noise-level space to stabilize gradients, committing to clean-structure prediction to keep the rigid-alignment loss biomolecules needed, and building DeCAF-Search, one steering algorithm for every compute budget. For more technical details, read out blog post: And the paper:
0:11

Diffusion models are an amazing tool for cofolding, they allow us to predict a protein and the molecule bound to it at once. But they are not exactly fast and require a lot of denoising steps to get accurate predictions. So we distilled ours. Meet DeCAF-Pearl: the first flow map model for all-atom cofolding. Instead of inching along the denoising trajectory, a flow map learns to jump across it. DeCAF-Pearl runs structure generation ~5x faster than Pearl, our SOTA model, while still maintaining the performance of the teacher model. That speed up allows us to run larger experiments and generate more synthetic data to improve our models. Getting there meant reparameterizing into noise-level space to stabilize gradients, committing to clean-structure prediction to keep the rigid-alignment loss biomolecules needed, and building DeCAF-Search, one steering algorithm for every compute budget. For more technical details, read out blog post: And the paper:

Sergey Edunov

36,985 Aufrufe • vor 1 Monat

Disappointed with your ICLR paper being rejected? Ten years ago today, Sergey and I finished training some of the first end-to-end neutral nets for robot control 🤖 We submitted the paper to RSS on January 23, 2015. It was rejected for being "incremental" and "unlikely to have much impact" Our resubmission to NeurIPS was also rejected It now has >4,000 citations (and more importantly, end-to-end training is widely accepted!) It's also cool to think about what's changed and what's the same -- - The network was 92k parameters and trained on ~15 minutes of data - The code was a combination of matlab, caffe, ROS, a custom CUDA kernel for speed, and a low-level 20 Hz controller in C++, all talking to each other. ROS+matlab was as bad as it sounds. - We pre-trained the encoder and did inference off-board on a workstation with a larger GPU. - We were paranoid about varying lighting messing up the network, so we did all the experiments after sunset (so long nights running experiments on the robot past 3 am) Now, we have manipulation policies that are far more dextrous, far more generalizable, and maybe on the cusp of breaking into the real world. :) (the paper:
0:16

Disappointed with your ICLR paper being rejected? Ten years ago today, Sergey and I finished training some of the first end-to-end neutral nets for robot control 🤖 We submitted the paper to RSS on January 23, 2015. It was rejected for being "incremental" and "unlikely to have much impact" Our resubmission to NeurIPS was also rejected It now has >4,000 citations (and more importantly, end-to-end training is widely accepted!) It's also cool to think about what's changed and what's the same -- - The network was 92k parameters and trained on ~15 minutes of data - The code was a combination of matlab, caffe, ROS, a custom CUDA kernel for speed, and a low-level 20 Hz controller in C++, all talking to each other. ROS+matlab was as bad as it sounds. - We pre-trained the encoder and did inference off-board on a workstation with a larger GPU. - We were paranoid about varying lighting messing up the network, so we did all the experiments after sunset (so long nights running experiments on the robot past 3 am) Now, we have manipulation policies that are far more dextrous, far more generalizable, and maybe on the cusp of breaking into the real world. :) (the paper:

Chelsea Finn

169,073 Aufrufe • vor 1 Jahr

When a spacecraft leaves Earth, it doesn’t just fire its engines and head straight to its destination. In many missions, especially those going beyond low Earth orbit, there’s a more subtle and elegant strategy at play, one that uses gravity itself as part of the navigation system. This is often called a gravity assist, or a slingshot maneuver. But in the case of missions like #Artemis II, what’s being used is a closely related idea known as a free-return trajectory. At first glance, it might sound simple: the spacecraft goes to the Moon, loops around it, and comes back. But the physics behind it is anything but simple. Instead of relying on continuous propulsion, the spacecraft follows a carefully calculated path through the gravitational field of the Earth–Moon system. It is launched with just the right speed and direction so that, as it approaches the Moon, the Moon’s gravity bends its trajectory. The spacecraft is effectively flung around the Moon, redirected onto a path that naturally brings it back toward Earth. No major engine burn is needed for the return. Small trajectory corrections may still be required, but gravity does the heavy lifting. That’s the key. This kind of trajectory is not just efficient, it’s also safe. If something goes wrong with the spacecraft’s engines or onboard systems, gravity itself ensures the return. It’s an inherent backup plan, built into the trajectory from the very beginning. The same fundamental idea appears in gravity assists used across the Solar System. When a spacecraft flies past a planet, it can gain or lose speed by exchanging momentum with that planet. From the spacecraft’s point of view, it’s as if it has been accelerated without using fuel. In reality, it has borrowed a tiny amount of orbital energy from the planet itself. That’s how missions like Voyager reached the outer planets, and how probes continue to explore regions far beyond what their onboard fuel alone would allow. But there’s an important distinction. An interplanetary gravity assist is typically used to change speed and direction, often increasing the spacecraft’s energy. A free-return trajectory, like the one used in Artemis II, is designed for something more specific: a path that naturally loops back to Earth without requiring additional propulsion. It’s less about gaining energy, and more about shaping a trajectory that guarantees a return. To understand why this works, it helps to stop thinking in straight lines. In space, motion follows curves defined by gravity. The spacecraft is constantly falling, first toward Earth, then toward the Moon, and then back toward Earth again. What looks like a loop is really a continuous free fall through a changing gravitational landscape. This way of navigating space reveals something deeper. We tend to think of engines as the drivers of motion, but once a spacecraft is on its way, gravity does most of the work. The art of spaceflight is not just about thrust. It’s about knowing when not to use it. #GoodLuck #Artemis NASA Artemis
0:11

When a spacecraft leaves Earth, it doesn’t just fire its engines and head straight to its destination. In many missions, especially those going beyond low Earth orbit, there’s a more subtle and elegant strategy at play, one that uses gravity itself as part of the navigation system. This is often called a gravity assist, or a slingshot maneuver. But in the case of missions like #Artemis II, what’s being used is a closely related idea known as a free-return trajectory. At first glance, it might sound simple: the spacecraft goes to the Moon, loops around it, and comes back. But the physics behind it is anything but simple. Instead of relying on continuous propulsion, the spacecraft follows a carefully calculated path through the gravitational field of the Earth–Moon system. It is launched with just the right speed and direction so that, as it approaches the Moon, the Moon’s gravity bends its trajectory. The spacecraft is effectively flung around the Moon, redirected onto a path that naturally brings it back toward Earth. No major engine burn is needed for the return. Small trajectory corrections may still be required, but gravity does the heavy lifting. That’s the key. This kind of trajectory is not just efficient, it’s also safe. If something goes wrong with the spacecraft’s engines or onboard systems, gravity itself ensures the return. It’s an inherent backup plan, built into the trajectory from the very beginning. The same fundamental idea appears in gravity assists used across the Solar System. When a spacecraft flies past a planet, it can gain or lose speed by exchanging momentum with that planet. From the spacecraft’s point of view, it’s as if it has been accelerated without using fuel. In reality, it has borrowed a tiny amount of orbital energy from the planet itself. That’s how missions like Voyager reached the outer planets, and how probes continue to explore regions far beyond what their onboard fuel alone would allow. But there’s an important distinction. An interplanetary gravity assist is typically used to change speed and direction, often increasing the spacecraft’s energy. A free-return trajectory, like the one used in Artemis II, is designed for something more specific: a path that naturally loops back to Earth without requiring additional propulsion. It’s less about gaining energy, and more about shaping a trajectory that guarantees a return. To understand why this works, it helps to stop thinking in straight lines. In space, motion follows curves defined by gravity. The spacecraft is constantly falling, first toward Earth, then toward the Moon, and then back toward Earth again. What looks like a loop is really a continuous free fall through a changing gravitational landscape. This way of navigating space reveals something deeper. We tend to think of engines as the drivers of motion, but once a spacecraft is on its way, gravity does most of the work. The art of spaceflight is not just about thrust. It’s about knowing when not to use it. #GoodLuck #Artemis NASA Artemis

Erika 

234,886 Aufrufe • vor 3 Monaten

Yes, that was space junk spotted in our bay area skies this evening… video by Jamie Li spotted from San Mateo. As a general rule: meteors, move, much faster and usually end with a flash of light, the orbiting space junk tends to move more slowly and can be easily followed across the sky as the materials burn up on reentry. 9/25/2025 NBC Bay Area
0:11

Yes, that was space junk spotted in our bay area skies this evening… video by Jamie Li spotted from San Mateo. As a general rule: meteors, move, much faster and usually end with a flash of light, the orbiting space junk tends to move more slowly and can be easily followed across the sky as the materials burn up on reentry. 9/25/2025 NBC Bay Area

Rob Mayeda

25,759 Aufrufe • vor 10 Monaten

A lot of elected officials are still silent in response to what occurred in Toronto this weekend. Why does antisemitism continuously get a free pass to override our laws and safety? It seems our government holds no space for hate, unless Jews are the target. To those in a position of power, wake up and start doing your job. It is because of your lack of leadership and inability to act with moral clarity that has brought us here. 8 months of this nonsense. No more lip service and empty platitudes. We have a criminal code, we have laws. Enforce them.
0:10

A lot of elected officials are still silent in response to what occurred in Toronto this weekend. Why does antisemitism continuously get a free pass to override our laws and safety? It seems our government holds no space for hate, unless Jews are the target. To those in a position of power, wake up and start doing your job. It is because of your lack of leadership and inability to act with moral clarity that has brought us here. 8 months of this nonsense. No more lip service and empty platitudes. We have a criminal code, we have laws. Enforce them.

Victoria Mancinelli

10,849 Aufrufe • vor 2 Jahren

NASA’s Epic 685,000-Mile Moon Odyssey! Get ready for history in the making! Right now, NASA’s Artemis II mission is blazing a trail through deep space on an incredible 10-day journey covering more than 685,000 miles — and it’s already halfway to the Moon.Four brave astronauts are currently farther from Earth than any humans have traveled in over half a century, riding aboard the Orion spacecraft on a daring voyage that will take them on a breathtaking flyby of the lunar this video, we break down the full adventure: the outbound trajectory, the dramatic lunar flyby, and the precise free-return path that will slingshot them safely back home. You’ll see exactly how Orion navigates the vast emptiness of space using clever orbital mechanics and innovative mission design.Artemis II marks the first crewed flight of NASA’s Artemis program — the bold step that will return humans to the Moon and open the door to sustained lunar exploration and beyond.Buckle up — this is how humanity returns to deep space!
0:12

NASA’s Epic 685,000-Mile Moon Odyssey! Get ready for history in the making! Right now, NASA’s Artemis II mission is blazing a trail through deep space on an incredible 10-day journey covering more than 685,000 miles — and it’s already halfway to the Moon.Four brave astronauts are currently farther from Earth than any humans have traveled in over half a century, riding aboard the Orion spacecraft on a daring voyage that will take them on a breathtaking flyby of the lunar this video, we break down the full adventure: the outbound trajectory, the dramatic lunar flyby, and the precise free-return path that will slingshot them safely back home. You’ll see exactly how Orion navigates the vast emptiness of space using clever orbital mechanics and innovative mission design.Artemis II marks the first crewed flight of NASA’s Artemis program — the bold step that will return humans to the Moon and open the door to sustained lunar exploration and beyond.Buckle up — this is how humanity returns to deep space!

Black Hole

21,046 Aufrufe • vor 3 Monaten

Hey #NeuraxonMini is literally out! , we manage to "transplant" a Neuraxon 2 bioinspired #AI brain to a physical robot the #SpheroMini moving from our last Scientific Paper (link bellow) by David Vivancos - e/acc & Jose Sánchez for Qubic #OpenScience hybridized with #Aigarth to the real World. First you need a Sphero Education Mini robot about 50$ Then you can try the first cool demos at Hugging Face: 1.- Neuraxon2MiniControl to drive the sphero robot 2.- Neuraxon2MiniWrite to write letters or words with physical moves of the sphero robot using Neuraxon Video Tutorials on youtube later today. Why this matters? Remember we are not building "dead" LLMs we are building #AliveAIs and for that we need to explore how it behaves in reality, from how it learns to how it fails, and what better way that in the emerging field of #robotics , time will tell if your next #HumanoidRobot have a #Neuraxon brain... Read the Paper: Explore the Neuraxon code here: Are you ready for #TrueAI ?
0:15

Hey #NeuraxonMini is literally out! , we manage to "transplant" a Neuraxon 2 bioinspired #AI brain to a physical robot the #SpheroMini moving from our last Scientific Paper (link bellow) by David Vivancos - e/acc & Jose Sánchez for Qubic #OpenScience hybridized with #Aigarth to the real World. First you need a Sphero Education Mini robot about 50$ Then you can try the first cool demos at Hugging Face: 1.- Neuraxon2MiniControl to drive the sphero robot 2.- Neuraxon2MiniWrite to write letters or words with physical moves of the sphero robot using Neuraxon Video Tutorials on youtube later today. Why this matters? Remember we are not building "dead" LLMs we are building #AliveAIs and for that we need to explore how it behaves in reality, from how it learns to how it fails, and what better way that in the emerging field of #robotics , time will tell if your next #HumanoidRobot have a #Neuraxon brain... Read the Paper: Explore the Neuraxon code here: Are you ready for #TrueAI ?

David Vivancos - e/acc

29,293 Aufrufe • vor 5 Monaten

The Sabotaging Practice of Over Supply and Sameness in the NFT Space. The current zeitgeist of the NFT space is that the same artists are doing the same kind of work five times a year, with project after project leaving a trail of disappointment and discontent among collectors and all of us watching in disbelief as huge resources are extracted from the space over work that feels like it could be left as an "artist study." I understand that you can do what you want with your money as collectors, but we are killing the whole space with this incestuous practice. No artist is that prolific to be able to do 5 collections of 100+ pieces each every year and actually deliver innovation and some kind of creative evolution. Of course, they can pretend play that the work has something new, but there is no precedent nor proof that that has ever happened in the speed that it happens in the NFT space. Again, people are free to through away their resources on whatever they want but with this way of doing things, we more and more are going to start seeing the consequences. Oh! There are consequences? Yes. Maybe unintended, but there are. Let's see. Let's start with the loss of belief in the NFT space as somewhere where emerging artists can come and find support for their experiments. Why even bother to bring experiments, innovation, and new ways to think of art on the blockchain if the same people have all the collectors hypnotized with their magical flutes? Why even try to come to a space where taking risks and challenging the status quo (the mission of art!!!) is overlooked? This makes the NFT space a social club and not a space for art. I guess it is fine, but IMO it is a recipe for disaster. New collectors stay away because the art will slowly but surely become stale and un-challenging. Why even bother to come and see what is happening here if you can't, as a collector, see new weird and up-and-coming artists? The amount of noise emitted by the same artists doing the same art over and over, drowns out any new voices. Again. A recipe for disaster. The NFT space is becoming a space of disappointment and doubt. We think that collections going to zero one after the other, over and over, is not damaging? I feel we are kidding ourselves. Disappointment piles up, and again, the people who will hurt are the emerging artists, the new blood, the ones who are willing to risk the most and, in return, put fire in this cold space of sameness. I love this space—don't get me wrong—it has changed my life, and I believe it has a ton of potential, but things need to change for it to become a beacon of light in art. But we need to support new voices. We need to support new ideas. The challenge is huge. I hope to contribute all I can to this change. I hope more and more see how exciting it is to go out and try to discover what else is out there and move this space forward. But again, I understand the leaps of faith needed, but if there is a space that is based on that, it's the NFT space...so there is hope. We will see. 📺by Boldtron
0:12

The Sabotaging Practice of Over Supply and Sameness in the NFT Space. The current zeitgeist of the NFT space is that the same artists are doing the same kind of work five times a year, with project after project leaving a trail of disappointment and discontent among collectors and all of us watching in disbelief as huge resources are extracted from the space over work that feels like it could be left as an "artist study." I understand that you can do what you want with your money as collectors, but we are killing the whole space with this incestuous practice. No artist is that prolific to be able to do 5 collections of 100+ pieces each every year and actually deliver innovation and some kind of creative evolution. Of course, they can pretend play that the work has something new, but there is no precedent nor proof that that has ever happened in the speed that it happens in the NFT space. Again, people are free to through away their resources on whatever they want but with this way of doing things, we more and more are going to start seeing the consequences. Oh! There are consequences? Yes. Maybe unintended, but there are. Let's see. Let's start with the loss of belief in the NFT space as somewhere where emerging artists can come and find support for their experiments. Why even bother to bring experiments, innovation, and new ways to think of art on the blockchain if the same people have all the collectors hypnotized with their magical flutes? Why even try to come to a space where taking risks and challenging the status quo (the mission of art!!!) is overlooked? This makes the NFT space a social club and not a space for art. I guess it is fine, but IMO it is a recipe for disaster. New collectors stay away because the art will slowly but surely become stale and un-challenging. Why even bother to come and see what is happening here if you can't, as a collector, see new weird and up-and-coming artists? The amount of noise emitted by the same artists doing the same art over and over, drowns out any new voices. Again. A recipe for disaster. The NFT space is becoming a space of disappointment and doubt. We think that collections going to zero one after the other, over and over, is not damaging? I feel we are kidding ourselves. Disappointment piles up, and again, the people who will hurt are the emerging artists, the new blood, the ones who are willing to risk the most and, in return, put fire in this cold space of sameness. I love this space—don't get me wrong—it has changed my life, and I believe it has a ton of potential, but things need to change for it to become a beacon of light in art. But we need to support new voices. We need to support new ideas. The challenge is huge. I hope to contribute all I can to this change. I hope more and more see how exciting it is to go out and try to discover what else is out there and move this space forward. But again, I understand the leaps of faith needed, but if there is a space that is based on that, it's the NFT space...so there is hope. We will see. 📺by Boldtron

alejandro cartagena

98,261 Aufrufe • vor 2 Jahren

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.
0:12

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.

MrNeRF

52,801 Aufrufe • vor 1 Jahr

At the 47th Annual Lakota Nation Invitational Basketball Tournament the Pine Ridge Thorpes boys basketball team show their solidarity and call on President Biden to give Executive Clemency for Leonard Peltier. This is a beautiful demonstration of the intergenerational support for this longstanding call for Justice! Free Leonard Peltier now! The White House President Donald J. Trump Join us in the call to #FreeLeonardPeltier by: ➡️ Telling President Biden to grant Executive Clemency for our relative: ➡️ Calling the White House at 202-456-1111, send an email: comments@whitehouse.gov ➡️ Contacting your Representatives: ➡️ Joining our #FreeLeonardPeltier Network and tell us why the fight to #FreeLeonardPeltier is important to you! ➡️ Texting “FreeLeonardNow” to 50302 to stay up to date on upcoming actions to free our relative. ➡️ Leave a Whitehouse Comment
0:14

At the 47th Annual Lakota Nation Invitational Basketball Tournament the Pine Ridge Thorpes boys basketball team show their solidarity and call on President Biden to give Executive Clemency for Leonard Peltier. This is a beautiful demonstration of the intergenerational support for this longstanding call for Justice! Free Leonard Peltier now! The White House President Donald J. Trump Join us in the call to #FreeLeonardPeltier by: ➡️ Telling President Biden to grant Executive Clemency for our relative: ➡️ Calling the White House at 202-456-1111, send an email: [email protected] ➡️ Contacting your Representatives: ➡️ Joining our #FreeLeonardPeltier Network and tell us why the fight to #FreeLeonardPeltier is important to you! ➡️ Texting “FreeLeonardNow” to 50302 to stay up to date on upcoming actions to free our relative. ➡️ Leave a Whitehouse Comment

NDN Collective

38,003 Aufrufe • vor 1 Jahr

BOOM! Humanoid Robots Just Performed Surgery for the First Time! REAL VIDEO! In a groundbreaking preclinical breakthrough, researchers at UC San Diego have achieved what many thought was years away: teleoperated humanoid robots successfully completing live surgeries. Published in Nature, the study marks the world’s first use of humanoid robots for in-vivo laparoscopic procedures on large animals (pigs). Two separate surgeries were completed: Key Details •. Procedure: Laparoscopic gallbladder removal (cholecystectomy) •. Team 1: Human surgeon + one humanoid robot (the robot performed core tasks while the human assisted) •. Team 2: Two humanoid robots working together with no human at the operating table •. Robots: Custom “Surgie” humanoids (~5 ft tall, ~60 lbs) using standard surgical tools •. Control: Fully teleoperated by surgeons (remote human control, not autonomous) •. Significance: First demonstration of humanoid robots handling real surgical workflows in a live setting, proving compatibility with existing OR tools and spaces This proof shows humanoid robots could one day help address surgeon shortages, enable remote procedures in rural areas, battlefields, or even space all at a fraction of the cost and space of traditional surgical robots like da Vinci. Read the full publication here: Project page with video: The future of surgery just got a whole lot more interesting. And medical cost for the first time in decades will be scheduled to go down, much further down.
0:12

BOOM! Humanoid Robots Just Performed Surgery for the First Time! REAL VIDEO! In a groundbreaking preclinical breakthrough, researchers at UC San Diego have achieved what many thought was years away: teleoperated humanoid robots successfully completing live surgeries. Published in Nature, the study marks the world’s first use of humanoid robots for in-vivo laparoscopic procedures on large animals (pigs). Two separate surgeries were completed: Key Details •. Procedure: Laparoscopic gallbladder removal (cholecystectomy) •. Team 1: Human surgeon + one humanoid robot (the robot performed core tasks while the human assisted) •. Team 2: Two humanoid robots working together with no human at the operating table •. Robots: Custom “Surgie” humanoids (~5 ft tall, ~60 lbs) using standard surgical tools •. Control: Fully teleoperated by surgeons (remote human control, not autonomous) •. Significance: First demonstration of humanoid robots handling real surgical workflows in a live setting, proving compatibility with existing OR tools and spaces This proof shows humanoid robots could one day help address surgeon shortages, enable remote procedures in rural areas, battlefields, or even space all at a fraction of the cost and space of traditional surgical robots like da Vinci. Read the full publication here: Project page with video: The future of surgery just got a whole lot more interesting. And medical cost for the first time in decades will be scheduled to go down, much further down.

Brian Roemmele

107,357 Aufrufe • vor 17 Tagen

AllStreetBets Partners with Wire Network to Build the World's Largest Decentralized Finance Community. 📌 AllStreetBets ($BETS), an emerging leader in decentralized finance, culture, and community, is thrilled to announce a landmark partnership with Wire Network. This collaboration represents a pivotal milestone towards a decentralized future for all, combining Wire Network's cutting-edge transaction technology, identity, and decentralized AI infrastructure with AllStreetBets' mission to enable financial sovereignty without censorship. 🤝 AllStreetBets ($BETS), co-founded by and Jaime Rogozinski, the visionary creator of WallStreetBets, is establishing a decentralized global powerhouse beyond the confines of Wall Street. By harnessing cutting-edge blockchain technology, AllStreetBets can surpass previous achievements and break free from centralization, censorship, and financial constraints. Wire Network has pioneered the world's first universal transaction layer for all blockchains, introducing a groundbreaking approach to transacting assets across all chains with low gas, high transactions per second, and eliminating the need for hazardous bridging protocols. First, there was on-chain; now, there is “on Wire.” Together, AllStreetBets and Wire Network will develop disruptive applications and technologies to enhance the value proposition of $BETS, offer unique products, and drive web3 tech adoption and community building. Wire Network's technology will seamlessly integrate with AllStreetBets' applications, providing secure and efficient transactions that surpass traditional on-chain methods. This partnership will expand AllStreetBets' ecosystem, granting access to hundreds of thousands of new users and unified liquidity pools. Our collaboration with Wire Network positions AllStreetBets at the forefront of innovation, merging blockchain, AI, and decentralized finance. We're excited about the potential this partnership holds to bring "first-to-market" applications to our community. For more information, visit our header link tree and follow to learn more about Wire.
0:10

AllStreetBets Partners with Wire Network to Build the World's Largest Decentralized Finance Community. 📌 AllStreetBets ($BETS), an emerging leader in decentralized finance, culture, and community, is thrilled to announce a landmark partnership with Wire Network. This collaboration represents a pivotal milestone towards a decentralized future for all, combining Wire Network's cutting-edge transaction technology, identity, and decentralized AI infrastructure with AllStreetBets' mission to enable financial sovereignty without censorship. 🤝 AllStreetBets ($BETS), co-founded by and Jaime Rogozinski, the visionary creator of WallStreetBets, is establishing a decentralized global powerhouse beyond the confines of Wall Street. By harnessing cutting-edge blockchain technology, AllStreetBets can surpass previous achievements and break free from centralization, censorship, and financial constraints. Wire Network has pioneered the world's first universal transaction layer for all blockchains, introducing a groundbreaking approach to transacting assets across all chains with low gas, high transactions per second, and eliminating the need for hazardous bridging protocols. First, there was on-chain; now, there is “on Wire.” Together, AllStreetBets and Wire Network will develop disruptive applications and technologies to enhance the value proposition of $BETS, offer unique products, and drive web3 tech adoption and community building. Wire Network's technology will seamlessly integrate with AllStreetBets' applications, providing secure and efficient transactions that surpass traditional on-chain methods. This partnership will expand AllStreetBets' ecosystem, granting access to hundreds of thousands of new users and unified liquidity pools. Our collaboration with Wire Network positions AllStreetBets at the forefront of innovation, merging blockchain, AI, and decentralized finance. We're excited about the potential this partnership holds to bring "first-to-market" applications to our community. For more information, visit our header link tree and follow to learn more about Wire.

allstreetbets

28,044 Aufrufe • vor 2 Jahren

❄️ Dear Players, On behalf of the entire Romance Club team, we want to say a simple and heartfelt thank you. Thank you for being with us, for your trust, and for choosing our stories year after year, living them alongside the characters, and filling this world with emotion and meaning. When we first embarked on this journey, we could never have imagined that Romance Club would become such a vital, personal space for people all over the world. It is because of you that this game has grown into something more: a space for feelings, support, and inspiration. In the coming year, we wish you more warmth, more joy, and more of those quiet, happy moments that deserve to be savored. May the path ahead be filled with bright stories, both on the pages of our novels and in your own lives. And to make your New Year’s Eve a little brighter, we’ve prepared a small gift for you—a festive promo code: 65NQ7UN3ESDM 🎁 May it become one more warm moment in your evening. With sincere gratitude and warmest wishes, The Romance Club Team 💞 #adventcalendar #romanceclub #visualnovel #mobilegame #winter
0:15

❄️ Dear Players, On behalf of the entire Romance Club team, we want to say a simple and heartfelt thank you. Thank you for being with us, for your trust, and for choosing our stories year after year, living them alongside the characters, and filling this world with emotion and meaning. When we first embarked on this journey, we could never have imagined that Romance Club would become such a vital, personal space for people all over the world. It is because of you that this game has grown into something more: a space for feelings, support, and inspiration. In the coming year, we wish you more warmth, more joy, and more of those quiet, happy moments that deserve to be savored. May the path ahead be filled with bright stories, both on the pages of our novels and in your own lives. And to make your New Year’s Eve a little brighter, we’ve prepared a small gift for you—a festive promo code: 65NQ7UN3ESDM 🎁 May it become one more warm moment in your evening. With sincere gratitude and warmest wishes, The Romance Club Team 💞 #adventcalendar #romanceclub #visualnovel #mobilegame #winter

Romance Club

34,737 Aufrufe • vor 6 Monaten