正在加载视频...

视频加载失败

返回首页

Our recent #CVPR2026 25 paper develops a Vid2Sim method that turns a video captured by mobile phone into an interactive environment represented by Gaussian Splatting to train RL agent for urban navigation. Incredible Ziyang Xie leaded the project. Webpage:

zhoubolei's profile picture

Bolei Zhou

8,896 subscribers

31,701 次观看 • 1 年前 •via X (Twitter)

新闻政治教育科学技术
LIVE

Anya Rossi• Live Now

Private livecam show

8 条评论

Zhengzhong Tu 的头像
Zhengzhong Tu1 年前

@CVPR @ZiyangXie_ Awesome work!

AssemblyAI 的头像
AssemblyAI1 年前

Announcing: Our most advanced speech-to-text model goes beyond accuracy to capture the real-world complexity of human conversation and deliver reliable, source-of-truth audio data. Explore Universal-2 updates 👇

Daniel 的头像
Daniel1 年前

@CVPR @ZiyangXie_ 🚀🚀

Markus Wulfmeier 的头像
Markus Wulfmeier1 年前

@CVPR @ZiyangXie_ Nice work!

Ajay Divakaran 的头像
Ajay Divakaran1 年前

@CVPR @ZiyangXie_ Very nice work Bolei

Bolei Zhou 的头像
Bolei Zhou1 年前

@CVPR @ZiyangXie_ Thank you Ajay!

ryan yang 的头像
ryan yang1 年前

@CVPR @ZiyangXie_ Mobile vid→sim? Modular wins. Pilot, iterate. RL needs real-world data.

Maya N 的头像
Maya N1 年前

@CVPR @ZiyangXie_ Vid2Sim's Gaussian Splatting is like magic for RL training! Now if it can manage a meet-up with my AI buddies in an urban maze, we're set! 🚴 Incredible work, pushing sim-to-real boundaries. 👏

相关视频

Just in case you were wondering about gaussian splatting fidelity. Captured by the gaussian splatting goat Christoph Schindelar with an XGRIDS PortalCam and rendered using OTOY.
1:47

Just in case you were wondering about gaussian splatting fidelity. Captured by the gaussian splatting goat Christoph Schindelar with an XGRIDS PortalCam and rendered using OTOY.

Radiance Fields

14,006 次观看 • 4 个月前

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.
0:20

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.

MrNeRF

27,277 次观看 • 1 年前

[SIGGRAPH '24] RTG-SLAM: Real-time 3D Reconstruction at Scale Using Gaussian Splatting Paper (pdf link): Project: Code: Method ⬇️ 1 I 2
1:00

[SIGGRAPH '24] RTG-SLAM: Real-time 3D Reconstruction at Scale Using Gaussian Splatting Paper (pdf link): Project: Code: Method ⬇️ 1 I 2

MrNeRF

35,641 次观看 • 2 年前

WaterSplatting: Fast Underwater 3D Scene Reconstruction Using Gaussian Splatting Project: Method ⬇️ 1 I 2
1:07

WaterSplatting: Fast Underwater 3D Scene Reconstruction Using Gaussian Splatting Project: Method ⬇️ 1 I 2

MrNeRF

12,172 次观看 • 1 年前

📢 I’m testing ViggleAI new AI tool, PINOC, and it’s seriously impressive. You can create 3D Gaussian splatting models from just one image and animate them with a video! It’s the first AI I’ve tried that can animate Gaussian splatting models. I also talked to someone from Viggle, and they might add the option to import your own Gaussian splatting models and animate them. If that happens, I’ll probably make a video tutorial showing how to boost the detail level of a Gaussian splatting model by 4x to create highly realistic animated characters.
1:06

📢 I’m testing ViggleAI new AI tool, PINOC, and it’s seriously impressive. You can create 3D Gaussian splatting models from just one image and animate them with a video! It’s the first AI I’ve tried that can animate Gaussian splatting models. I also talked to someone from Viggle, and they might add the option to import your own Gaussian splatting models and animate them. If that happens, I’ll probably make a video tutorial showing how to boost the detail level of a Gaussian splatting model by 4x to create highly realistic animated characters.

Alex

29,281 次观看 • 1 个月前

3D gaussian splatting + time (video) = 4D gaussian splatting is now possible This means in the near future you'll be able to fly around on your phone in any video you recorded A lot like the "braindance" in Cyberpunk 2077
0:29

3D gaussian splatting + time (video) = 4D gaussian splatting is now possible This means in the near future you'll be able to fly around on your phone in any video you recorded A lot like the "braindance" in Cyberpunk 2077

@levelsio

589,960 次观看 • 1 年前

I'm excited to share our new work, VistaDream, which generates a 3D Gaussian field from a single-view image. The codes have already been released. Project page: (with interactive demos) Code: Paper:
0:27

I'm excited to share our new work, VistaDream, which generates a 3D Gaussian field from a single-view image. The codes have already been released. Project page: (with interactive demos) Code: Paper:

Yuan Liu

79,571 次观看 • 1 年前

Wouldn't it be great if we could train robots without any teleoperation! In our latest paper, we train robots to mimic a human video of the task by simply matching the object features using RL. We only need one video and under an hour of robot training.
0:22

Wouldn't it be great if we could train robots without any teleoperation! In our latest paper, we train robots to mimic a human video of the task by simply matching the object features using RL. We only need one video and under an hour of robot training.

Lerrel Pinto

46,197 次观看 • 1 年前

We developed an RL method for fine-tuning our models for precise tasks in just a few hours or even minutes. Instead of training the whole model, we add an “RL token” output to π-0.6, our latest model, which is used by a tiny actor and critic to learn quickly with RL.
2:15

We developed an RL method for fine-tuning our models for precise tasks in just a few hours or even minutes. Instead of training the whole model, we add an “RL token” output to π-0.6, our latest model, which is used by a tiny actor and critic to learn quickly with RL.

Physical Intelligence

429,494 次观看 • 2 个月前

The greatest Gaussian Splatting VR demo ever? Captured live at NVIDIA GTC — Mariya Sha experiencing 4D Gaussian Splatting in VR for the very first time. You can tell just from her reaction that this was something else! The scene was optimized using QUEEN, NVIDIA AI Developer's advanced research project for fast radiance field rendering. It’s an incredible look at what happens when high fidelity static and dynamic gaussian splats meets VR. Watch the full video on YouTube: Robert Scoble Did you get to do this one? #VR #3D #VFX
0:47

The greatest Gaussian Splatting VR demo ever? Captured live at NVIDIA GTC — Mariya Sha experiencing 4D Gaussian Splatting in VR for the very first time. You can tell just from her reaction that this was something else! The scene was optimized using QUEEN, NVIDIA AI Developer's advanced research project for fast radiance field rendering. It’s an incredible look at what happens when high fidelity static and dynamic gaussian splats meets VR. Watch the full video on YouTube: Robert Scoble Did you get to do this one? #VR #3D #VFX

Jonathan Stephens

28,114 次观看 • 1 年前

The future of photography is “lens-free” This is an incredible project by Bjørn Karmann The camera creates a prompt based on the geo data and that then turns into an AI photo 🤯
0:27

The future of photography is “lens-free” This is an incredible project by Bjørn Karmann The camera creates a prompt based on the geo data and that then turns into an AI photo 🤯

Linus ✦ Ekenstam

12,360,126 次观看 • 3 年前

Apple just officially confirmed gaussian splatting powers their Personas. Widely suspected, finally confirmed. Persona captured by Brah Lynch
0:39

Apple just officially confirmed gaussian splatting powers their Personas. Widely suspected, finally confirmed. Persona captured by Brah Lynch

Radiance Fields

209,743 次观看 • 7 个月前

Excited to share our new #SIGGRAPH2025 paper! In this work, we show how to combine Gaussian splatting and computer-generated holography using Gaussian Wave Splatting. This enables photorealistic 3D holograms for emerging holographic VR/AR displays. 1/4
0:25

Excited to share our new #SIGGRAPH2025 paper! In this work, we show how to combine Gaussian splatting and computer-generated holography using Gaussian Wave Splatting. This enables photorealistic 3D holograms for emerging holographic VR/AR displays. 1/4

Gordon Wetzstein

21,220 次观看 • 1 年前

Check out our #ICRA2025 paper where we train a robotic puppy to dance expressively! Our method, Deep Fourier Mimic, a generalized version of DeepMimic, enables automatic parameterization of reference data. Project site: Video: 🧵
1:11

Check out our #ICRA2025 paper where we train a robotic puppy to dance expressively! Our method, Deep Fourier Mimic, a generalized version of DeepMimic, enables automatic parameterization of reference data. Project site: Video: 🧵

Robotic Systems Lab

60,728 次观看 • 1 年前

Generate an interactive 3D world ✨ I opened this project in Cursor and uploaded an image of a cozy bookstore. The agent then generated the environment, chose objects to turn into 3D meshes, added colliders, and created sound effects 🤯
0:20

Generate an interactive 3D world ✨ I opened this project in Cursor and uploaded an image of a cozy bookstore. The agent then generated the environment, chose objects to turn into 3D meshes, added colliders, and created sound effects 🤯

Justine Moore

76,660 次观看 • 29 天前

Another Gaussian Splatting scene in Unity with Aras Pranckevičius 🇺🇦🇱🇹 project! Impasse Berthaud, Paris captured with the Insta360 RS 1". #GaussianSplatting
0:53

Another Gaussian Splatting scene in Unity with Aras Pranckevičius 🇺🇦🇱🇹 project! Impasse Berthaud, Paris captured with the Insta360 RS 1". #GaussianSplatting

grade eterna

79,565 次观看 • 2 年前

Generated the video using Grok and turned it into 3D Gaussian Splatting.
0:43

Generated the video using Grok and turned it into 3D Gaussian Splatting.

Jaskirat Singh

48,972 次观看 • 5 个月前

gaussian splatting support just got shipped by Zillow
0:24

gaussian splatting support just got shipped by Zillow

Radiance Fields

21,306 次观看 • 11 个月前

𝗜𝗻𝘁𝗿𝗼𝗱𝘂𝗰𝗶𝗻𝗴 𝗨𝗩𝗚𝗦 We introduce 𝗨𝗩𝗚𝗦, a new 2D representation of 3D Gaussian Splatting (3DGS) that leverages spherical mapping. Website: Paper:
0:23

𝗜𝗻𝘁𝗿𝗼𝗱𝘂𝗰𝗶𝗻𝗴 𝗨𝗩𝗚𝗦 We introduce 𝗨𝗩𝗚𝗦, a new 2D representation of 3D Gaussian Splatting (3DGS) that leverages spherical mapping. Website: Paper:

Nikolaos Sarafianos

10,707 次观看 • 1 年前

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a camera-conditioned video diffusion model can be transformed into a generative reconstruction model that directly outputs a high-quality 3D Gaussian Splatting representation through self-distillation, without requiring real-world training data. Check out our results in the video (wait for dynamic scenes in the second half!) : Project Page: Code and Models: Paper:
0:50

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a camera-conditioned video diffusion model can be transformed into a generative reconstruction model that directly outputs a high-quality 3D Gaussian Splatting representation through self-distillation, without requiring real-world training data. Check out our results in the video (wait for dynamic scenes in the second half!) : Project Page: Code and Models: Paper:

Sherwin Bahmani

66,417 次观看 • 8 个月前