正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

White Light Reference for Machine Learning. Meet our inhouse tech Doggo "Rolo". "More Doggo than Doggo" Since July we've been redesigning our scanning pipeline to work with the new 3D Gaussian Splatting for Real-Time Radiance Field Rendering method from Inria. IR's AeonX capture system has been designed to capture... show more

Infinite-Realities

8,740 subscribers

236,750 次观看 • 2 年前 •via X (Twitter)

科学技术健康养生艺术

Anya Rossi• Live Now

Private livecam show

11 条评论

Pianaland 🇪🇺 🇺🇦 🇹🇼🇮🇱 的头像

Pianaland 🇪🇺 🇺🇦 🇹🇼🇮🇱2 年前

Is the fur just geometry? Traditional 3d softwares go arround the theme with a huge variety of solutions. Or this just a reference fo then make a proper 3d model (im imagine that what the cam can’t see there are no data / no model)

Infinite-Realities 的头像

Infinite-Realities2 年前

This is more useful for reference as it's an approximation albeit a very good looking one but I bet the folks at Epic could work some interesting magic with it if they had a commercial license to integrate the method into Unreal.

Dan Lowe 的头像

Dan Lowe2 年前

That's crazy! Great test subject: The hair detail and shading really shows this approach off.

Furkan Gözükara 的头像

Furkan Gözükara2 年前

I read the Readme but confusing So you provided photos of this dog trained model and then viewed with viewer? How is the workflow?

Infinite-Realities 的头像

Infinite-Realities2 年前

The images are aligned in either Reality Capture, or Metashape, or Colmap. They are trained with the Guassian Splatting process then viewed in a modified version of Sibr.

Zvezdan Nedeljkovic 的头像

Zvezdan Nedeljkovic2 年前

I am currently trying to figure out how to install everything and make my first model. As I figuren you need colmap to feed it to the gaussin splatting? What do you export from Reality Capture? Great results btw :)

Infinite-Realities 的头像

Infinite-Realities2 年前

Thanks we don't have a defined pipeline that we can share for the moment but I think others have started to document and share their pipeline. I think more resources will come online soon. We plan to create an install write up at some point.

Giddy Kong: The Gaming Ape 的头像

Giddy Kong: The Gaming Ape2 年前

You're showing us that Rolo isn't real... but my brain refuses to listen.

Vlad Erium 🇯🇵 的头像

Vlad Erium 🇯🇵2 年前

Looks cool!

darthgera123 的头像

darthgera1232 年前

Hi sorry I dont understand but are these renderings with multiple light conditions?

Infinite-Realities 的头像

Infinite-Realities2 年前

These are viewed in real-time baked lighting results.

相关视频

Meet our inhouse tech Doggo "Rolo". Cinematic RGB Lighting "More Doggo than Doggo" Since July we've been redesigning our scanning pipeline to work with the amazing 3D Gaussian Splatting for Real-Time Radiance Field Rendering method from Inria. IR's AeonX capture system has been designed to capture "Spatial" memories for the future. We've built on a custom version of Inria's Sibr viewer to handle the playback of our multiple processed 4D frames. GS has reignited our passion for 3D/4D scanning. Thank you to the team at Inria More content to come. #guassiansplatting #ir #aeonx #4d #motionscanning #inria #ximea #idatronic #spatial #youth83

Meet our inhouse tech Doggo "Rolo". Cinematic RGB Lighting "More Doggo than Doggo" Since July we've been redesigning our scanning pipeline to work with the amazing 3D Gaussian Splatting for Real-Time Radiance Field Rendering method from Inria. IR's AeonX capture system has been designed to capture "Spatial" memories for the future. We've built on a custom version of Inria's Sibr viewer to handle the playback of our multiple processed 4D frames. GS has reignited our passion for 3D/4D scanning. Thank you to the team at Inria More content to come. #guassiansplatting #ir #aeonx #4d #motionscanning #inria #ximea #idatronic #spatial #youth83

Infinite-Realities

98,664 次观看 • 2 年前

"More Doggo than Doggo" Motion scanned @ 60fps. Playing back @ 20fps. Meet our inhouse tech Doggo "Rolo". Since July we've been redesigning our scanning pipeline to work with the new 3D Gaussian Splatting for Real-Time Radiance Field Rendering method from Inria. GS has reignited our passion for 3D/4D scanning. Thank you to the team at Inria IR's AeonX capture system has been designed to capture "Spatial" memories for the future. We've built on a custom version of Inria's Sibr viewer to handle the playback of our multiple processed 4D frames. Our next goal is to optimize the player to be multi-threaded to improve performance over 60fps. GS has reignited our passion for 3D/4D scanning. Thank you to the team at Inria More content to come. #guassiansplatting #ir #aeonx #4d #motionscanning #inria #ximea #idatronic #spatial #youth83

"More Doggo than Doggo" Motion scanned @ 60fps. Playing back @ 20fps. Meet our inhouse tech Doggo "Rolo". Since July we've been redesigning our scanning pipeline to work with the new 3D Gaussian Splatting for Real-Time Radiance Field Rendering method from Inria. GS has reignited our passion for 3D/4D scanning. Thank you to the team at Inria IR's AeonX capture system has been designed to capture "Spatial" memories for the future. We've built on a custom version of Inria's Sibr viewer to handle the playback of our multiple processed 4D frames. Our next goal is to optimize the player to be multi-threaded to improve performance over 60fps. GS has reignited our passion for 3D/4D scanning. Thank you to the team at Inria More content to come. #guassiansplatting #ir #aeonx #4d #motionscanning #inria #ximea #idatronic #spatial #youth83

Infinite-Realities

48,300 次观看 • 2 年前

We're proud to showcase some recent real-time work with 3D / 4D Gaussian splatting. In January of 2024 we acquired a full 3DGS commercial license with Inria to allow us to offer 4DGS services to clients around the world. We've spent the last 10 months developing our custom 4DGS software pipeline, utilizing our own Nvidia GPU cluster to batch process 100,000's of 4DGS frames rapidly, combined with our state-of-the-art custom built volumetric capture system(s). We can capture anything from complex character interactions for visual effects shots, or dynamic fast fighting scenes, sports, acting, even capturing and storing memories of family and friends for the future! The possibilities are endless. Our focus is always on high-quality and high-fidelity. We don't cut corners and we're continually striving to learn and improve. The below video showcases some 6-dof spatial captures we took of Henry Pearce's family. These scenes are played back in real-time @ 30fps inside a 3rd party engine running in a 120fps virtual environment. This is a culmination of years of hard work and dedication and we are keen to commercialize this technology with you. Please do reach out if you're interested in our capture systems or our 3D/4DGS processing services. HQ YouTube Link: HQ Vimeo Link: #spatialcapture #vr #virtualmemories #inria #3dgs #4dgs #aeonx #ir #ximea Music "Vision" by megiddo music Special thanks to Aras Pranckevičius 🇺🇦🇱🇹

We're proud to showcase some recent real-time work with 3D / 4D Gaussian splatting. In January of 2024 we acquired a full 3DGS commercial license with Inria to allow us to offer 4DGS services to clients around the world. We've spent the last 10 months developing our custom 4DGS software pipeline, utilizing our own Nvidia GPU cluster to batch process 100,000's of 4DGS frames rapidly, combined with our state-of-the-art custom built volumetric capture system(s). We can capture anything from complex character interactions for visual effects shots, or dynamic fast fighting scenes, sports, acting, even capturing and storing memories of family and friends for the future! The possibilities are endless. Our focus is always on high-quality and high-fidelity. We don't cut corners and we're continually striving to learn and improve. The below video showcases some 6-dof spatial captures we took of Henry Pearce's family. These scenes are played back in real-time @ 30fps inside a 3rd party engine running in a 120fps virtual environment. This is a culmination of years of hard work and dedication and we are keen to commercialize this technology with you. Please do reach out if you're interested in our capture systems or our 3D/4DGS processing services. HQ YouTube Link: HQ Vimeo Link: #spatialcapture #vr #virtualmemories #inria #3dgs #4dgs #aeonx #ir #ximea Music "Vision" by megiddo music Special thanks to Aras Pranckevičius 🇺🇦🇱🇹

Infinite-Realities

202,748 次观看 • 2 年前

Some of IR's early digital puppetry R&D tests utilizing our "AeonX: S0L" system. WIP Combined with Reality Capture, Wrap4D from R3DS and the awesome Mush3D for wrinkle and fat simulation. More motion scan pipeline details here #digitalcreatures #ir #4D

Some of IR's early digital puppetry R&D tests utilizing our "AeonX: S0L" system. WIP Combined with Reality Capture, Wrap4D from R3DS and the awesome Mush3D for wrinkle and fat simulation. More motion scan pipeline details here #digitalcreatures #ir #4D

Infinite-Realities

106,466 次观看 • 3 年前

4D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Models Contributions: • We introduce 4D LangSplat for open-vocabulary 4D spatial-temporal queries. To the best of our knowledge, we are the first to construct 4D language fields with object textual captions generated by MLLMs. • To model smooth transitions across states for objects in 4D scenes, we propose a status deformable network to capture continuous temporal changes. • Experiential results show that our method attains state-of-the-art performance for both time-agnostic and time-sensitive open-vocabulary queries.

4D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Models Contributions: • We introduce 4D LangSplat for open-vocabulary 4D spatial-temporal queries. To the best of our knowledge, we are the first to construct 4D language fields with object textual captions generated by MLLMs. • To model smooth transitions across states for objects in 4D scenes, we propose a status deformable network to capture continuous temporal changes. • Experiential results show that our method attains state-of-the-art performance for both time-agnostic and time-sensitive open-vocabulary queries.

MrNeRF

10,953 次观看 • 1 年前

Enter the SPLATRIX! We digitized Henry Pearce and converted him over to 4DGS to be played back in real-time. 3D Gaussians Splats in Motion. 4DGS. Our goal was to improve the quality of our AeonX & 4DGS pipeline, with automated background removal to retain fine hair details as well as to improve overall surface consistency on a full torso capture. We're currently using a post process to temporally filter the 2D frames. We still need to solve 4DGS temporal stability. We're hoping to test with Jonathon Luiten dynamic gaussian code soon... 🙏 for that script! We captured this performance under global illumination. This is an easy task compared to RGB+W lighting, which is going to be much harder! This is our next challenge. We're posting these snippet videos to show our progress with 3D/4DGS. We plan to write a full blog post on our 3D/4DGS journey soon. 3D Gaussian Splatting #GaussianSplatting #inria #radiancefields #ir #aeonx #rgbw #idatronic #ximea #sibr #hdri #60fps More info here - Higher Quality Videos:

Enter the SPLATRIX! We digitized Henry Pearce and converted him over to 4DGS to be played back in real-time. 3D Gaussians Splats in Motion. 4DGS. Our goal was to improve the quality of our AeonX & 4DGS pipeline, with automated background removal to retain fine hair details as well as to improve overall surface consistency on a full torso capture. We're currently using a post process to temporally filter the 2D frames. We still need to solve 4DGS temporal stability. We're hoping to test with Jonathon Luiten dynamic gaussian code soon... 🙏 for that script! We captured this performance under global illumination. This is an easy task compared to RGB+W lighting, which is going to be much harder! This is our next challenge. We're posting these snippet videos to show our progress with 3D/4DGS. We plan to write a full blog post on our 3D/4DGS journey soon. 3D Gaussian Splatting #GaussianSplatting #inria #radiancefields #ir #aeonx #rgbw #idatronic #ximea #sibr #hdri #60fps More info here - Higher Quality Videos:

Infinite-Realities

90,625 次观看 • 2 年前

Happy to announce the results of our latest research, which takes 3D Gaussian Splatting to the next level: "A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasets," which has been accepted at #SIGGRAPH2024!🎉 Find it here:

Happy to announce the results of our latest research, which takes 3D Gaussian Splatting to the next level: "A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasets," which has been accepted at #SIGGRAPH2024!🎉 Find it here:

Bernhard Kerbl

356,236 次观看 • 2 年前

Fashion has never been more tradable & accessible. More than 10,000 items being brought on chain for the first time. The most advanced capture dome scanning tech for Digital Try On, Digital Museum linked to a Physical Storage Solution. $VIVI on Solana

Fashion has never been more tradable & accessible. More than 10,000 items being brought on chain for the first time. The most advanced capture dome scanning tech for Digital Try On, Digital Museum linked to a Physical Storage Solution. $VIVI on Solana

VIVI PROJECT(LEGENDARY HUMANITY)

34,078 次观看 • 1 年前

From Mitch: Founder of Shiba Rescue of New Jersey At Shiba Rescue of New Jersey, we sincerely thank Prince and the #DOGGO crypto community on ETH for your generous donation. Your support strengthens our mission and demonstrates how our community can come together to make a difference for Shibas in need. Together, we’re ensuring that every dog has a loving home. Thank you for being part of this journey! This one is for you Shibetoshi Nakamoto from our #DOGGO Community ❤️

From Mitch: Founder of Shiba Rescue of New Jersey At Shiba Rescue of New Jersey, we sincerely thank Prince and the #DOGGO crypto community on ETH for your generous donation. Your support strengthens our mission and demonstrates how our community can come together to make a difference for Shibas in need. Together, we’re ensuring that every dog has a loving home. Thank you for being part of this journey! This one is for you Shibetoshi Nakamoto from our #DOGGO Community ❤️

Prince

55,143 次观看 • 1 年前

Designed in collaboration with our pro teams, designed for you 💫 We've been cooking with Sony Electronics, and it's finally time to show you what we've been working on. Get ready for spatial audio, crystal clear comms, and all-day comfort with INZONE Buds:

Designed in collaboration with our pro teams, designed for you 💫 We've been cooking with Sony Electronics, and it's finally time to show you what we've been working on. Get ready for spatial audio, crystal clear comms, and all-day comfort with INZONE Buds:

FNATIC

93,634 次观看 • 2 年前

Times are changing. Service providers are soon going to have to adapt. Or at least have the ability to generate your own diffusion models. 360 spin (Pixverse) 3DGS (Inria Sibr viewer) Synthetic Human 3DGS SD+LORA -> Pixverse 360 -> Metashape -> Postshot -> Inria Sibr (.PLY)

Times are changing. Service providers are soon going to have to adapt. Or at least have the ability to generate your own diffusion models. 360 spin (Pixverse) 3DGS (Inria Sibr viewer) Synthetic Human 3DGS SD+LORA -> Pixverse 360 -> Metashape -> Postshot -> Inria Sibr (.PLY)

Infinite-Realities

62,750 次观看 • 1 年前

Is 3D scene generation much closer to being solved all of a sudden? It has been a few days since the release of OpenAI Sora. We run our COLMAP-Free 3D Gaussian Splatting on the released videos. Our method does not need to pre-process cameras and it seems we can directly just get 3D from the videos. Check out our results here. 🧵👇 (1/n

Is 3D scene generation much closer to being solved all of a sudden? It has been a few days since the release of OpenAI Sora. We run our COLMAP-Free 3D Gaussian Splatting on the released videos. Our method does not need to pre-process cameras and it seems we can directly just get 3D from the videos. Check out our results here. 🧵👇 (1/n

Xiaolong Wang

157,355 次观看 • 2 年前

1000+ FPS 4D Gaussian Splatting for Dynamic Scene Rendering Contributions: • We delve into the temporal redundancy of 4D Gaussian Splatting and explain the main reason for the storage pressure and suboptimal rendering speed. • We introduce 4DGS-1K, a compact and memory-efficient framework to address these issues. It consists of two key components: a spatial-temporal variation score-based pruning strategy and a temporal filter. • Extensive experiments demonstrate that 4DGS-1K not only achieves a substantial storage reduction of approximately 41× but also accelerates rasterization to 1000+ FPS while maintaining high-quality reconstruction.

1000+ FPS 4D Gaussian Splatting for Dynamic Scene Rendering Contributions: • We delve into the temporal redundancy of 4D Gaussian Splatting and explain the main reason for the storage pressure and suboptimal rendering speed. • We introduce 4DGS-1K, a compact and memory-efficient framework to address these issues. It consists of two key components: a spatial-temporal variation score-based pruning strategy and a temporal filter. • Extensive experiments demonstrate that 4DGS-1K not only achieves a substantial storage reduction of approximately 41× but also accelerates rasterization to 1000+ FPS while maintaining high-quality reconstruction.

MrNeRF

12,200 次观看 • 1 年前

3D gaussian splatting + time (video) = 4D gaussian splatting is now possible This means in the near future you'll be able to fly around on your phone in any video you recorded A lot like the "braindance" in Cyberpunk 2077

3D gaussian splatting + time (video) = 4D gaussian splatting is now possible This means in the near future you'll be able to fly around on your phone in any video you recorded A lot like the "braindance" in Cyberpunk 2077

@levelsio

590,013 次观看 • 1 年前

To our Wicked fans, As 2024 is coming to a close, we want to take the time to thank you for joining us on our journey with No Rest for the Wicked. This has been a huge year for all of us at Moon Studios. Launching Wicked in Early Access in April was quite the beginning. We've been listening to your feedback very closely, rapidly rolling out hotfixes, balancing, optimizing and adding quality-of-life improvements to the game. With The Crucible Update we added a whole new rogue-lite mode, setting the stage for more replayability out of the existing Early Access content. Since then we've been hard at work on “The Breach” and our next big Content and Feature updates. We know we’ve been quiet - a lot has been happening for us at Moon Studios during this year, and we will finally be able to share all about it very soon! We will be kicking off 2025 with a new announcement in January and you can also expect better and more frequent communication on our Official Channels throughout the year. Thank you for sticking with us and helping shape No Rest for the Wicked into something truly special. Your passion, feedback and support continue to further fuel our passion since the very first announcement at the The Game Awards. We couldn’t be more proud of our team at Moon Studios and everything we have in store for 2025. Here’s to an even bigger year for No Rest for the Wicked, Moon Studios and all of you! Happy holidays! 🎉🎊🎁 The Moon Studios Team ❤️

To our Wicked fans, As 2024 is coming to a close, we want to take the time to thank you for joining us on our journey with No Rest for the Wicked. This has been a huge year for all of us at Moon Studios. Launching Wicked in Early Access in April was quite the beginning. We've been listening to your feedback very closely, rapidly rolling out hotfixes, balancing, optimizing and adding quality-of-life improvements to the game. With The Crucible Update we added a whole new rogue-lite mode, setting the stage for more replayability out of the existing Early Access content. Since then we've been hard at work on “The Breach” and our next big Content and Feature updates. We know we’ve been quiet - a lot has been happening for us at Moon Studios during this year, and we will finally be able to share all about it very soon! We will be kicking off 2025 with a new announcement in January and you can also expect better and more frequent communication on our Official Channels throughout the year. Thank you for sticking with us and helping shape No Rest for the Wicked into something truly special. Your passion, feedback and support continue to further fuel our passion since the very first announcement at the The Game Awards. We couldn’t be more proud of our team at Moon Studios and everything we have in store for 2025. Here’s to an even bigger year for No Rest for the Wicked, Moon Studios and all of you! Happy holidays! 🎉🎊🎁 The Moon Studios Team ❤️

No Rest for the Wicked

73,244 次观看 • 1 年前

Long live bullet time. The future of sports is 4d gaussian splatting.

Long live bullet time. The future of sports is 4d gaussian splatting.

Bilawal Sidhu

127,835 次观看 • 2 个月前

It has been 2 years since we updated our reel. Thank you to everyone that we have worked with in that time. We couldn't be prouder of the work the team at Half Giant has created. Check out more of our work at

It has been 2 years since we updated our reel. Thank you to everyone that we have worked with in that time. We couldn't be prouder of the work the team at Half Giant has created. Check out more of our work at

Half Giant

33,511 次观看 • 1 年前

We've been a bit quieter recently, and here's why. We've been busy packing and preparing for the move to our new HQ! 😁🎉 Disassembling our 4-meter high scanning chamber was a BIG challenge, but we did it! Watch the behind-the-scenes time-lapse video below 🎥✨ Stay tuned for regular updates and more exciting news from our new location. #Metahero #NewBeginnings #NewHQ #BehindTheScenes

We've been a bit quieter recently, and here's why. We've been busy packing and preparing for the move to our new HQ! 😁🎉 Disassembling our 4-meter high scanning chamber was a BIG challenge, but we did it! Watch the behind-the-scenes time-lapse video below 🎥✨ Stay tuned for regular updates and more exciting news from our new location. #Metahero #NewBeginnings #NewHQ #BehindTheScenes

Metahero.io

42,973 次观看 • 2 年前

📢Happy to present Convex Splatting, a novel way for 3D reconstruction based on 3D smooth convexes. For the first time, a splatting-based method reaches the quality of NeRF sota methods but with real-time rendering and few primitives!! I expect this to replace Gaussian splatting for 3D in the coming months. CODE RELEASED TODAY! joint work with collaborators from Université de Liège Visual Geometry Group (VGG) , KAUST Computer Vision Lab (IVUL) a thread 🧵 1/n

📢Happy to present Convex Splatting, a novel way for 3D reconstruction based on 3D smooth convexes. For the first time, a splatting-based method reaches the quality of NeRF sota methods but with real-time rendering and few primitives!! I expect this to replace Gaussian splatting for 3D in the coming months. CODE RELEASED TODAY! joint work with collaborators from Université de Liège Visual Geometry Group (VGG) , KAUST Computer Vision Lab (IVUL) a thread 🧵 1/n

Abdullah Hamdi

71,661 次观看 • 1 年前