Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

White Light Reference for Machine Learning. Meet our inhouse tech Doggo "Rolo". "More Doggo than Doggo" Since July we've been redesigning our scanning pipeline to work with the new 3D Gaussian Splatting for Real-Time Radiance Field Rendering method from Inria. IR's AeonX capture system has been designed to capture...

8Infinite8's profile picture

Infinite-Realities

8,737 subscribers

236,763 Aufrufe • vor 2 Jahren •via X (Twitter)

Wissenschaft & TechnologieGesundheit & WellnessKunst
LIVE

Anya Rossi• Live Now

Private livecam show

11 Kommentare

Profilbild von Pianaland 🇪🇺 🇺🇦 🇹🇼🇮🇱
Pianaland 🇪🇺 🇺🇦 🇹🇼🇮🇱vor 2 Jahren

Is the fur just geometry? Traditional 3d softwares go arround the theme with a huge variety of solutions. Or this just a reference fo then make a proper 3d model (im imagine that what the cam can’t see there are no data / no model)

Profilbild von Infinite-Realities
Infinite-Realitiesvor 2 Jahren

This is more useful for reference as it's an approximation albeit a very good looking one but I bet the folks at Epic could work some interesting magic with it if they had a commercial license to integrate the method into Unreal.

Profilbild von Dan Lowe
Dan Lowevor 2 Jahren

That's crazy! Great test subject: The hair detail and shading really shows this approach off.

Profilbild von Furkan Gözükara
Furkan Gözükaravor 2 Jahren

I read the Readme but confusing So you provided photos of this dog trained model and then viewed with viewer? How is the workflow?

Profilbild von Infinite-Realities
Infinite-Realitiesvor 2 Jahren

The images are aligned in either Reality Capture, or Metashape, or Colmap. They are trained with the Guassian Splatting process then viewed in a modified version of Sibr.

Profilbild von Zvezdan Nedeljkovic
Zvezdan Nedeljkovicvor 2 Jahren

I am currently trying to figure out how to install everything and make my first model. As I figuren you need colmap to feed it to the gaussin splatting? What do you export from Reality Capture? Great results btw :)

Profilbild von Infinite-Realities
Infinite-Realitiesvor 2 Jahren

Thanks we don't have a defined pipeline that we can share for the moment but I think others have started to document and share their pipeline. I think more resources will come online soon. We plan to create an install write up at some point.

Profilbild von Giddy Kong: The Gaming Ape
Giddy Kong: The Gaming Apevor 2 Jahren

You're showing us that Rolo isn't real... but my brain refuses to listen.

Profilbild von Vlad Erium 🇯🇵
Vlad Erium 🇯🇵vor 2 Jahren

Looks cool!

Profilbild von darthgera123
darthgera123vor 2 Jahren

Hi sorry I dont understand but are these renderings with multiple light conditions?

Profilbild von Infinite-Realities
Infinite-Realitiesvor 2 Jahren

These are viewed in real-time baked lighting results.

Ähnliche Videos

Meet our inhouse tech Doggo "Rolo". Cinematic RGB Lighting "More Doggo than Doggo" Since July we've been redesigning our scanning pipeline to work with the amazing 3D Gaussian Splatting for Real-Time Radiance Field Rendering method from Inria. IR's AeonX capture system has been designed to capture "Spatial" memories for the future. We've built on a custom version of Inria's Sibr viewer to handle the playback of our multiple processed 4D frames. GS has reignited our passion for 3D/4D scanning. Thank you to the team at Inria More content to come. #guassiansplatting #ir #aeonx #4d #motionscanning #inria #ximea #idatronic #spatial #youth83
1:57

Meet our inhouse tech Doggo "Rolo". Cinematic RGB Lighting "More Doggo than Doggo" Since July we've been redesigning our scanning pipeline to work with the amazing 3D Gaussian Splatting for Real-Time Radiance Field Rendering method from Inria. IR's AeonX capture system has been designed to capture "Spatial" memories for the future. We've built on a custom version of Inria's Sibr viewer to handle the playback of our multiple processed 4D frames. GS has reignited our passion for 3D/4D scanning. Thank you to the team at Inria More content to come. #guassiansplatting #ir #aeonx #4d #motionscanning #inria #ximea #idatronic #spatial #youth83

Infinite-Realities

98,664 Aufrufe • vor 2 Jahren

"More Doggo than Doggo" Motion scanned @ 60fps. Playing back @ 20fps. Meet our inhouse tech Doggo "Rolo". Since July we've been redesigning our scanning pipeline to work with the new 3D Gaussian Splatting for Real-Time Radiance Field Rendering method from Inria. GS has reignited our passion for 3D/4D scanning. Thank you to the team at Inria IR's AeonX capture system has been designed to capture "Spatial" memories for the future. We've built on a custom version of Inria's Sibr viewer to handle the playback of our multiple processed 4D frames. Our next goal is to optimize the player to be multi-threaded to improve performance over 60fps. GS has reignited our passion for 3D/4D scanning. Thank you to the team at Inria More content to come. #guassiansplatting #ir #aeonx #4d #motionscanning #inria #ximea #idatronic #spatial #youth83
0:41

"More Doggo than Doggo" Motion scanned @ 60fps. Playing back @ 20fps. Meet our inhouse tech Doggo "Rolo". Since July we've been redesigning our scanning pipeline to work with the new 3D Gaussian Splatting for Real-Time Radiance Field Rendering method from Inria. GS has reignited our passion for 3D/4D scanning. Thank you to the team at Inria IR's AeonX capture system has been designed to capture "Spatial" memories for the future. We've built on a custom version of Inria's Sibr viewer to handle the playback of our multiple processed 4D frames. Our next goal is to optimize the player to be multi-threaded to improve performance over 60fps. GS has reignited our passion for 3D/4D scanning. Thank you to the team at Inria More content to come. #guassiansplatting #ir #aeonx #4d #motionscanning #inria #ximea #idatronic #spatial #youth83

Infinite-Realities

48,300 Aufrufe • vor 2 Jahren

Some of IR's early digital puppetry R&D tests utilizing our "AeonX: S0L" system. WIP Combined with Reality Capture, Wrap4D from R3DS and the awesome Mush3D for wrinkle and fat simulation. More motion scan pipeline details here #digitalcreatures #ir #4D
0:36

Some of IR's early digital puppetry R&D tests utilizing our "AeonX: S0L" system. WIP Combined with Reality Capture, Wrap4D from R3DS and the awesome Mush3D for wrinkle and fat simulation. More motion scan pipeline details here #digitalcreatures #ir #4D

Infinite-Realities

106,466 Aufrufe • vor 3 Jahren

We're proud to showcase some recent real-time work with 3D / 4D Gaussian splatting. In January of 2024 we acquired a full 3DGS commercial license with Inria to allow us to offer 4DGS services to clients around the world. We've spent the last 10 months developing our custom 4DGS software pipeline, utilizing our own Nvidia GPU cluster to batch process 100,000's of 4DGS frames rapidly, combined with our state-of-the-art custom built volumetric capture system(s). We can capture anything from complex character interactions for visual effects shots, or dynamic fast fighting scenes, sports, acting, even capturing and storing memories of family and friends for the future! The possibilities are endless. Our focus is always on high-quality and high-fidelity. We don't cut corners and we're continually striving to learn and improve. The below video showcases some 6-dof spatial captures we took of Henry Pearce's family. These scenes are played back in real-time @ 30fps inside a 3rd party engine running in a 120fps virtual environment. This is a culmination of years of hard work and dedication and we are keen to commercialize this technology with you. Please do reach out if you're interested in our capture systems or our 3D/4DGS processing services. HQ YouTube Link: HQ Vimeo Link: #spatialcapture #vr #virtualmemories #inria #3dgs #4dgs #aeonx #ir #ximea Music "Vision" by megiddo music Special thanks to Aras Pranckevičius 🇺🇦🇱🇹
2:20

We're proud to showcase some recent real-time work with 3D / 4D Gaussian splatting. In January of 2024 we acquired a full 3DGS commercial license with Inria to allow us to offer 4DGS services to clients around the world. We've spent the last 10 months developing our custom 4DGS software pipeline, utilizing our own Nvidia GPU cluster to batch process 100,000's of 4DGS frames rapidly, combined with our state-of-the-art custom built volumetric capture system(s). We can capture anything from complex character interactions for visual effects shots, or dynamic fast fighting scenes, sports, acting, even capturing and storing memories of family and friends for the future! The possibilities are endless. Our focus is always on high-quality and high-fidelity. We don't cut corners and we're continually striving to learn and improve. The below video showcases some 6-dof spatial captures we took of Henry Pearce's family. These scenes are played back in real-time @ 30fps inside a 3rd party engine running in a 120fps virtual environment. This is a culmination of years of hard work and dedication and we are keen to commercialize this technology with you. Please do reach out if you're interested in our capture systems or our 3D/4DGS processing services. HQ YouTube Link: HQ Vimeo Link: #spatialcapture #vr #virtualmemories #inria #3dgs #4dgs #aeonx #ir #ximea Music "Vision" by megiddo music Special thanks to Aras Pranckevičius 🇺🇦🇱🇹

Infinite-Realities

202,783 Aufrufe • vor 2 Jahren

4D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Models Contributions: • We introduce 4D LangSplat for open-vocabulary 4D spatial-temporal queries. To the best of our knowledge, we are the first to construct 4D language fields with object textual captions generated by MLLMs. • To model smooth transitions across states for objects in 4D scenes, we propose a status deformable network to capture continuous temporal changes. • Experiential results show that our method attains state-of-the-art performance for both time-agnostic and time-sensitive open-vocabulary queries.
0:29

4D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Models Contributions: • We introduce 4D LangSplat for open-vocabulary 4D spatial-temporal queries. To the best of our knowledge, we are the first to construct 4D language fields with object textual captions generated by MLLMs. • To model smooth transitions across states for objects in 4D scenes, we propose a status deformable network to capture continuous temporal changes. • Experiential results show that our method attains state-of-the-art performance for both time-agnostic and time-sensitive open-vocabulary queries.

MrNeRF

10,953 Aufrufe • vor 1 Jahr

Enter the SPLATRIX! We digitized Henry Pearce and converted him over to 4DGS to be played back in real-time. 3D Gaussians Splats in Motion. 4DGS. Our goal was to improve the quality of our AeonX & 4DGS pipeline, with automated background removal to retain fine hair details as well as to improve overall surface consistency on a full torso capture. We're currently using a post process to temporally filter the 2D frames. We still need to solve 4DGS temporal stability. We're hoping to test with Jonathon Luiten dynamic gaussian code soon... 🙏 for that script! We captured this performance under global illumination. This is an easy task compared to RGB+W lighting, which is going to be much harder! This is our next challenge. We're posting these snippet videos to show our progress with 3D/4DGS. We plan to write a full blog post on our 3D/4DGS journey soon. 3D Gaussian Splatting #GaussianSplatting #inria #radiancefields #ir #aeonx #rgbw #idatronic #ximea #sibr #hdri #60fps More info here - Higher Quality Videos:
1:14

Enter the SPLATRIX! We digitized Henry Pearce and converted him over to 4DGS to be played back in real-time. 3D Gaussians Splats in Motion. 4DGS. Our goal was to improve the quality of our AeonX & 4DGS pipeline, with automated background removal to retain fine hair details as well as to improve overall surface consistency on a full torso capture. We're currently using a post process to temporally filter the 2D frames. We still need to solve 4DGS temporal stability. We're hoping to test with Jonathon Luiten dynamic gaussian code soon... 🙏 for that script! We captured this performance under global illumination. This is an easy task compared to RGB+W lighting, which is going to be much harder! This is our next challenge. We're posting these snippet videos to show our progress with 3D/4DGS. We plan to write a full blog post on our 3D/4DGS journey soon. 3D Gaussian Splatting #GaussianSplatting #inria #radiancefields #ir #aeonx #rgbw #idatronic #ximea #sibr #hdri #60fps More info here - Higher Quality Videos:

Infinite-Realities

90,662 Aufrufe • vor 2 Jahren

Happy to announce the results of our latest research, which takes 3D Gaussian Splatting to the next level: "A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasets," which has been accepted at #SIGGRAPH2024!🎉 Find it here:
1:40

Happy to announce the results of our latest research, which takes 3D Gaussian Splatting to the next level: "A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasets," which has been accepted at #SIGGRAPH2024!🎉 Find it here:

Bernhard Kerbl

356,272 Aufrufe • vor 2 Jahren

Whilst we figure out a solution for temporal filtering on 3D Gaussian Splatting input frames. We can use a temporal filtering plugin on the screen captures or rendered images to act as a visualization tool to check what the future results might look like. "Processing and rendering a digital human with 3D Gaussian Splatting with a post process to simulate temporal filtering." Left video no temporal filtering. Right video with temporal filtering. R&D for archviz projects. #GaussianSplatting #ir #inria #sibr #aftereffects #temporalfiltering
0:42

Whilst we figure out a solution for temporal filtering on 3D Gaussian Splatting input frames. We can use a temporal filtering plugin on the screen captures or rendered images to act as a visualization tool to check what the future results might look like. "Processing and rendering a digital human with 3D Gaussian Splatting with a post process to simulate temporal filtering." Left video no temporal filtering. Right video with temporal filtering. R&D for archviz projects. #GaussianSplatting #ir #inria #sibr #aftereffects #temporalfiltering

Infinite-Realities

58,368 Aufrufe • vor 2 Jahren

From Mitch: Founder of Shiba Rescue of New Jersey At Shiba Rescue of New Jersey, we sincerely thank Prince and the #DOGGO crypto community on ETH for your generous donation. Your support strengthens our mission and demonstrates how our community can come together to make a difference for Shibas in need. Together, we’re ensuring that every dog has a loving home. Thank you for being part of this journey! This one is for you Shibetoshi Nakamoto from our #DOGGO Community ❤️
0:22

From Mitch: Founder of Shiba Rescue of New Jersey At Shiba Rescue of New Jersey, we sincerely thank Prince and the #DOGGO crypto community on ETH for your generous donation. Your support strengthens our mission and demonstrates how our community can come together to make a difference for Shibas in need. Together, we’re ensuring that every dog has a loving home. Thank you for being part of this journey! This one is for you Shibetoshi Nakamoto from our #DOGGO Community ❤️

Prince

55,143 Aufrufe • vor 1 Jahr

Fashion has never been more tradable & accessible. More than 10,000 items being brought on chain for the first time. The most advanced capture dome scanning tech for Digital Try On, Digital Museum linked to a Physical Storage Solution. $VIVI on Solana
1:08

Fashion has never been more tradable & accessible. More than 10,000 items being brought on chain for the first time. The most advanced capture dome scanning tech for Digital Try On, Digital Museum linked to a Physical Storage Solution. $VIVI on Solana

VIVI PROJECT(LEGENDARY HUMANITY)

34,151 Aufrufe • vor 1 Jahr

Designed in collaboration with our pro teams, designed for you 💫 We've been cooking with Sony Electronics, and it's finally time to show you what we've been working on. Get ready for spatial audio, crystal clear comms, and all-day comfort with INZONE Buds:
0:44

Designed in collaboration with our pro teams, designed for you 💫 We've been cooking with Sony Electronics, and it's finally time to show you what we've been working on. Get ready for spatial audio, crystal clear comms, and all-day comfort with INZONE Buds:

FNATIC

93,634 Aufrufe • vor 2 Jahren

Is 3D scene generation much closer to being solved all of a sudden? It has been a few days since the release of OpenAI Sora. We run our COLMAP-Free 3D Gaussian Splatting on the released videos. Our method does not need to pre-process cameras and it seems we can directly just get 3D from the videos. Check out our results here. 🧵👇 (1/n
0:25

Is 3D scene generation much closer to being solved all of a sudden? It has been a few days since the release of OpenAI Sora. We run our COLMAP-Free 3D Gaussian Splatting on the released videos. Our method does not need to pre-process cameras and it seems we can directly just get 3D from the videos. Check out our results here. 🧵👇 (1/n

Xiaolong Wang

157,383 Aufrufe • vor 2 Jahren

Times are changing. Service providers are soon going to have to adapt. Or at least have the ability to generate your own diffusion models. 360 spin (Pixverse) 3DGS (Inria Sibr viewer) Synthetic Human 3DGS SD+LORA -> Pixverse 360 -> Metashape -> Postshot -> Inria Sibr (.PLY)
0:28

Times are changing. Service providers are soon going to have to adapt. Or at least have the ability to generate your own diffusion models. 360 spin (Pixverse) 3DGS (Inria Sibr viewer) Synthetic Human 3DGS SD+LORA -> Pixverse 360 -> Metashape -> Postshot -> Inria Sibr (.PLY)

Infinite-Realities

62,774 Aufrufe • vor 1 Jahr

1000+ FPS 4D Gaussian Splatting for Dynamic Scene Rendering Contributions: • We delve into the temporal redundancy of 4D Gaussian Splatting and explain the main reason for the storage pressure and suboptimal rendering speed. • We introduce 4DGS-1K, a compact and memory-efficient framework to address these issues. It consists of two key components: a spatial-temporal variation score-based pruning strategy and a temporal filter. • Extensive experiments demonstrate that 4DGS-1K not only achieves a substantial storage reduction of approximately 41× but also accelerates rasterization to 1000+ FPS while maintaining high-quality reconstruction.
0:25

1000+ FPS 4D Gaussian Splatting for Dynamic Scene Rendering Contributions: • We delve into the temporal redundancy of 4D Gaussian Splatting and explain the main reason for the storage pressure and suboptimal rendering speed. • We introduce 4DGS-1K, a compact and memory-efficient framework to address these issues. It consists of two key components: a spatial-temporal variation score-based pruning strategy and a temporal filter. • Extensive experiments demonstrate that 4DGS-1K not only achieves a substantial storage reduction of approximately 41× but also accelerates rasterization to 1000+ FPS while maintaining high-quality reconstruction.

MrNeRF

12,200 Aufrufe • vor 1 Jahr

3D gaussian splatting + time (video) = 4D gaussian splatting is now possible This means in the near future you'll be able to fly around on your phone in any video you recorded A lot like the "braindance" in Cyberpunk 2077
0:29

3D gaussian splatting + time (video) = 4D gaussian splatting is now possible This means in the near future you'll be able to fly around on your phone in any video you recorded A lot like the "braindance" in Cyberpunk 2077

@levelsio

590,061 Aufrufe • vor 1 Jahr

To our Wicked fans, As 2024 is coming to a close, we want to take the time to thank you for joining us on our journey with No Rest for the Wicked. This has been a huge year for all of us at Moon Studios. Launching Wicked in Early Access in April was quite the beginning. We've been listening to your feedback very closely, rapidly rolling out hotfixes, balancing, optimizing and adding quality-of-life improvements to the game. With The Crucible Update we added a whole new rogue-lite mode, setting the stage for more replayability out of the existing Early Access content. Since then we've been hard at work on “The Breach” and our next big Content and Feature updates. We know we’ve been quiet - a lot has been happening for us at Moon Studios during this year, and we will finally be able to share all about it very soon! We will be kicking off 2025 with a new announcement in January and you can also expect better and more frequent communication on our Official Channels throughout the year. Thank you for sticking with us and helping shape No Rest for the Wicked into something truly special. Your passion, feedback and support continue to further fuel our passion since the very first announcement at the The Game Awards. We couldn’t be more proud of our team at Moon Studios and everything we have in store for 2025. Here’s to an even bigger year for No Rest for the Wicked, Moon Studios and all of you! Happy holidays! 🎉🎊🎁 The Moon Studios Team ❤️
1:02

To our Wicked fans, As 2024 is coming to a close, we want to take the time to thank you for joining us on our journey with No Rest for the Wicked. This has been a huge year for all of us at Moon Studios. Launching Wicked in Early Access in April was quite the beginning. We've been listening to your feedback very closely, rapidly rolling out hotfixes, balancing, optimizing and adding quality-of-life improvements to the game. With The Crucible Update we added a whole new rogue-lite mode, setting the stage for more replayability out of the existing Early Access content. Since then we've been hard at work on “The Breach” and our next big Content and Feature updates. We know we’ve been quiet - a lot has been happening for us at Moon Studios during this year, and we will finally be able to share all about it very soon! We will be kicking off 2025 with a new announcement in January and you can also expect better and more frequent communication on our Official Channels throughout the year. Thank you for sticking with us and helping shape No Rest for the Wicked into something truly special. Your passion, feedback and support continue to further fuel our passion since the very first announcement at the The Game Awards. We couldn’t be more proud of our team at Moon Studios and everything we have in store for 2025. Here’s to an even bigger year for No Rest for the Wicked, Moon Studios and all of you! Happy holidays! 🎉🎊🎁 The Moon Studios Team ❤️

No Rest for the Wicked

73,244 Aufrufe • vor 1 Jahr

Long live bullet time. The future of sports is 4d gaussian splatting.
0:32

Long live bullet time. The future of sports is 4d gaussian splatting.

Bilawal Sidhu

127,960 Aufrufe • vor 3 Monaten

It has been 2 years since we updated our reel. Thank you to everyone that we have worked with in that time. We couldn't be prouder of the work the team at Half Giant has created. Check out more of our work at
1:00

It has been 2 years since we updated our reel. Thank you to everyone that we have worked with in that time. We couldn't be prouder of the work the team at Half Giant has created. Check out more of our work at

Half Giant

34,178 Aufrufe • vor 2 Jahren

We've been a bit quieter recently, and here's why. We've been busy packing and preparing for the move to our new HQ! 😁🎉 Disassembling our 4-meter high scanning chamber was a BIG challenge, but we did it! Watch the behind-the-scenes time-lapse video below 🎥✨ Stay tuned for regular updates and more exciting news from our new location. #Metahero #NewBeginnings #NewHQ #BehindTheScenes
0:22

We've been a bit quieter recently, and here's why. We've been busy packing and preparing for the move to our new HQ! 😁🎉 Disassembling our 4-meter high scanning chamber was a BIG challenge, but we did it! Watch the behind-the-scenes time-lapse video below 🎥✨ Stay tuned for regular updates and more exciting news from our new location. #Metahero #NewBeginnings #NewHQ #BehindTheScenes

Metahero.io

43,051 Aufrufe • vor 2 Jahren