Loading video...

Video Failed to Load

Go Home

Video to 3D Memory (MiDAS v3.1 + #glslViewer +

patriciogv's profile picture

patricio gonzalez vivo

17,082 subscribers

137,365 views • 3 years ago •via X (Twitter)

#glslViewer
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Minecraft 3D generation now at the highest quality ever, built using fal ⛏️ Text → Image (nano-banana-pro) → 3D mesh (Hunyuan 3D v3.1) → Voxelize → Texture mapping → Minecraft structure!
0:17

Minecraft 3D generation now at the highest quality ever, built using fal ⛏️ Text → Image (nano-banana-pro) → 3D mesh (Hunyuan 3D v3.1) → Voxelize → Texture mapping → Minecraft structure!

Blendi

490,878 views • 2 months ago

Turn any webpage into a museum! 🏛️ Made this Chrome extension that uses Hunyuan 3D v3.1 on fal to turn any image into a 3D model, and three.js for the interactive viewer
0:16

Turn any webpage into a museum! 🏛️ Made this Chrome extension that uses Hunyuan 3D v3.1 on fal to turn any image into a 3D model, and three.js for the interactive viewer

Blendi

48,851 views • 2 months ago

Meowscles is concerned for Midas.. #Fortnite #Midas #FortniteArt
0:18

Meowscles is concerned for Midas.. #Fortnite #Midas #FortniteArt

Vincenciel

12,046 views • 5 months ago

how i feel listening to midas touch
0:17

how i feel listening to midas touch

closed.

18,964 views • 1 year ago

Welcome to #Chelsea, Alex! 💙 / Midas Sports Management
0:19

Welcome to #Chelsea, Alex! 💙 / Midas Sports Management

Absolute Chelsea

155,924 views • 3 years ago

Wuthering Waves V3.1 New official ad :) #WutheringWaves #WuWa #鳴潮 #WuWaCollection #WuWaAnniversary
0:18

Wuthering Waves V3.1 New official ad :) #WutheringWaves #WuWa #鳴潮 #WuWaCollection #WuWaAnniversary

RinasCita

69,785 views • 4 months ago

They’re def gonna be late to the wedding #Fortnite #Midas #FortniteArt
0:13

They’re def gonna be late to the wedding #Fortnite #Midas #FortniteArt

Vincenciel

33,600 views • 1 year ago

Advice from Midas
0:16

Advice from Midas

ꓕNIOԀꓤƎ⅁⅁Iꓤꓕ

21,369 views • 2 days ago

hands of midas
0:15

hands of midas

M⁷🌙 지민 ♡ arirang

170,403 views • 1 year ago

The context size of video world models is only a few frames. Like a human with severe memory loss! We design a long-term memory for world models based on explicit 3D representations inspired by the human mind. This enables long-term consistency. 1/3
0:12

The context size of video world models is only a few frames. Like a human with severe memory loss! We design a long-term memory for world models based on explicit 3D representations inspired by the human mind. This enables long-term consistency. 1/3

Gordon Wetzstein

34,796 views • 1 year ago

MIT researchers taught a robot dog to perceive a 3D world using Neural Volumetric Memory (NVM). This technique lets the bot climb stairs, step over gaps & run autonomously w/a single neural network. Paper: Video: w/UC San Diego
0:12

MIT researchers taught a robot dog to perceive a 3D world using Neural Volumetric Memory (NVM). This technique lets the bot climb stairs, step over gaps & run autonomously w/a single neural network. Paper: Video: w/UC San Diego

MIT CSAIL

507,618 views • 3 years ago

Lightplane Highly-Scalable Components for Neural 3D Fields Contemporary 3D research, particularly in reconstruction and generation, heavily relies on 2D images for inputs or supervision. However, current designs for these 2D-3D mapping are memory-intensive, posing a
0:12

Lightplane Highly-Scalable Components for Neural 3D Fields Contemporary 3D research, particularly in reconstruction and generation, heavily relies on 2D images for inputs or supervision. However, current designs for these 2D-3D mapping are memory-intensive, posing a

AK

18,896 views • 2 years ago

LGTM from Apple: 4K feed-forward 3D Gaussian Splatting. instant 4K 3D scenes without massive GPUs.. - predicts a few lightweight 3D shapes, wraps them in ultra-high-res 2D textures. - low Memory usage You take two normal photos of a room. Instantly walk around it in flawless 3D.
0:12

LGTM from Apple: 4K feed-forward 3D Gaussian Splatting. instant 4K 3D scenes without massive GPUs.. - predicts a few lightweight 3D shapes, wraps them in ultra-high-res 2D textures. - low Memory usage You take two normal photos of a room. Instantly walk around it in flawless 3D.

Wildminder

46,278 views • 2 months ago

Yu et al., "MosaicMem: Hybrid Spatial Memory for Controllable Video World Models" A patch-based spatial memory that you raster into views + glues to make things work.
0:10

Yu et al., "MosaicMem: Hybrid Spatial Memory for Controllable Video World Models" A patch-based spatial memory that you raster into views + glues to make things work.

Kwang Moo Yi

11,170 views • 3 months ago

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.
0:12

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.

MrNeRF

52,801 views • 1 year ago

I always thought camera pose estimation is necessary for 3D reconstruction, until Zequn and Stephen proved me wrong! Introducing PreF3R, purely feed-forward 3D Gaussian Splatting without any intermediate pose estimation and COLMAP initialization. Video in, 3D Gaussians and novel view rendering out. Key technique: spatial memory network from Spann3R and Gaussian head supervised by pointmap loss plus photometric loss. See more at:
0:19

I always thought camera pose estimation is necessary for 3D reconstruction, until Zequn and Stephen proved me wrong! Introducing PreF3R, purely feed-forward 3D Gaussian Splatting without any intermediate pose estimation and COLMAP initialization. Video in, 3D Gaussians and novel view rendering out. Key technique: spatial memory network from Spann3R and Gaussian head supervised by pointmap loss plus photometric loss. See more at:

Heng Yang

20,160 views • 1 year ago

I don’t have the BRAM for a depth buffer so it’s time to get the memory controller up and running for this fjord torus. 100% FPGA logic 3D pipeline, no CPU.
0:13

I don’t have the BRAM for a depth buffer so it’s time to get the memory controller up and running for this fjord torus. 100% FPGA logic 3D pipeline, no CPU.

Ian Hanschen

29,249 views • 4 months ago

Doing anything but contacting his daughter #Fortnite #Midas
0:13

Doing anything but contacting his daughter #Fortnite #Midas

Vincenciel

27,881 views • 1 year ago

TikTok folks really liked this one, so I'm bringing him on here as well. Blink and you'll miss it. Cowboy Midas skin concept #Fortnite #Midas #FortniteConcept
0:16

TikTok folks really liked this one, so I'm bringing him on here as well. Blink and you'll miss it. Cowboy Midas skin concept #Fortnite #Midas #FortniteConcept

Addabobadda

25,306 views • 1 year ago