正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Video to 3D Memory (MiDAS v3.1 + #glslViewer +

patricio gonzalez vivo

17,186 subscribers

137,380 次观看 • 3 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Minecraft 3D generation now at the highest quality ever, built using fal ⛏️ Text → Image (nano-banana-pro) → 3D mesh (Hunyuan 3D v3.1) → Voxelize → Texture mapping → Minecraft structure!

Minecraft 3D generation now at the highest quality ever, built using fal ⛏️ Text → Image (nano-banana-pro) → 3D mesh (Hunyuan 3D v3.1) → Voxelize → Texture mapping → Minecraft structure!

Blendi

493,434 次观看 • 7 个月前

Turn any webpage into a museum! 🏛️ Made this Chrome extension that uses Hunyuan 3D v3.1 on fal to turn any image into a 3D model, and three.js for the interactive viewer

Turn any webpage into a museum! 🏛️ Made this Chrome extension that uses Hunyuan 3D v3.1 on fal to turn any image into a 3D model, and three.js for the interactive viewer

Blendi

48,960 次观看 • 6 个月前

Meowscles is concerned for Midas.. #Fortnite #Midas #FortniteArt

Meowscles is concerned for Midas.. #Fortnite #Midas #FortniteArt

Vincenciel

12,451 次观看 • 9 个月前

how i feel listening to midas touch

how i feel listening to midas touch

closed.

18,977 次观看 • 1 年前

Wuthering Waves V3.1 New official ad :) #WutheringWaves #WuWa #鳴潮 #WuWaCollection #WuWaAnniversary

Wuthering Waves V3.1 New official ad :) #WutheringWaves #WuWa #鳴潮 #WuWaCollection #WuWaAnniversary

RinasCita

69,785 次观看 • 8 个月前

Welcome to #Chelsea, Alex! 💙 / Midas Sports Management

Welcome to #Chelsea, Alex! 💙 / Midas Sports Management

Absolute Chelsea

155,924 次观看 • 3 年前

vgpu 0.6 is out 🔉 · Build complex 3D scenes more easily · Create 3D websites, VR, or videos · Better performance and memory usage

vgpu 0.6 is out 🔉 · Build complex 3D scenes more easily · Create 3D websites, VR, or videos · Better performance and memory usage

Matias 🧉

11,597 次观看 • 17 天前

They’re def gonna be late to the wedding #Fortnite #Midas #FortniteArt

They’re def gonna be late to the wedding #Fortnite #Midas #FortniteArt

Vincenciel

33,600 次观看 • 1 年前

Advice from Midas

Advice from Midas

ꓕNIOԀꓤƎ⅁⅁Iꓤꓕ

21,661 次观看 • 4 个月前

hands of midas

hands of midas

M⁷🌙 지민 ♡ arirang

170,474 次观看 • 2 年前

The context size of video world models is only a few frames. Like a human with severe memory loss! We design a long-term memory for world models based on explicit 3D representations inspired by the human mind. This enables long-term consistency. 1/3

The context size of video world models is only a few frames. Like a human with severe memory loss! We design a long-term memory for world models based on explicit 3D representations inspired by the human mind. This enables long-term consistency. 1/3

Gordon Wetzstein

35,128 次观看 • 1 年前

MIT researchers taught a robot dog to perceive a 3D world using Neural Volumetric Memory (NVM). This technique lets the bot climb stairs, step over gaps & run autonomously w/a single neural network. Paper: Video: w/UC San Diego

MIT researchers taught a robot dog to perceive a 3D world using Neural Volumetric Memory (NVM). This technique lets the bot climb stairs, step over gaps & run autonomously w/a single neural network. Paper: Video: w/UC San Diego

MIT CSAIL

507,687 次观看 • 3 年前

LGTM from Apple: 4K feed-forward 3D Gaussian Splatting. instant 4K 3D scenes without massive GPUs.. - predicts a few lightweight 3D shapes, wraps them in ultra-high-res 2D textures. - low Memory usage You take two normal photos of a room. Instantly walk around it in flawless 3D.

LGTM from Apple: 4K feed-forward 3D Gaussian Splatting. instant 4K 3D scenes without massive GPUs.. - predicts a few lightweight 3D shapes, wraps them in ultra-high-res 2D textures. - low Memory usage You take two normal photos of a room. Instantly walk around it in flawless 3D.

Wildminder

46,458 次观看 • 7 个月前

Yu et al., "MosaicMem: Hybrid Spatial Memory for Controllable Video World Models" A patch-based spatial memory that you raster into views + glues to make things work.

Yu et al., "MosaicMem: Hybrid Spatial Memory for Controllable Video World Models" A patch-based spatial memory that you raster into views + glues to make things work.

Kwang Moo Yi

11,170 次观看 • 7 个月前

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.

MrNeRF

52,849 次观看 • 1 年前

Lightning v3.1 Pro is the most human TTS ever built. The person on the other end doesn’t care about the model. They care whether the conversation feels natural. So we fine-tuned Lightning v3.1 Pro for the details that make speech feel human: where a pause lands, which word carries the weight, and how the pace shifts when a line is a question not a statement. With 250+ expressive voices across 31+ languages, Lightning brings natural rhythm, emotion, and nuance to every interaction. Built for conversations that sound less like AI and more like someone worth listening to. Try Lightning v3.1 Pro →

Lightning v3.1 Pro is the most human TTS ever built. The person on the other end doesn’t care about the model. They care whether the conversation feels natural. So we fine-tuned Lightning v3.1 Pro for the details that make speech feel human: where a pause lands, which word carries the weight, and how the pace shifts when a line is a question not a statement. With 250+ expressive voices across 31+ languages, Lightning brings natural rhythm, emotion, and nuance to every interaction. Built for conversations that sound less like AI and more like someone worth listening to. Try Lightning v3.1 Pro →

smallest.ai

33,263 次观看 • 1 个月前

A lot of work over the weekend: LYGIA: cmake/python bundle script for C++ VERA v1.1.0: - support for gsplats - LYGIA bundle to stream line default shaders - better camera interactions GlslViewer v3.5.1: support for gsplats and native lygia support

A lot of work over the weekend: LYGIA: cmake/python bundle script for C++ VERA v1.1.0: - support for gsplats - LYGIA bundle to stream line default shaders - better camera interactions GlslViewer v3.5.1: support for gsplats and native lygia support

patricio gonzalez vivo

15,097 次观看 • 9 个月前