正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Humans are social creatures and physical interaction with other humans plays an important role in our everyday life. In this thread, we explain how such interactions can be reconstructed in 3D from a single image utilising a denoising diffusion probabilistic model. (1/n)

Lea Wilken/Müller

2,096 subscribers

76,563 次观看 • 2 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

If you’re not in freefall, you’re likely contacting something. Yet 3D human-object interaction (HOI) reconstruction remains underexplored. PICO (#CVPR2025) recovers humans 🏃‍♂️, objects 🏓, and their interactions 👉🍎- all in 3D, from just a single internet image. 1/11

If you’re not in freefall, you’re likely contacting something. Yet 3D human-object interaction (HOI) reconstruction remains underexplored. PICO (#CVPR2025) recovers humans 🏃‍♂️, objects 🏓, and their interactions 👉🍎- all in 3D, from just a single internet image. 1/11

Shashank Tripathi

24,164 次观看 • 1 年前

DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion TL;DR: Create 3/4DGS from Video Diffusion Note: Some first inference code released (not all yet). Contributions (cited): • We present DimensionX, a novel framework for generating photorealistic 3D and 4D scenes from only a single image using controllable video diffusion. • We propose ST-Director, which decouples the spatial and temporal priors in video diffusion models by learning (spatial and temporal) dimension-aware modules with our curated datasets. We further enhance the hybriddimension control with a training-free composition approach according to the essence of video diffusion denoising process. • To bridge the gap between video diffusion and real-world scenes, we design a trajectory-aware mechanism for 3D generation and an identity-preserving denoising approach for 4D generation, enabling more realistic and controllable scene synthesis. • Extensive experiments manifest that our DimensionX delivers superior performance in video, 3D, and 4D generation compared with baseline methods.

DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion TL;DR: Create 3/4DGS from Video Diffusion Note: Some first inference code released (not all yet). Contributions (cited): • We present DimensionX, a novel framework for generating photorealistic 3D and 4D scenes from only a single image using controllable video diffusion. • We propose ST-Director, which decouples the spatial and temporal priors in video diffusion models by learning (spatial and temporal) dimension-aware modules with our curated datasets. We further enhance the hybriddimension control with a training-free composition approach according to the essence of video diffusion denoising process. • To bridge the gap between video diffusion and real-world scenes, we design a trajectory-aware mechanism for 3D generation and an identity-preserving denoising approach for 4D generation, enabling more realistic and controllable scene synthesis. • Extensive experiments manifest that our DimensionX delivers superior performance in video, 3D, and 4D generation compared with baseline methods.

MrNeRF

17,062 次观看 • 1 年前

the fact that i can take an image of a room and turn it into a 3d model in one shot is actually insane this took like 30 seconds from image to 3d model

the fact that i can take an image of a room and turn it into a 3d model in one shot is actually insane this took like 30 seconds from image to 3d model

Jan

131,884 次观看 • 9 个月前

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.

MrNeRF

52,849 次观看 • 1 年前

Create a 3D model from a single image, set of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”

Create a 3D model from a single image, set of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”

Bilawal Sidhu

92,867 次观看 • 2 年前

We are excited to introduce Stable Fast 3D, Stability AI’s latest breakthrough in 3D asset generation technology. This innovative model transforms a single input image into a detailed 3D asset in just 0.5 seconds, setting a new standard for speed and quality in the field of 3D reconstruction! Alongside this release, we’ve also published a technical report that highlights how we achieve fast inference speeds with reduced baked illumination and material parameters. 👾You can learn more and access the report here:

We are excited to introduce Stable Fast 3D, Stability AI’s latest breakthrough in 3D asset generation technology. This innovative model transforms a single input image into a detailed 3D asset in just 0.5 seconds, setting a new standard for speed and quality in the field of 3D reconstruction! Alongside this release, we’ve also published a technical report that highlights how we achieve fast inference speeds with reduced baked illumination and material parameters. 👾You can learn more and access the report here:

Stability AI

438,839 次观看 • 2 年前

The Hidden Language of Diffusion Models paper page: tackle the challenge of understanding concept representations in text-to-image models by decomposing an input text prompt into a small set of interpretable elements. This is achieved by learning a pseudo-token that is a sparse weighted combination of tokens from the model's vocabulary, with the objective of reconstructing the images generated for the given concept. Applied over the state-of-the-art Stable Diffusion model, this decomposition reveals non-trivial and surprising structures in the representations of concepts. For example, we find that some concepts such as "a president" or "a composer" are dominated by specific instances (e.g., "Obama", "Biden") and their interpolations. Other concepts, such as "happiness" combine associated terms that can be concrete ("family", "laughter") or abstract ("friendship", "emotion"). In addition to peering into the inner workings of Stable Diffusion, our method also enables applications such as single-image decomposition to tokens, bias detection and mitigation, and semantic image manipulation

The Hidden Language of Diffusion Models paper page: tackle the challenge of understanding concept representations in text-to-image models by decomposing an input text prompt into a small set of interpretable elements. This is achieved by learning a pseudo-token that is a sparse weighted combination of tokens from the model's vocabulary, with the objective of reconstructing the images generated for the given concept. Applied over the state-of-the-art Stable Diffusion model, this decomposition reveals non-trivial and surprising structures in the representations of concepts. For example, we find that some concepts such as "a president" or "a composer" are dominated by specific instances (e.g., "Obama", "Biden") and their interpolations. Other concepts, such as "happiness" combine associated terms that can be concrete ("family", "laughter") or abstract ("friendship", "emotion"). In addition to peering into the inner workings of Stable Diffusion, our method also enables applications such as single-image decomposition to tokens, bias detection and mitigation, and semantic image manipulation

AK

41,830 次观看 • 3 年前

**Giant Grey Alien Meeting Humans in the Field** A massive grey alien towers over a group of humans in an open field, with a disc-shaped UFO visible nearby. The scale and interaction are breathtaking. Is this real footage of a close encounter with a giant extraterrestrial? **What do you think?** #GiantAlien #GreyGiant #AlienMeeting #UFOEncounter #RealAlien #Disclosure #PlanetSecrets

Giant Grey Alien Meeting Humans in the Field A massive grey alien towers over a group of humans in an open field, with a disc-shaped UFO visible nearby. The scale and interaction are breathtaking. Is this real footage of a close encounter with a giant extraterrestrial? What do you think? #GiantAlien #GreyGiant #AlienMeeting #UFOEncounter #RealAlien #Disclosure #PlanetSecrets

TOLGA ÖZÇELİK

11,778 次观看 • 1 个月前

Only one cruel monster in this video 👺Human trash is destroying life on our planet. Humans are the biggest failure of evolution. A clusterfuck for all life. We can do better. We can live without destroying life. #LiveVegan or go extinct a s a p 🙏

Only one cruel monster in this video 👺Human trash is destroying life on our planet. Humans are the biggest failure of evolution. A clusterfuck for all life. We can do better. We can live without destroying life. #LiveVegan or go extinct a s a p 🙏

Marc Pieterse (⧖) @marcpieterse.bsky.social

130,331 次观看 • 8 个月前

16 Videos That Prove Men Are Simple Creatures – A Thread🧵 ⚠️ Every single video in this thread will brighten your mood instantly 1. Men can find joy in the smallest things, they’re just that simple 😂

16 Videos That Prove Men Are Simple Creatures – A Thread🧵 ⚠️ Every single video in this thread will brighten your mood instantly 1. Men can find joy in the smallest things, they’re just that simple 😂

Saffron Sniper

9,038,944 次观看 • 1 年前

Diffusions are excellent in creating fantastic images and videos 🔎 We cooked a *diffusion* model to synthesize structured data #ICLR2025 🔥 Introducing TabDiff, a mixed-type diffusion model for generating synthetic tabular data, imputing missing values, and beyond! 🧵 1/n

Diffusions are excellent in creating fantastic images and videos 🔎 We cooked a diffusion model to synthesize structured data #ICLR2025 🔥 Introducing TabDiff, a mixed-type diffusion model for generating synthetic tabular data, imputing missing values, and beyond! 🧵 1/n

Minkai Xu

50,434 次观看 • 1 年前

Okay this new model is insane. Generate an image, then give it to the model to turn it into a 3D model with matching texture in seconds. Creativity on Spielwerk will be endless with this

Okay this new model is insane. Generate an image, then give it to the model to turn it into a 3D model with matching texture in seconds. Creativity on Spielwerk will be endless with this

Eike Drescher

37,987 次观看 • 9 个月前

Today, we're sharing two major advancements in our work toward general-purpose embodied AI agents: VC-1 & ASC. We're excited for how this work will help build toward a future where AI agents can assist humans in both the virtual & physical world. Details ⬇️

Today, we're sharing two major advancements in our work toward general-purpose embodied AI agents: VC-1 & ASC. We're excited for how this work will help build toward a future where AI agents can assist humans in both the virtual & physical world. Details ⬇️

AI at Meta

125,005 次观看 • 3 年前

Try new poses and angles! 3D drawing figures are ideal for when you have a pose in mind but can't find that perfect reference image. Learn how to apply poses and other fun additions like BVH files to your 3D model in this tutorial: #clipstudio

Try new poses and angles! 3D drawing figures are ideal for when you have a pose in mind but can't find that perfect reference image. Learn how to apply poses and other fun additions like BVH files to your 3D model in this tutorial: #clipstudio

CLIP STUDIO PAINT

165,643 次观看 • 1 年前

Joe Rogan is still troubled by inaccurate statements made by Bob Lazar. Humans are not containers for souls, humans ARE souls having many temporary experiences in physical form. The soul is never a prisoner and is always safe. The UFOs that want to be seen are our soul family.

Joe Rogan is still troubled by inaccurate statements made by Bob Lazar. Humans are not containers for souls, humans ARE souls having many temporary experiences in physical form. The soul is never a prisoner and is always safe. The UFOs that want to be seen are our soul family.

Kab

102,157 次观看 • 2 年前

AI agents can only succeed when verified human identification works! Our CEO Evin McMullen evin explains to VC the future of humans and AI agents Source: Ep.24 | Humans and Al Agents: Whom Are We Interacting With? of the "Web2+1 with VC: Insider Tips in Blockchain and Crypto" podcast

AI agents can only succeed when verified human identification works! Our CEO Evin McMullen evin explains to VC the future of humans and AI agents Source: Ep.24 | Humans and Al Agents: Whom Are We Interacting With? of the "Web2+1 with VC: Insider Tips in Blockchain and Crypto" podcast

Billions Network

32,141 次观看 • 5 个月前