Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

ViewCrafter can generate high-quality 3D views from single or few images using a video diffusion model! It allows for precise camera control and is useful for real-time rendering and turning text into 3D scenes. Links ⬇️

dreamingtulpa's profile picture

Dreaming Tulpa 🥓👑

54,815 subscribers

19,892 Aufrufe • vor 1 Jahr •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.
0:12

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.

MrNeRF

52,801 Aufrufe • vor 1 Jahr

Create a 3D model from a single image, set of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”
0:18

Create a 3D model from a single image, set of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”

Bilawal Sidhu

92,792 Aufrufe • vor 2 Jahren

This is RICULOUSLY good, TRELLIS 3D Generation model by Microsoft! 🔥 Generate high-quality 3D assets from text or image prompts. Supports various formats like Radiance Fields, 3D Gaussians, and meshes Available for FREE on Hugging Face!
0:14

This is RICULOUSLY good, TRELLIS 3D Generation model by Microsoft! 🔥 Generate high-quality 3D assets from text or image prompts. Supports various formats like Radiance Fields, 3D Gaussians, and meshes Available for FREE on Hugging Face!

Vaibhav (VB) Srivastav

62,437 Aufrufe • vor 1 Jahr

NVIDIA introduces Edify 3D AI model You can generate high quality 3D assets from text or image input under 2 minutes! With PBR materials, quad-mesh topologies, and 4k textures. 6 wild examples:
0:18

NVIDIA introduces Edify 3D AI model You can generate high quality 3D assets from text or image input under 2 minutes! With PBR materials, quad-mesh topologies, and 4k textures. 6 wild examples:

Min Choi

399,041 Aufrufe • vor 1 Jahr

DreamCraft3D++ can generate animatable high-quality 3D assets from an image in 10 minutes! Yes, it supports meshes 🔥 Links ⬇️
0:16

DreamCraft3D++ can generate animatable high-quality 3D assets from an image in 10 minutes! Yes, it supports meshes 🔥 Links ⬇️

Dreaming Tulpa 🥓👑

59,017 Aufrufe • vor 1 Jahr

If you make videos, this is huge! The world’s first 3D-conditioned foundational video model has landed. Imagine literally stepping into your scene and directing the camera from inside it. Kamo-1 model from Kinetix is made for creators who want actual, precise control. Dive into the details ⬇️
0:10

If you make videos, this is huge! The world’s first 3D-conditioned foundational video model has landed. Imagine literally stepping into your scene and directing the camera from inside it. Kamo-1 model from Kinetix is made for creators who want actual, precise control. Dive into the details ⬇️

Umesh

30,586 Aufrufe • vor 7 Monaten

UI/UX Designers, you can now generate stunning 3D mockup images and videos without relying on Figma plugins. I found this amazing tool called ContentCore, It quickly generate high-quality 3D device mockups (images and video animations) to showcase your UI designs, with zero design hassle. Bookmark it for later 💜
0:16

UI/UX Designers, you can now generate stunning 3D mockup images and videos without relying on Figma plugins. I found this amazing tool called ContentCore, It quickly generate high-quality 3D device mockups (images and video animations) to showcase your UI designs, with zero design hassle. Bookmark it for later 💜

Abraham John 🦄🦓

48,047 Aufrufe • vor 9 Monaten

Introducing 📦𝗔𝗿𝘁𝗶𝗟𝗮𝘁𝗲𝗻𝘁🔧 (SIGGRAPH Asia 2025) — a high-quality 3D diffusion model that explicitly models object articulation, paving the way for richer, more realistic assets in embodied AI and simulation: – Generates fully articulated 3D objects – Physically plausible joints & motion – High-fidelity 3D Gaussian appearance – Supports generation from a single real image arXiv: Project: Code (coming soon):
0:16

Introducing 📦𝗔𝗿𝘁𝗶𝗟𝗮𝘁𝗲𝗻𝘁🔧 (SIGGRAPH Asia 2025) — a high-quality 3D diffusion model that explicitly models object articulation, paving the way for richer, more realistic assets in embodied AI and simulation: – Generates fully articulated 3D objects – Physically plausible joints & motion – High-fidelity 3D Gaussian appearance – Supports generation from a single real image arXiv: Project: Code (coming soon):

Xingang Pan

11,502 Aufrufe • vor 7 Monaten

DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion TL;DR: Create 3/4DGS from Video Diffusion Note: Some first inference code released (not all yet). Contributions (cited): • We present DimensionX, a novel framework for generating photorealistic 3D and 4D scenes from only a single image using controllable video diffusion. • We propose ST-Director, which decouples the spatial and temporal priors in video diffusion models by learning (spatial and temporal) dimension-aware modules with our curated datasets. We further enhance the hybriddimension control with a training-free composition approach according to the essence of video diffusion denoising process. • To bridge the gap between video diffusion and real-world scenes, we design a trajectory-aware mechanism for 3D generation and an identity-preserving denoising approach for 4D generation, enabling more realistic and controllable scene synthesis. • Extensive experiments manifest that our DimensionX delivers superior performance in video, 3D, and 4D generation compared with baseline methods.
0:18

DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion TL;DR: Create 3/4DGS from Video Diffusion Note: Some first inference code released (not all yet). Contributions (cited): • We present DimensionX, a novel framework for generating photorealistic 3D and 4D scenes from only a single image using controllable video diffusion. • We propose ST-Director, which decouples the spatial and temporal priors in video diffusion models by learning (spatial and temporal) dimension-aware modules with our curated datasets. We further enhance the hybriddimension control with a training-free composition approach according to the essence of video diffusion denoising process. • To bridge the gap between video diffusion and real-world scenes, we design a trajectory-aware mechanism for 3D generation and an identity-preserving denoising approach for 4D generation, enabling more realistic and controllable scene synthesis. • Extensive experiments manifest that our DimensionX delivers superior performance in video, 3D, and 4D generation compared with baseline methods.

MrNeRF

17,039 Aufrufe • vor 1 Jahr

A real-time AI motion capture model with 1B parameters. Connects to a 1080P camera or processes uploaded video to generate 3D motion data in real time. Supports Unreal Engine, Unity, and Blender, requiring 8GB of GPU VRAM for real-time processing.
0:13

A real-time AI motion capture model with 1B parameters. Connects to a 1080P camera or processes uploaded video to generate 3D motion data in real time. Supports Unreal Engine, Unity, and Blender, requiring 8GB of GPU VRAM for real-time processing.

CYANPUPPETS

36,748 Aufrufe • vor 4 Monaten

Today, we’re introducing Meta’s latest 3D foundation model, AssetGen 2.0, which was designed to create high-quality 3D assets from text and image prompts. AssetGen 2.0 consists of two models developed within Meta: one to generate 3D meshes and another to generate textures. Read More:
0:17

Today, we’re introducing Meta’s latest 3D foundation model, AssetGen 2.0, which was designed to create high-quality 3D assets from text and image prompts. AssetGen 2.0 consists of two models developed within Meta: one to generate 3D meshes and another to generate textures. Read More:

Jake Steinerman 🌎

92,257 Aufrufe • vor 1 Jahr

3D Gaussian Splatting for Real-Time Radiance Field Rendering paper page: Radiance Field methods have recently revolutionized novel-view synthesis of scenes captured with multiple photos or videos. However, achieving high visual quality still requires neural networks that are costly to train and render, while recent faster methods inevitably trade off speed for quality. For unbounded and complete scenes (rather than isolated objects) and 1080p resolution rendering, no current method can achieve real-time display rates. We introduce three key elements that allow us to achieve state-of-the-art visual quality while maintaining competitive training times and importantly allow high-quality real-time (>= 30 fps) novel-view synthesis at 1080p resolution. First, starting from sparse points produced during camera calibration, we represent the scene with 3D Gaussians that preserve desirable properties of continuous volumetric radiance fields for scene optimization while avoiding unnecessary computation in empty space; Second, we perform interleaved optimization/density control of the 3D Gaussians, notably optimizing anisotropic covariance to achieve an accurate representation of the scene; Third, we develop a fast visibility-aware rendering algorithm that supports anisotropic splatting and both accelerates training and allows realtime rendering. We demonstrate state-of-the-art visual quality and real-time rendering on several established datasets.
0:18

3D Gaussian Splatting for Real-Time Radiance Field Rendering paper page: Radiance Field methods have recently revolutionized novel-view synthesis of scenes captured with multiple photos or videos. However, achieving high visual quality still requires neural networks that are costly to train and render, while recent faster methods inevitably trade off speed for quality. For unbounded and complete scenes (rather than isolated objects) and 1080p resolution rendering, no current method can achieve real-time display rates. We introduce three key elements that allow us to achieve state-of-the-art visual quality while maintaining competitive training times and importantly allow high-quality real-time (>= 30 fps) novel-view synthesis at 1080p resolution. First, starting from sparse points produced during camera calibration, we represent the scene with 3D Gaussians that preserve desirable properties of continuous volumetric radiance fields for scene optimization while avoiding unnecessary computation in empty space; Second, we perform interleaved optimization/density control of the 3D Gaussians, notably optimizing anisotropic covariance to achieve an accurate representation of the scene; Third, we develop a fast visibility-aware rendering algorithm that supports anisotropic splatting and both accelerates training and allows realtime rendering. We demonstrate state-of-the-art visual quality and real-time rendering on several established datasets.

AK

633,428 Aufrufe • vor 2 Jahren

Google presents LayoutVLM a model that can generate 3D layouts from text instructions
0:13

Google presents LayoutVLM a model that can generate 3D layouts from text instructions

Dreaming Tulpa 🥓👑

27,205 Aufrufe • vor 1 Jahr

there is a new gaussian splat method that can create high-quality 3D scenes from long videos without needing camera positions:
0:18

there is a new gaussian splat method that can create high-quality 3D scenes from long videos without needing camera positions:

Dreaming Tulpa 🥓👑

41,437 Aufrufe • vor 9 Monaten

SPARK can create high-quality 3D face avatars from regular videos and track expressions and poses in real time. It improves the accuracy of 3D face reconstructions for tasks like aging, face swapping, and digital makeup. 6 examples:
0:11

SPARK can create high-quality 3D face avatars from regular videos and track expressions and poses in real time. It improves the accuracy of 3D face reconstructions for tasks like aging, face swapping, and digital makeup. 6 examples:

Dreaming Tulpa 🥓👑

193,764 Aufrufe • vor 1 Jahr

3D AI is levelling up.. Hunyuan 3D just dropped Sketch to 3D, turn any sketch into high quality 3D model and.. it can even rig &amp; and animate your 3D character automatically something big is coming today, stay tuned. step by step tutorial:
0:12

3D AI is levelling up.. Hunyuan 3D just dropped Sketch to 3D, turn any sketch into high quality 3D model and.. it can even rig &amp; and animate your 3D character automatically something big is coming today, stay tuned. step by step tutorial:

el.cine

235,364 Aufrufe • vor 1 Jahr