Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Relightify: Relightable 3D Faces from a Single Image via Diffusion Models abs: paper page:

_akhaliq's profile picture

AK

502,645 subscribers

85,893 Aufrufe • vor 3 Jahren •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion abs: project page: github:
0:16

DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion abs: project page: github:

AK

152,818 Aufrufe • vor 3 Jahren

🚀 Introducing GenLit – Reformulating Single-Image Relighting as Video Generation! We leverage video diffusion models to perform realistic near-field relighting from just a single image—No explicit 3D reconstruction or ray tracing required! No intermediate graphics buffers, directly in the pixel space! 📄 Dive into the paper: 🎥 Project page & demos: 🛠 Code coming soon! #GenerativeAI #ComputerVision #Relighting #DiffusionModels #Graphics 🧵 1/5
0:19

🚀 Introducing GenLit – Reformulating Single-Image Relighting as Video Generation! We leverage video diffusion models to perform realistic near-field relighting from just a single image—No explicit 3D reconstruction or ray tracing required! No intermediate graphics buffers, directly in the pixel space! 📄 Dive into the paper: 🎥 Project page & demos: 🛠 Code coming soon! #GenerativeAI #ComputerVision #Relighting #DiffusionModels #Graphics 🧵 1/5

Haiwen (Haven) Feng

22,392 Aufrufe • vor 11 Monaten

Meta just dropped a new paper. "A Recipe for Generating 3D Worlds From a Single Image" Turn a single image into a high-quality 3D world ready for VR. 10 wild examples:
0:16

Meta just dropped a new paper. "A Recipe for Generating 3D Worlds From a Single Image" Turn a single image into a high-quality 3D world ready for VR. 10 wild examples:

Angry Tom

214,328 Aufrufe • vor 1 Jahr

Create a 3D model from a single image, set of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”
0:18

Create a 3D model from a single image, set of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”

Bilawal Sidhu

92,760 Aufrufe • vor 2 Jahren

Pixel3DMM is a new method that can reconstruct 3D human faces from a single RGB image or multiple frames
0:16

Pixel3DMM is a new method that can reconstruct 3D human faces from a single RGB image or multiple frames

Dreaming Tulpa 🥓👑

32,565 Aufrufe • vor 1 Jahr

Someone just built a AI agent that connects to blender and builds full 3d models from a single image.
0:18

Someone just built a AI agent that connects to blender and builds full 3d models from a single image.

Oliver Prompts

53,398 Aufrufe • vor 1 Monat

Excited to share our new work "AvatarPopUp"! "Instant 3D Human Avatar Generation using Image Diffusion Models" 💻 📄
0:16

Excited to share our new work "AvatarPopUp"! "Instant 3D Human Avatar Generation using Image Diffusion Models" 💻 📄

Nikos Kolotouros

14,081 Aufrufe • vor 2 Jahren

So much exciting open-source 2d-to-3d research being shared open-source. Here is VAST AI Research implementation of Zehuan-Huang’s paper on Hugging Face Gradio MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generation
0:14

So much exciting open-source 2d-to-3d research being shared open-source. Here is VAST AI Research implementation of Zehuan-Huang’s paper on Hugging Face Gradio MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generation

Matt Hartman

24,215 Aufrufe • vor 1 Jahr

🆕 Image super-resolution model just dropped! Superior results even with a single sampling step. 🔥InvSR: Arbitrary-steps Image Super-resolution via Diffusion Inversion.
0:12

🆕 Image super-resolution model just dropped! Superior results even with a single sampling step. 🔥InvSR: Arbitrary-steps Image Super-resolution via Diffusion Inversion.

Gradio

53,331 Aufrufe • vor 1 Jahr

Introducing 📦𝗔𝗿𝘁𝗶𝗟𝗮𝘁𝗲𝗻𝘁🔧 (SIGGRAPH Asia 2025) — a high-quality 3D diffusion model that explicitly models object articulation, paving the way for richer, more realistic assets in embodied AI and simulation: – Generates fully articulated 3D objects – Physically plausible joints & motion – High-fidelity 3D Gaussian appearance – Supports generation from a single real image arXiv: Project: Code (coming soon):
0:16

Introducing 📦𝗔𝗿𝘁𝗶𝗟𝗮𝘁𝗲𝗻𝘁🔧 (SIGGRAPH Asia 2025) — a high-quality 3D diffusion model that explicitly models object articulation, paving the way for richer, more realistic assets in embodied AI and simulation: – Generates fully articulated 3D objects – Physically plausible joints & motion – High-fidelity 3D Gaussian appearance – Supports generation from a single real image arXiv: Project: Code (coming soon):

Xingang Pan

11,473 Aufrufe • vor 6 Monaten

DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion TL;DR: Create 3/4DGS from Video Diffusion Note: Some first inference code released (not all yet). Contributions (cited): • We present DimensionX, a novel framework for generating photorealistic 3D and 4D scenes from only a single image using controllable video diffusion. • We propose ST-Director, which decouples the spatial and temporal priors in video diffusion models by learning (spatial and temporal) dimension-aware modules with our curated datasets. We further enhance the hybriddimension control with a training-free composition approach according to the essence of video diffusion denoising process. • To bridge the gap between video diffusion and real-world scenes, we design a trajectory-aware mechanism for 3D generation and an identity-preserving denoising approach for 4D generation, enabling more realistic and controllable scene synthesis. • Extensive experiments manifest that our DimensionX delivers superior performance in video, 3D, and 4D generation compared with baseline methods.
0:18

DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion TL;DR: Create 3/4DGS from Video Diffusion Note: Some first inference code released (not all yet). Contributions (cited): • We present DimensionX, a novel framework for generating photorealistic 3D and 4D scenes from only a single image using controllable video diffusion. • We propose ST-Director, which decouples the spatial and temporal priors in video diffusion models by learning (spatial and temporal) dimension-aware modules with our curated datasets. We further enhance the hybriddimension control with a training-free composition approach according to the essence of video diffusion denoising process. • To bridge the gap between video diffusion and real-world scenes, we design a trajectory-aware mechanism for 3D generation and an identity-preserving denoising approach for 4D generation, enabling more realistic and controllable scene synthesis. • Extensive experiments manifest that our DimensionX delivers superior performance in video, 3D, and 4D generation compared with baseline methods.

MrNeRF

17,017 Aufrufe • vor 1 Jahr

Spell AI making a 3d volume from a single image. Link below
0:13

Spell AI making a 3d volume from a single image. Link below

Spline

10,815 Aufrufe • vor 1 Jahr

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.
0:12

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.

MrNeRF

52,801 Aufrufe • vor 1 Jahr

Here’s how to create this cool 3D scene from a single image! 📸 Midjourney (isometric image generation) Trellis (Image to 3D Gaussian Splat) Browser Lab (3D Editor Splat Import)
0:13

Here’s how to create this cool 3D scene from a single image! 📸 Midjourney (isometric image generation) Trellis (Image to 3D Gaussian Splat) Browser Lab (3D Editor Splat Import)

Ian Curtis

117,601 Aufrufe • vor 1 Jahr

HOLY SHIT - generate 3D mesh from a single image in LESS THAN A SECOND 🤯
0:13

HOLY SHIT - generate 3D mesh from a single image in LESS THAN A SECOND 🤯

Vaibhav (VB) Srivastav

154,108 Aufrufe • vor 1 Jahr

Can we use motion to prompt diffusion models? Our #ICLR2024 paper does just that. We propose Motion Guidance, a technique that allows users to edit an image by specifying “where things should move.”
0:15

Can we use motion to prompt diffusion models? Our #ICLR2024 paper does just that. We propose Motion Guidance, a technique that allows users to edit an image by specifying “where things should move.”

Daniel Geng

16,304 Aufrufe • vor 2 Jahren

3Dfy anything from a single image! Very thrilled to announce SAM 3D. From an input image, select any object you want, 3Dfy it! Blog: Demo:
0:15

3Dfy anything from a single image! Very thrilled to announce SAM 3D. From an input image, select any object you want, 3Dfy it! Blog: Demo:

Georgia Gkioxari

166,050 Aufrufe • vor 6 Monaten

SAM 3D Body is a CVPR 2026 award candidate paper from AI at Meta model recovers a full 3D human body mesh from a single RGB image you can run it automatically, or guide the reconstruction with masks and 2D keypoints thx to Niels Rogge for awesome demo idea
0:13

SAM 3D Body is a CVPR 2026 award candidate paper from AI at Meta model recovers a full 3D human body mesh from a single RGB image you can run it automatically, or guide the reconstruction with masks and 2D keypoints thx to Niels Rogge for awesome demo idea

SkalskiP @ CVPR2026

68,847 Aufrufe • vor 2 Tagen

Diffusion models have amazing image creation abilities. But how well does their generative knowledge transfer to discriminative tasks? We present Diffusion Classifier: strong classification results with pretrained conditional diffusion models, *with no additional training*! 1/9
0:13

Diffusion models have amazing image creation abilities. But how well does their generative knowledge transfer to discriminative tasks? We present Diffusion Classifier: strong classification results with pretrained conditional diffusion models, *with no additional training*! 1/9

Alex Li

95,304 Aufrufe • vor 2 Jahren