Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

PixWorld Unifying 3D Scene Generation and Reconstruction in Pixel Space

_akhaliq's profile picture

AK

526,875 subscribers

16,750 Aufrufe • vor 4 Monaten •via X (Twitter)

Wissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

5 Kommentare

Profilbild von AK
AKvor 4 Monaten

paper:

Profilbild von Isabelle E-Z
Isabelle E-Zvor 4 Monaten

The pixel space approach is elegant. Unifying 3D generation and reconstruction will have real implications for robotics and automation.

Profilbild von Jonathan Korstad
Jonathan Korstadvor 4 Monaten

👀

Profilbild von Ferbin
Ferbinvor 4 Monaten

The big unlock is editing a room like a photo. Change the couch, keep the shadows, don't rebuild the whole world.

Profilbild von AI Mastery Guide
AI Mastery Guidevor 4 Monaten

1042x faster and better quality is a pretty rare combo to see in the same result.

Ähnliche Videos

Pixel-perfect 3D generation is here. 🧵 Tencent’s new Free Local Pixal3D project every pixel directly into 3D space. No more "AI hallucinations"—just sub-pixel faithful reconstruction. ✅ Open Weights ✅ Local (24GB VRAM) ✅ Matches silhouettes perfectly Is this the new benchmark for open-source 3D? Full workflow and test: 👇 #3DAI #Pixal3D #GameDev #Tencen #OpenSource #3DModeling
1:13

Pixel-perfect 3D generation is here. 🧵 Tencent’s new Free Local Pixal3D project every pixel directly into 3D space. No more "AI hallucinations"—just sub-pixel faithful reconstruction. ✅ Open Weights ✅ Local (24GB VRAM) ✅ Matches silhouettes perfectly Is this the new benchmark for open-source 3D? Full workflow and test: 👇 #3DAI #Pixal3D #GameDev #Tencen #OpenSource #3DModeling

Stefan 3D AI

23,210 Aufrufe • vor 6 Monaten

Nvidia presents LLaMA-Mesh Unifying 3D Mesh Generation with Language Models
1:04

Nvidia presents LLaMA-Mesh Unifying 3D Mesh Generation with Language Models

AK

113,609 Aufrufe • vor 2 Jahren

📢📢GenRecon: Bridging Generative Priors for Multi-View 3D Scene Reconstruction📢📢 Reconstructing high-fidelity 3D scenes from sparse RGB input is hard. It needs a strong 3D prior! We reformulate multi-view scene reconstruction as conditional 3D generation over overlapping spatial chunks, lifting posed image features into a generative shape prior via 3D conditioning. As an example prior, we build on Trellis2, and train it such that its reconstruction is pixel aligned and matches from all views. GenRecon achieves unprecedented reconstruction quality from any sparse RGB input sequence, even from a phone capture. The reconstruction also includes PBR materials which facilitates relighting and virtual object insertion. Amazing work by Katharina Schmid, Nicolas von Lützow, Jozef, Angela Dai
0:26

📢📢GenRecon: Bridging Generative Priors for Multi-View 3D Scene Reconstruction📢📢 Reconstructing high-fidelity 3D scenes from sparse RGB input is hard. It needs a strong 3D prior! We reformulate multi-view scene reconstruction as conditional 3D generation over overlapping spatial chunks, lifting posed image features into a generative shape prior via 3D conditioning. As an example prior, we build on Trellis2, and train it such that its reconstruction is pixel aligned and matches from all views. GenRecon achieves unprecedented reconstruction quality from any sparse RGB input sequence, even from a phone capture. The reconstruction also includes PBR materials which facilitates relighting and virtual object insertion. Amazing work by Katharina Schmid, Nicolas von Lützow, Jozef, Angela Dai

Matthias Niessner

18,482 Aufrufe • vor 5 Monaten

👾 UniForge3D: Joint 3D Reconstruction and Generation in a Shared Anchor-Guided Space ❤ Thanks to Wenjue Chen, Wenyue Chen, Heliang Zheng, Rongfei Jia, Yuan Liu, Meng Li 🌐 🧬 📄 📦
0:59

👾 UniForge3D: Joint 3D Reconstruction and Generation in a Shared Anchor-Guided Space ❤ Thanks to Wenjue Chen, Wenyue Chen, Heliang Zheng, Rongfei Jia, Yuan Liu, Meng Li 🌐 🧬 📄 📦

camenduru

15,728 Aufrufe • vor 1 Monat

Pixal3D Pixel-Aligned 3D Generation from Images
1:04

Pixal3D Pixel-Aligned 3D Generation from Images

AK

31,427 Aufrufe • vor 6 Monaten

SAM 3D enables accurate 3D reconstruction from a single image, supporting real-world applications in editing, robotics, and interactive scene generation. Matt, a SAM 3D researcher, explains how the two-model design makes this possible for both people and complex environments. 🔗 Read the SAM 3D Objects research paper: 🔗 Read the SAM 3D Body research paper:
1:54

SAM 3D enables accurate 3D reconstruction from a single image, supporting real-world applications in editing, robotics, and interactive scene generation. Matt, a SAM 3D researcher, explains how the two-model design makes this possible for both people and complex environments. 🔗 Read the SAM 3D Objects research paper: 🔗 Read the SAM 3D Body research paper:

AI at Meta

18,031 Aufrufe • vor 11 Monaten

LEGO-Anything Coding Agents for 3D Scene Reconstruction paper:
0:51

LEGO-Anything Coding Agents for 3D Scene Reconstruction paper:

AK

100,450 Aufrufe • vor 1 Monat

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a camera-conditioned video diffusion model can be transformed into a generative reconstruction model that directly outputs a high-quality 3D Gaussian Splatting representation through self-distillation, without requiring real-world training data. Check out our results in the video (wait for dynamic scenes in the second half!) : Project Page: Code and Models: Paper:
0:50

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a camera-conditioned video diffusion model can be transformed into a generative reconstruction model that directly outputs a high-quality 3D Gaussian Splatting representation through self-distillation, without requiring real-world training data. Check out our results in the video (wait for dynamic scenes in the second half!) : Project Page: Code and Models: Paper:

Sherwin Bahmani

66,960 Aufrufe • vor 1 Jahr

3D scene reconstructions by NVIDIA. ArtiFixer - repairs artifacts and extends sparse views via Wan 2.1. - high-fidelity inpainting in occluded regions - gens hundreds of consistent frames in a single pass - 3D Gaussian Splatting for navigable scene reconstruction Makes the 3D environment look photorealistic and fully navigable for VR/AR. It basically turns a broken 3D model into a polished, professional scene.
0:43

3D scene reconstructions by NVIDIA. ArtiFixer - repairs artifacts and extends sparse views via Wan 2.1. - high-fidelity inpainting in occluded regions - gens hundreds of consistent frames in a single pass - 3D Gaussian Splatting for navigable scene reconstruction Makes the 3D environment look photorealistic and fully navigable for VR/AR. It basically turns a broken 3D model into a polished, professional scene.

Wildminder

16,086 Aufrufe • vor 5 Monaten

Today we are releasing JST-2, the world's first full-stack physics-native world foundation model. Many world models learn in pixel/video space. We went back to first principles and built the entire model stack in 3D. Generate a 3D scene in seconds and expand it in real time. Create characters with motion built in, all through one general architecture.
1:45

Today we are releasing JST-2, the world's first full-stack physics-native world foundation model. Many world models learn in pixel/video space. We went back to first principles and built the entire model stack in 3D. Generate a 3D scene in seconds and expand it in real time. Create characters with motion built in, all through one general architecture.

ViggleAI

1,744,407 Aufrufe • vor 25 Tagen

Live monocular 3D reconstruction from camera feed, with multi-frame stitching and relative positioning (frame buffer of 4)... running on M3 mac cpu at 24fps... visualised using Rerun next up... realtime semantic navigation in 3d space...
0:22

Live monocular 3D reconstruction from camera feed, with multi-frame stitching and relative positioning (frame buffer of 4)... running on M3 mac cpu at 24fps... visualised using Rerun next up... realtime semantic navigation in 3d space...

ud

22,080 Aufrufe • vor 10 Monaten

WaterSplatting: Fast Underwater 3D Scene Reconstruction Using Gaussian Splatting Project: Method ⬇️ 1 I 2
1:07

WaterSplatting: Fast Underwater 3D Scene Reconstruction Using Gaussian Splatting Project: Method ⬇️ 1 I 2

MrNeRF

12,191 Aufrufe • vor 2 Jahren

📢Face Anything: 4D Face Reconstruction from Any Image Sequence Transformer model for 4D face reconstruction and dense tracking: - predict canonical facial coordinates per pixel - tracking as reconstruction in canonical space - geometry + correspondences in one forward pass Key idea: a shared canonical space across frames - correspondences as nearest neighbors - no motion or deformation estimation Stable geometry and tracking, even under large expressions and viewpoint changes - check out our results! 🌐 ▶️ Great work by Umut Kocasarı, Simon Giebenhain, Richard Shaw
0:42

📢Face Anything: 4D Face Reconstruction from Any Image Sequence Transformer model for 4D face reconstruction and dense tracking: - predict canonical facial coordinates per pixel - tracking as reconstruction in canonical space - geometry + correspondences in one forward pass Key idea: a shared canonical space across frames - correspondences as nearest neighbors - no motion or deformation estimation Stable geometry and tracking, even under large expressions and viewpoint changes - check out our results! 🌐 ▶️ Great work by Umut Kocasarı, Simon Giebenhain, Richard Shaw

Matthias Niessner

61,927 Aufrufe • vor 6 Monaten

just a pixel in space
0:48

just a pixel in space

pale kirill

99,931 Aufrufe • vor 8 Monaten

📢 GenRecon Code Release 📢 Few images in → complete, high-fidelity 3D scene out! GenRecon builds a generative prior on full scenes, resulting in unprecedented 3D reconstruction quality. 🔗 🌐 📄
0:20

📢 GenRecon Code Release 📢 Few images in → complete, high-fidelity 3D scene out! GenRecon builds a generative prior on full scenes, resulting in unprecedented 3D reconstruction quality. 🔗 🌐 📄

Matthias Niessner

40,586 Aufrufe • vor 4 Monaten

Spatial 3D AI is live on 🥽✨ You can now bring 3D AI Agents and 3D Assets straight into your real-world physical space in augmented reality. Powered by NVIDIA AI for lightning-fast 3D generation. Watch it in action below 👇
0:54

Spatial 3D AI is live on 🥽✨ You can now bring 3D AI Agents and 3D Assets straight into your real-world physical space in augmented reality. Powered by NVIDIA AI for lightning-fast 3D generation. Watch it in action below 👇

three.ws

12,106 Aufrufe • vor 2 Monaten

Let's remove VAEs and ViTs from video models! 🚀 Introducing 𝗣𝗶𝘅𝗲𝗹𝗨𝗠𝗠: an encoder-free unified multimodal model for image and video understanding and generation, directly in pixel space. Code and model available today! 🌐 📄
0:28

Let's remove VAEs and ViTs from video models! 🚀 Introducing 𝗣𝗶𝘅𝗲𝗹𝗨𝗠𝗠: an encoder-free unified multimodal model for image and video understanding and generation, directly in pixel space. Code and model available today! 🌐 📄

Cong Wei

88,361 Aufrufe • vor 1 Monat

🚀 Our NeurIPS '24 work, Large Spatial Model (LSM), is here! LSM performs semantic 3D reconstruction in just 0.1s, processing unposed data via feed-forward 3D reconstruction. 👉It leverages large-scale 3D datasets with minimal annotations, defining a 3D latent space. We are continuously exploring how this explicit 3D representation can further enhance reasoning and robotic learning. 🔗 Try our online Gradio demo with your own data at #NeurIPS2024 #3DReconstruction
0:23

🚀 Our NeurIPS '24 work, Large Spatial Model (LSM), is here! LSM performs semantic 3D reconstruction in just 0.1s, processing unposed data via feed-forward 3D reconstruction. 👉It leverages large-scale 3D datasets with minimal annotations, defining a 3D latent space. We are continuously exploring how this explicit 3D representation can further enhance reasoning and robotic learning. 🔗 Try our online Gradio demo with your own data at #NeurIPS2024 #3DReconstruction

Zhiwen(Aaron) Fan

44,051 Aufrufe • vor 2 Jahren