Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

(1/2) MonoNPHM will be presented as a #CVPR2024 Highlight! Our Neural Parametric Head Model parametrizes both geometry and appearance. With the learned model, we can then 3D reconstruct and track human heads from images or videos.

Matthias Niessner

47,444 subscribers

17,209 Aufrufe • vor 2 Jahren •via X (Twitter)

Kunst Wissenschaft & Technologie Bildung #CVPR2024

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

(1/2) We released our Neural Parametric Head Models (NPHM) dataset from our #CVPR2023 paper! It includes over 5600 high-fidelity 3D scans of human heads from 272 subjects - all publicly available! Check it out!

(1/2) We released our Neural Parametric Head Models (NPHM) dataset from our #CVPR2023 paper! It includes over 5600 high-fidelity 3D scans of human heads from 272 subjects - all publicly available! Check it out!

Matthias Niessner

36,014 Aufrufe • vor 3 Jahren

Industrial CT scans capture both geometry and relative density. We start by taking hundreds of X-ray images from different angles, then reconstruct them into a 3D model that can be sectioned and analyzed. A dark area in a 2D X-ray image could be either thicker material or denser material; by rotating the object we’re scanning, we can separate geometry from density. In this Lumafield CT scan, density is visualized as a blue-red color map.

Industrial CT scans capture both geometry and relative density. We start by taking hundreds of X-ray images from different angles, then reconstruct them into a 3D model that can be sectioned and analyzed. A dark area in a 2D X-ray image could be either thicker material or denser material; by rotating the object we’re scanning, we can separate geometry from density. In this Lumafield CT scan, density is visualized as a blue-red color map.

Jon Bruner

79,466 Aufrufe • vor 1 Jahr

(1/2) Check out 𝐆𝐚𝐮𝐬𝐬𝐢𝐚𝐧𝐀𝐯𝐚𝐭𝐚𝐫𝐬: Photorealistic Head Avatars with Rigged 3D Gaussians! We create photorealistic head avatars by animating 3D Gaussians on a parametric face model - edited and rendered in *real-time*!

(1/2) Check out 𝐆𝐚𝐮𝐬𝐬𝐢𝐚𝐧𝐀𝐯𝐚𝐭𝐚𝐫𝐬: Photorealistic Head Avatars with Rigged 3D Gaussians! We create photorealistic head avatars by animating 3D Gaussians on a parametric face model - edited and rendered in real-time!

Matthias Niessner

126,971 Aufrufe • vor 2 Jahren

This also shows up in the representations learned by the model. We plot the model’s representations of human and robot images. As pre-training is scaled up, the representation of humans and robots become more aligned: to a scaled-up model, human videos "look" like robot demos.

This also shows up in the representations learned by the model. We plot the model’s representations of human and robot images. As pre-training is scaled up, the representation of humans and robots become more aligned: to a scaled-up model, human videos "look" like robot demos.

Physical Intelligence

120,595 Aufrufe • vor 6 Monaten

Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models Contributions: • We introduce Diffuman4D, a novel diffusion model that generates spatio-temporally consistent and high-resolution (1024p) human videos from sparse-view video inputs. • We propose a sliding iterative denoising mechanism that enhances both the spatial and temporal consistency of generated long-term videos while maintaining efficient inference. • We design a human pose conditioning scheme to enhance the appearance quality and motion accuracy of generated human videos. • We plan to release our processed version of the DNA-Rendering dataset, which we believe will benefit future research in this area.

Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models Contributions: • We introduce Diffuman4D, a novel diffusion model that generates spatio-temporally consistent and high-resolution (1024p) human videos from sparse-view video inputs. • We propose a sliding iterative denoising mechanism that enhances both the spatial and temporal consistency of generated long-term videos while maintaining efficient inference. • We design a human pose conditioning scheme to enhance the appearance quality and motion accuracy of generated human videos. • We plan to release our processed version of the DNA-Rendering dataset, which we believe will benefit future research in this area.

MrNeRF

24,729 Aufrufe • vor 11 Monaten

CVPR Highlight #1 VGGT: Visual Geometry Grounded Transformer (best paper award) 🚀 Super-fast 3D scene reconstruction 🤗 Model and demo on Hugging Face The result is a GLB point cloud 👇

CVPR Highlight #1 VGGT: Visual Geometry Grounded Transformer (best paper award) 🚀 Super-fast 3D scene reconstruction 🤗 Model and demo on Hugging Face The result is a GLB point cloud 👇

dylan

19,325 Aufrufe • vor 1 Jahr

Pixel3DMM is a new method that can reconstruct 3D human faces from a single RGB image or multiple frames

Pixel3DMM is a new method that can reconstruct 3D human faces from a single RGB image or multiple frames

Dreaming Tulpa 🥓👑

32,565 Aufrufe • vor 1 Jahr

✨ Made a new mini feature on Photo AI: [ Grab from 3d model ] So the problem is we're at that stage in time (typical for AI) where image-to-3d models are not good enough but are fun to play with, but we know they'll be good enough in 1-2 years With [ Make 3d model ] you already can turn any Photo AI pic into a 3d model but it still looks hyper clunky and deformed, but it works! One cool idea I had to make that more useful and made now: Let people make a 3d model then change the view of the it with the 3d viewer, then press [ o ] and it grabs a frame of the 3d That image you can then [ Remix ] (img2img), and it becomes a real photo again and that in turn you can then turn into a video again with [ Make video ] So that essentially gives you a fully freeform camera position control to take photos with One thing I need to fix is the background/skybox, I kinda need to take the original photo and remove the person and just get the background for the 3d model viewer, in this case it should be white, but it's a start!

✨ Made a new mini feature on Photo AI: [ Grab from 3d model ] So the problem is we're at that stage in time (typical for AI) where image-to-3d models are not good enough but are fun to play with, but we know they'll be good enough in 1-2 years With [ Make 3d model ] you already can turn any Photo AI pic into a 3d model but it still looks hyper clunky and deformed, but it works! One cool idea I had to make that more useful and made now: Let people make a 3d model then change the view of the it with the 3d viewer, then press [ o ] and it grabs a frame of the 3d That image you can then [ Remix ] (img2img), and it becomes a real photo again and that in turn you can then turn into a video again with [ Make video ] So that essentially gives you a fully freeform camera position control to take photos with One thing I need to fix is the background/skybox, I kinda need to take the original photo and remove the person and just get the background for the 3d model viewer, in this case it should be white, but it's a start!

@levelsio

119,210 Aufrufe • vor 1 Jahr

🧍 Very cool idea So I added it to Photo AI as a T-Pose photo pack you can use to create a moving (or dancing) 3d model of yourself It auto-generates the correct T-Pose of your model immediately and then converts it into a 3D model you can download (as .fbx) and instantly import into @mixamo to rig it After rigging you can add any movement from Mixamo to move it however you want

🧍 Very cool idea So I added it to Photo AI as a T-Pose photo pack you can use to create a moving (or dancing) 3d model of yourself It auto-generates the correct T-Pose of your model immediately and then converts it into a 3D model you can download (as .fbx) and instantly import into @mixamo to rig it After rigging you can add any movement from Mixamo to move it however you want

@levelsio

139,521 Aufrufe • vor 5 Monaten

✨ 3d models are now LIVE on Photo AI 😊 You can now turn any AI photo you make into a 3d model by pressing [ 📦 Make 3d model ] And then you can view it inside Photo AI or download it as a .GLB 3d model file It's still very early in AI generated 3d model world but it's nice to have this feature working already As always, the models will keep improving, so this feature will keep getting better (like it did with video, it sucked before, now it's getting passable) Next would be nice to switch to .USDZ so you can load it straight into your iPhone with ARKit and put it in your room Available now for everyone on the Premium and Ultra plan

✨ 3d models are now LIVE on Photo AI 😊 You can now turn any AI photo you make into a 3d model by pressing [ 📦 Make 3d model ] And then you can view it inside Photo AI or download it as a .GLB 3d model file It's still very early in AI generated 3d model world but it's nice to have this feature working already As always, the models will keep improving, so this feature will keep getting better (like it did with video, it sucked before, now it's getting passable) Next would be nice to switch to .USDZ so you can load it straight into your iPhone with ARKit and put it in your room Available now for everyone on the Premium and Ultra plan

@levelsio

112,930 Aufrufe • vor 1 Jahr

(1/2) Check out 𝐌𝐞𝐬𝐡𝐆𝐏𝐓! MeshGPT generates triangle meshes by autoregressively sampling from a transformer model that produces tokens from a learned geometric vocabulary. As a result, we obtain clean and compact meshes :)

(1/2) Check out 𝐌𝐞𝐬𝐡𝐆𝐏𝐓! MeshGPT generates triangle meshes by autoregressively sampling from a transformer model that produces tokens from a learned geometric vocabulary. As a result, we obtain clean and compact meshes :)

Matthias Niessner

396,160 Aufrufe • vor 2 Jahren

Here is a preview of the new bang options for our 3D customizable vtuber model! ✨ Not everyone can afford a high end 1:1 3D vtuber model. Which is why my sister and I are working so hard to provide a customizable 3D vtuber avatar with the same level of quality and tech!🩷

Pastell & Palette🤍 3D Customizable Model!

21,309 Aufrufe • vor 1 Monat

(1/2) Check out "𝐏𝐨𝐥𝐲𝐃𝐢𝐟𝐟: Generating 3D Polygonal Meshes with Diffusion Models"! Our model operates directly on the polygons of 3D meshes and generates novel shapes as output through an iterative diffusion process.

(1/2) Check out "𝐏𝐨𝐥𝐲𝐃𝐢𝐟𝐟: Generating 3D Polygonal Meshes with Diffusion Models"! Our model operates directly on the polygons of 3D meshes and generates novel shapes as output through an iterative diffusion process.

Matthias Niessner

57,941 Aufrufe • vor 2 Jahren

(1/2) 📢𝐍𝐏𝐆𝐀: 𝐍𝐞𝐮𝐫𝐚𝐥 𝐏𝐚𝐫𝐚𝐦𝐞𝐭𝐫𝐢𝐜 𝐆𝐚𝐮𝐬𝐬𝐢𝐚𝐧 𝐀𝐯𝐚𝐭𝐚𝐫𝐬 📢 #SIGGRAPHAsia We leverage a neural parametric representation to facilitate precise control over 3D Gaussians to obtain high-fidelity avatars.

(1/2) 📢𝐍𝐏𝐆𝐀: 𝐍𝐞𝐮𝐫𝐚𝐥 𝐏𝐚𝐫𝐚𝐦𝐞𝐭𝐫𝐢𝐜 𝐆𝐚𝐮𝐬𝐬𝐢𝐚𝐧 𝐀𝐯𝐚𝐭𝐚𝐫𝐬 📢 #SIGGRAPHAsia We leverage a neural parametric representation to facilitate precise control over 3D Gaussians to obtain high-fidelity avatars.

Matthias Niessner

30,741 Aufrufe • vor 1 Jahr

Okay this new model is insane. Generate an image, then give it to the model to turn it into a 3D model with matching texture in seconds. Creativity on Spielwerk will be endless with this

Okay this new model is insane. Generate an image, then give it to the model to turn it into a 3D model with matching texture in seconds. Creativity on Spielwerk will be endless with this

Eike Drescher

37,987 Aufrufe • vor 7 Monaten

8. CUSTOMIZABLE HEAD MODEL dont think many people know this unless they check csp updates (its more of a recent feature) but the default head model is completely customizable and it’s awesome!! can choose from presets or adjust features manually materials > 3D > basic

8. CUSTOMIZABLE HEAD MODEL dont think many people know this unless they check csp updates (its more of a recent feature) but the default head model is completely customizable and it’s awesome!! can choose from presets or adjust features manually materials > 3D > basic

KITTY★DISK

35,529 Aufrufe • vor 1 Jahr

Humans are social creatures and physical interaction with other humans plays an important role in our everyday life. In this thread, we explain how such interactions can be reconstructed in 3D from a single image utilising a denoising diffusion probabilistic model. (1/n)

Humans are social creatures and physical interaction with other humans plays an important role in our everyday life. In this thread, we explain how such interactions can be reconstructed in 3D from a single image utilising a denoising diffusion probabilistic model. (1/n)

Lea Wilken/Müller

76,538 Aufrufe • vor 2 Jahren

I can no longer walk around a city without seeing a machine-readable 3D model in my head. This is a geometric and semantic 3D model of San Francisco. These maps connect the world of bits and atoms, enabling visual positioning, 3D navigation and geospatial intelligence.

I can no longer walk around a city without seeing a machine-readable 3D model in my head. This is a geometric and semantic 3D model of San Francisco. These maps connect the world of bits and atoms, enabling visual positioning, 3D navigation and geospatial intelligence.

Bilawal Sidhu

260,188 Aufrufe • vor 1 Jahr

Giveaway! 🐯🍖 I'm giving out a custom vtuber model to celebrate my 1-year vtubing anniversary! The model will have both art and rigging by me! Rules: Follow me and like + retweet this post to enter! Winner will be drawn a few months from now OR when i reach 50K follows!

Giveaway! 🐯🍖 I'm giving out a custom vtuber model to celebrate my 1-year vtubing anniversary! The model will have both art and rigging by me! Rules: Follow me and like + retweet this post to enter! Winner will be drawn a few months from now OR when i reach 50K follows!

SmilodonnaVT 🍗

28,436 Aufrufe • vor 1 Jahr

SAM 3D Body is a CVPR 2026 award candidate paper from AI at Meta model recovers a full 3D human body mesh from a single RGB image you can run it automatically, or guide the reconstruction with masks and 2D keypoints thx to Niels Rogge for awesome demo idea

SAM 3D Body is a CVPR 2026 award candidate paper from AI at Meta model recovers a full 3D human body mesh from a single RGB image you can run it automatically, or guide the reconstruction with masks and 2D keypoints thx to Niels Rogge for awesome demo idea

SkalskiP

71,881 Aufrufe • vor 1 Monat