Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

(1/2) We released our Neural Parametric Head Models (NPHM) dataset from our #CVPR2023 paper! It includes over 5600 high-fidelity 3D scans of human heads from 272 subjects - all publicly available! Check it out!

MattNiessner's profile picture

Matthias Niessner

48,456 subscribers

36,064 Aufrufe • vor 3 Jahren •via X (Twitter)

Wissenschaft & TechnologieBildung#CVPR2023
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

(1/2) MonoNPHM will be presented as a #CVPR2024 Highlight! Our Neural Parametric Head Model parametrizes both geometry and appearance. With the learned model, we can then 3D reconstruct and track human heads from images or videos.
0:18

(1/2) MonoNPHM will be presented as a #CVPR2024 Highlight! Our Neural Parametric Head Model parametrizes both geometry and appearance. With the learned model, we can then 3D reconstruct and track human heads from images or videos.

Matthias Niessner

17,209 Aufrufe • vor 2 Jahren

Check out TriPlaneNet! From a single image, we predict EG3D latents & offsets, thus obtaining high-fidelity 3D models. Works in real time! Great work by our stellar MA student Ananta R. Bhattarai advised by Artem Sevastopolsky #WACV2024
0:10

Check out TriPlaneNet! From a single image, we predict EG3D latents & offsets, thus obtaining high-fidelity 3D models. Works in real time! Great work by our stellar MA student Ananta R. Bhattarai advised by Artem Sevastopolsky #WACV2024

Matthias Niessner

28,867 Aufrufe • vor 2 Jahren

📢📢𝐍𝐞𝐑𝐒𝐞𝐦𝐛𝐥𝐞 𝐯𝟐 𝐃𝐚𝐭𝐚𝐬𝐞𝐭 𝐑𝐞𝐥𝐞𝐚𝐬𝐞📢📢 Head captures of 7.1MP from 16 cameras at 73fps: * More recordings (425 people) * Better color calibration * Convenient download scripts The new version of our dataset adds 156 participants for a total of 425 different people. In its entirety, the dataset provides now 65 million images from over 15 hours of diverse human facial expression performances. We improved the color consistency of the recorded images with a better color calibration procedure. As a result, 3D reconstructions with images from the NeRSemble dataset should become better and look more realistic. Finally, we made it much easier to download the recordings with our new download repository. It now just takes a single command to download all frontal hair shake videos of all participants or to download all recordings of a single participant. Check it out: Awesome work by Tobias Kirschstein Simon Giebenhain !!!
0:17

📢📢𝐍𝐞𝐑𝐒𝐞𝐦𝐛𝐥𝐞 𝐯𝟐 𝐃𝐚𝐭𝐚𝐬𝐞𝐭 𝐑𝐞𝐥𝐞𝐚𝐬𝐞📢📢 Head captures of 7.1MP from 16 cameras at 73fps: * More recordings (425 people) * Better color calibration * Convenient download scripts The new version of our dataset adds 156 participants for a total of 425 different people. In its entirety, the dataset provides now 65 million images from over 15 hours of diverse human facial expression performances. We improved the color consistency of the recorded images with a better color calibration procedure. As a result, 3D reconstructions with images from the NeRSemble dataset should become better and look more realistic. Finally, we made it much easier to download the recordings with our new download repository. It now just takes a single command to download all frontal hair shake videos of all participants or to download all recordings of a single participant. Check it out: Awesome work by Tobias Kirschstein Simon Giebenhain !!!

Matthias Niessner

12,089 Aufrufe • vor 1 Jahr

📢Pix2NPHM: Learning to Regress NPHM Reconstructions From a Single Image📢 We directly regress neural parametric head models (NPHMs) from a single image — fast, stable, and significantly more expressive than classical 3DMMs such as FLAME. Face tracking & 3D reconstruction are often limited by the representational capacity of PCA-based face models. By lifting NPHMs to a first-class reconstruction primitive, we enable more accurate geometry, richer expressions, and finer animation control. Pix2NPHM obtains fast and reliable NPHM reconstructions on real-world data. Inference-time optimization against surface normals and canonical point maps can further increase fidelity. Key to successful and generalized training of our ViT-based network are: (1) large-scale registration of existing 3D head datasets, and (2) self-supervised training on vast in-the-wild 2D video datasets using pseudo ground-truth surface normals. Finally, we show that geometry-aware pretraining on pixel-aligned reconstruction tasks significantly outperforms generic visual pretraining (e.g., DINO-style features) in terms of generalization. 🌍 🎥 Great work by Simon Giebenhain, Tobias Kirschstein, Liam Schoneveld, Davide Davoli, Zhe Chen
0:17

📢Pix2NPHM: Learning to Regress NPHM Reconstructions From a Single Image📢 We directly regress neural parametric head models (NPHMs) from a single image — fast, stable, and significantly more expressive than classical 3DMMs such as FLAME. Face tracking & 3D reconstruction are often limited by the representational capacity of PCA-based face models. By lifting NPHMs to a first-class reconstruction primitive, we enable more accurate geometry, richer expressions, and finer animation control. Pix2NPHM obtains fast and reliable NPHM reconstructions on real-world data. Inference-time optimization against surface normals and canonical point maps can further increase fidelity. Key to successful and generalized training of our ViT-based network are: (1) large-scale registration of existing 3D head datasets, and (2) self-supervised training on vast in-the-wild 2D video datasets using pseudo ground-truth surface normals. Finally, we show that geometry-aware pretraining on pixel-aligned reconstruction tasks significantly outperforms generic visual pretraining (e.g., DINO-style features) in terms of generalization. 🌍 🎥 Great work by Simon Giebenhain, Tobias Kirschstein, Liam Schoneveld, Davide Davoli, Zhe Chen

Matthias Niessner

37,850 Aufrufe • vor 7 Monaten

Diffusion models are great, but we can squeeze out so much more from them. The only problem is that it usually requires extra training or manual representation editing. In our new paper, we show that with the current capabilities of LLMs, it is much simpler than we thought!
0:17

Diffusion models are great, but we can squeeze out so much more from them. The only problem is that it usually requires extra training or manual representation editing. In our new paper, we show that with the current capabilities of LLMs, it is much simpler than we thought!

Yossi Gandelsman

34,863 Aufrufe • vor 4 Monaten

Over the Reality just hit another major milestone in the AI era. We have now surpassed 200,000 mappings in our dataset. 🎉 These are not just images. They are high-quality 3D maps generated from the mapping activity of our global community, which has produced more than 94M images of real-world locations so far. The dataset also includes 900TB+ of spatial data that can power Visual AI models, Robotics VPS for real-world navigation and positioning, XR VPS for precise spatial anchoring and AR experiences, Spatial Computing applications, Digital Twins, and the next generation of real-world AI infrastructure. In just the past 2 weeks, our dataset grew by +17,955 mapped locations. That is nearly +10% growth in just 14 days. More maps. More data. More demand for $OVR.
0:10

Over the Reality just hit another major milestone in the AI era. We have now surpassed 200,000 mappings in our dataset. 🎉 These are not just images. They are high-quality 3D maps generated from the mapping activity of our global community, which has produced more than 94M images of real-world locations so far. The dataset also includes 900TB+ of spatial data that can power Visual AI models, Robotics VPS for real-world navigation and positioning, XR VPS for precise spatial anchoring and AR experiences, Spatial Computing applications, Digital Twins, and the next generation of real-world AI infrastructure. In just the past 2 weeks, our dataset grew by +17,955 mapped locations. That is nearly +10% growth in just 14 days. More maps. More data. More demand for $OVR.

Over the Reality 🌐

926,557 Aufrufe • vor 4 Monaten

A dream of our lab has been to image the full central dogma from a single endogenous gene, all live and with single molecule resolution. After many years we are happy to unveil a beautiful cell line that makes it possible. Check out our preprint ( (1/n)
0:11

A dream of our lab has been to image the full central dogma from a single endogenous gene, all live and with single molecule resolution. After many years we are happy to unveil a beautiful cell line that makes it possible. Check out our preprint ( (1/n)

Timothy

206,314 Aufrufe • vor 2 Jahren

We are The Curated: a platform to discover and curate digital Art Gems from all over Web3. Check out a preview of our features here. Click the link in our bio to sign up and get involved!
0:10

We are The Curated: a platform to discover and curate digital Art Gems from all over Web3. Check out a preview of our features here. Click the link in our bio to sign up and get involved!

The Curated

5,886,749 Aufrufe • vor 3 Jahren

we gave it our all out there with mega performances from the whole team. a final race of the season to be proud of 💪 #AbuDhabiGP
0:11

we gave it our all out there with mega performances from the whole team. a final race of the season to be proud of 💪 #AbuDhabiGP

Visa Cash App Racing Bulls F1 Team

348,315 Aufrufe • vor 2 Jahren

We ran a blind head-to-head on the leading image models for one specific job: >product detail shots. Seedream 5.0 Lite (BytePlus, ByteDance) beat the flagship models from Google, OpenAI, and Black Forest Labs. It won 2 out of 3 times.
0:16

We ran a blind head-to-head on the leading image models for one specific job: >product detail shots. Seedream 5.0 Lite (BytePlus, ByteDance) beat the flagship models from Google, OpenAI, and Black Forest Labs. It won 2 out of 3 times.

ben

26,137 Aufrufe • vor 2 Monaten

We refreshed our logo to better reflect what we are building: multimodal world models that simulate environments, predict outcomes, and enable planning over long horizons. We kept the moon from our original mark and evolved it into a symbol of depth, generation, and evolving worlds.
0:10

We refreshed our logo to better reflect what we are building: multimodal world models that simulate environments, predict outcomes, and enable planning over long horizons. We kept the moon from our original mark and evolved it into a symbol of depth, generation, and evolving worlds.

Moonlake

12,664 Aufrufe • vor 4 Monaten

Today we’re releasing SAIR, the Structurally Augmented IC50 Repository. SAIR is the Largest Open-Sourced Binding Affinity Dataset with Cofolded 3D Structures. It includes more than 5 million protein-ligand structures, generated using our Large Quantitative Models and labeled with binding affinity data. By providing this unprecedented scale of structure-activity data, we aim to enable researchers to train and evaluate new AI models for drug discovery, bridging the historical gap between molecular structures and drug potency prediction. The SAIR dataset was created using the NVIDIA DGX Cloud and is now publicly available on the Google Cloud Platform. Access and build with SAIR today! 📰Read the Press Release: 📥Learn More and Download the Dataset at #DrugDiscovery #LQMs #SAIR #AIforScience #SandboxAQ
0:16

Today we’re releasing SAIR, the Structurally Augmented IC50 Repository. SAIR is the Largest Open-Sourced Binding Affinity Dataset with Cofolded 3D Structures. It includes more than 5 million protein-ligand structures, generated using our Large Quantitative Models and labeled with binding affinity data. By providing this unprecedented scale of structure-activity data, we aim to enable researchers to train and evaluate new AI models for drug discovery, bridging the historical gap between molecular structures and drug potency prediction. The SAIR dataset was created using the NVIDIA DGX Cloud and is now publicly available on the Google Cloud Platform. Access and build with SAIR today! 📰Read the Press Release: 📥Learn More and Download the Dataset at #DrugDiscovery #LQMs #SAIR #AIforScience #SandboxAQ

SandboxAQ

129,416 Aufrufe • vor 1 Jahr

Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models Contributions: • We introduce Diffuman4D, a novel diffusion model that generates spatio-temporally consistent and high-resolution (1024p) human videos from sparse-view video inputs. • We propose a sliding iterative denoising mechanism that enhances both the spatial and temporal consistency of generated long-term videos while maintaining efficient inference. • We design a human pose conditioning scheme to enhance the appearance quality and motion accuracy of generated human videos. • We plan to release our processed version of the DNA-Rendering dataset, which we believe will benefit future research in this area.
0:10

Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models Contributions: • We introduce Diffuman4D, a novel diffusion model that generates spatio-temporally consistent and high-resolution (1024p) human videos from sparse-view video inputs. • We propose a sliding iterative denoising mechanism that enhances both the spatial and temporal consistency of generated long-term videos while maintaining efficient inference. • We design a human pose conditioning scheme to enhance the appearance quality and motion accuracy of generated human videos. • We plan to release our processed version of the DNA-Rendering dataset, which we believe will benefit future research in this area.

MrNeRF

24,729 Aufrufe • vor 1 Jahr

Ready for 2026 ? Qubic #Science #Neuraxon Research version 2.1 is out, since life moves so does the data we capture for understanding True #AI Bioinspired evolution. This one includes a deeper exploration of the #TimeSeries of #AritificialLife moments of the Neuraxoners. (Log Level 2, btw it increases 10X the log files) New Hugging Face Dataset 9,170,708 TimeSeries Rows from 40K Nxers about 2,000 Games Code GitHub : And Paper ResearchGate
0:10

Ready for 2026 ? Qubic #Science #Neuraxon Research version 2.1 is out, since life moves so does the data we capture for understanding True #AI Bioinspired evolution. This one includes a deeper exploration of the #TimeSeries of #AritificialLife moments of the Neuraxoners. (Log Level 2, btw it increases 10X the log files) New Hugging Face Dataset 9,170,708 TimeSeries Rows from 40K Nxers about 2,000 Games Code GitHub : And Paper ResearchGate

David Vivancos - e/acc

25,522 Aufrufe • vor 6 Monaten

Celebrating our 2 year anniversary in Türkiye 🇹🇷 Day 1- we indulged like the sultans at the Hammam Spa and it was truly changing! From there, we met up with a local seamstress who took us into the back park of the Grand Bazaar (past all the tourist traps) and let us choose from hundreds of vintage textiles to design our Turkish style coats. Then, we ended our night with a chef tasting menu over looking the The Bosporus straight
0:16

Celebrating our 2 year anniversary in Türkiye 🇹🇷 Day 1- we indulged like the sultans at the Hammam Spa and it was truly changing! From there, we met up with a local seamstress who took us into the back park of the Grand Bazaar (past all the tourist traps) and let us choose from hundreds of vintage textiles to design our Turkish style coats. Then, we ended our night with a chef tasting menu over looking the The Bosporus straight

Lily Anne

12,027 Aufrufe • vor 3 Monaten

To replace animal testing with AI, we need MASSIVE human datasets. Today, we're thrilled to share Axiom's new data exploration tool, providing the ability to visually explore the world's largest primary human liver toxicity dataset. Built with Axiom's proprietary wetlab protocols, our dataset includes detailed liver toxicity profiles for over 100,000 distinct molecules. The key to this dataset is our ability to do high-throughput, multiplexed high-content screening with primary human liver cells. Traditionally, toxicity assays either sacrifice throughput or sacrifice biological relevance (using easy-to-grow immortalized cell lines instead of real human cells). We managed to combine throughput, physiological relevance, and multiplexing in one platform. The assays run in a high throughput format using automation, meaning thousands of compound-dose conditions can be tested in one experiment. We achieved this using pooled primary human hepatocytes, which are often fragile and expensive. By systemizing our automation and quality control processes, we were able to run over 120+ batches on the same donor pool with incredible reproducibility and consistency. We did this while integrating many readouts per well, whereas many existing toxicity assays only do a single readout. Our multiplexed approach provides far more data per experiment enabling us to measure 10-20 different toxicity phenotypes such as apoptosis, necrosis, mitochondrial fission, endoplasmic reticulum stress, stress granule formation, microtubules, and more all from a single well on a 384-well plate! The combination of scale, high content information, and data quality is exactly what is needed to train highly accurate AI models in biology. If you're interested, please explore the dataset in the comments below and let me know if you want to chat about the details!
0:19

To replace animal testing with AI, we need MASSIVE human datasets. Today, we're thrilled to share Axiom's new data exploration tool, providing the ability to visually explore the world's largest primary human liver toxicity dataset. Built with Axiom's proprietary wetlab protocols, our dataset includes detailed liver toxicity profiles for over 100,000 distinct molecules. The key to this dataset is our ability to do high-throughput, multiplexed high-content screening with primary human liver cells. Traditionally, toxicity assays either sacrifice throughput or sacrifice biological relevance (using easy-to-grow immortalized cell lines instead of real human cells). We managed to combine throughput, physiological relevance, and multiplexing in one platform. The assays run in a high throughput format using automation, meaning thousands of compound-dose conditions can be tested in one experiment. We achieved this using pooled primary human hepatocytes, which are often fragile and expensive. By systemizing our automation and quality control processes, we were able to run over 120+ batches on the same donor pool with incredible reproducibility and consistency. We did this while integrating many readouts per well, whereas many existing toxicity assays only do a single readout. Our multiplexed approach provides far more data per experiment enabling us to measure 10-20 different toxicity phenotypes such as apoptosis, necrosis, mitochondrial fission, endoplasmic reticulum stress, stress granule formation, microtubules, and more all from a single well on a 384-well plate! The combination of scale, high content information, and data quality is exactly what is needed to train highly accurate AI models in biology. If you're interested, please explore the dataset in the comments below and let me know if you want to chat about the details!

Brandon White

25,117 Aufrufe • vor 1 Jahr

🚀🌍🚀 Echo-2 is live! It generates high-quality physically grounded 3D scenes instead of just pixels. Check out the open demo to create and explore worlds in real-time! I gave it a picture from my Himalayas trek—it handles the massive scale range really well! 🏔️🌍
0:12

🚀🌍🚀 Echo-2 is live! It generates high-quality physically grounded 3D scenes instead of just pixels. Check out the open demo to create and explore worlds in real-time! I gave it a picture from my Himalayas trek—it handles the massive scale range really well! 🏔️🌍

David Novotny

11,400 Aufrufe • vor 2 Monaten

Detective Instinct is NOW AVAILABLE in all regions (on 15% launch discount for the next two weeks)! Thank you all for supporting us. We did our best to craft a story we can be proud of, so we hope sincerely hope you enjoy it 🫡 Check it out on Steam or Nintendo Switch!
0:10

Detective Instinct is NOW AVAILABLE in all regions (on 15% launch discount for the next two weeks)! Thank you all for supporting us. We did our best to craft a story we can be proud of, so we hope sincerely hope you enjoy it 🫡 Check it out on Steam or Nintendo Switch!

Detective Instinct - OUT NOW on Steam and Switch!

122,281 Aufrufe • vor 8 Monaten

Congratulations Warhorse Studios on the release of Kingdom Come: Deliverance II! Fun fact: In 2016 we recorded our own version of “Kingdom Come” by Manowar, and a few months later, once the brilliant Kingdom Come: Deliverance II was released into the world of gaming, we found our cover perfectly complemented the game. Because of this, we decided to release a video featuring some awesome footage from the game. We honour this special day today by watching it! Check it out 👉
0:16

Congratulations Warhorse Studios on the release of Kingdom Come: Deliverance II! Fun fact: In 2016 we recorded our own version of “Kingdom Come” by Manowar, and a few months later, once the brilliant Kingdom Come: Deliverance II was released into the world of gaming, we found our cover perfectly complemented the game. Because of this, we decided to release a video featuring some awesome footage from the game. We honour this special day today by watching it! Check it out 👉

Sabaton

20,294 Aufrufe • vor 1 Jahr