Загрузка видео...

Не удалось загрузить видео

На главную

Code and data are now online for CameraHMR, our state-of-the-art parametric 3D human pose and shape (HPS) estimation method that will appear at hashtag#3DV2025. There are 4 key contributions that make it so accurate and robust: 1. To get accurate 3D shape and pose as well as good alignment...

21,696 просмотров • 1 год назад •via X (Twitter)

Комментарии: 9

Фото профиля Jerin Philip
Jerin Philip1 год назад

Nice work, currently looking into using it. When is the release of CamSMPLify + HumanFoV + DenseKP expected? What's the hardware requirements to train this end-to-end? 4D-Humans mention 8 A100 GPUs for 7 days, does this require similar?

Фото профиля Michael Black
Michael Black1 год назад

All code will be out before 3DV takes place.

Фото профиля Digital Currency
Digital Currency2 лет назад

From 3D modeling to VR/AR development, our MSc in Metaverse program equips you with the technical skills to excel in the rapidly evolving digital world. Don't miss out—enroll today! #UNIC #MScMetaverse

Фото профиля Duke 'Burrito Haver' Zero
Duke 'Burrito Haver' Zero1 год назад

could you embed a sentiment layer keyed to facial expressions / body language?

Фото профиля Michael Black
Michael Black1 год назад

This method is just about pixels to parameters but, yes, relating these parameters to expressions and body language is something we are interested in. E.g., have a look at our work on generating moving people from audio:

Фото профиля lotsoflittleprojects
lotsoflittleprojects1 год назад

Will this model get folded into Meshcapade?

Фото профиля Michael Black
Michael Black1 год назад

The next Meshcapade release will have many goodies that go beyond CameraHMR. Coming soon!

Фото профиля Matt Jaynes
Matt Jaynes1 год назад

@camenduru Damn! Impressive!

Фото профиля JohnYue122333
JohnYue1223331 год назад

MPI, awesome!

Похожие видео

One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization paper page: Single image 3D reconstruction is an important but challenging task that requires extensive knowledge of our natural world. Many existing methods solve this problem by optimizing a neural radiance field under the guidance of 2D diffusion models but suffer from lengthy optimization time, 3D inconsistency results, and poor geometry. In this work, we propose a novel method that takes a single image of any object as input and generates a full 360-degree 3D textured mesh in a single feed-forward pass. Given a single image, we first use a view-conditioned 2D diffusion model, Zero123, to generate multi-view images for the input view, and then aim to lift them up to 3D space. Since traditional reconstruction methods struggle with inconsistent multi-view predictions, we build our 3D reconstruction module upon an SDF-based generalizable neural surface reconstruction method and propose several critical training strategies to enable the reconstruction of 360-degree meshes. Without costly optimizations, our method reconstructs 3D shapes in significantly less time than existing methods. Moreover, our method favors better geometry, generates more 3D consistent results, and adheres more closely to the input image. We evaluate our approach on both synthetic data and in-the-wild images and demonstrate its superiority in terms of both mesh quality and runtime. In addition, our approach can seamlessly support the text-to-3D task by integrating with off-the-shelf text-to-image diffusion models.

AK

179,061 просмотров • 3 лет назад

Physics-based Motion Retargeting from Sparse Inputs paper page: Avatars are important to create interactive and immersive experiences in virtual worlds. One challenge in animating these characters to mimic a user's motion is that commercial AR/VR products consist only of a headset and controllers, providing very limited sensor data of the user's pose. Another challenge is that an avatar might have a different skeleton structure than a human and the mapping between them is unclear. In this work we address both of these challenges. We introduce a method to retarget motions in real-time from sparse human sensor data to characters of various morphologies. Our method uses reinforcement learning to train a policy to control characters in a physics simulator. We only require human motion capture data for training, without relying on artist-generated animations for each avatar. This allows us to use large motion capture datasets to train general policies that can track unseen users from real and sparse data in real-time. We demonstrate the feasibility of our approach on three characters with different skeleton structure: a dinosaur, a mouse-like creature and a human. We show that the avatar poses often match the user surprisingly well, despite having no sensor information of the lower body available. We discuss and ablate the important components in our framework, specifically the kinematic retargeting step, the imitation, contact and action reward as well as our asymmetric actor-critic observations. We further explore the robustness of our method in a variety of settings including unbalancing, dancing and sports motions.

AK

106,527 просмотров • 3 лет назад

Muslims are now specifically targeting California to run for office and take over the government “We want to make sure we activate California Muslims in so we can shape the rest of the country, because we can shape California. We need you to run for office” “Muslims. We will build a network of activists at every masjid, every mosque, to ensure that every eligible Muslim, every eligible person is registered to vote, that every elected official at every level engages with the Muslim community, that more American Muslims run for office — And we want to make sure that we activate California Muslims in so we can shape the rest of the country, because we can shape California. We need you to run for office, and I want to salute the dozens and dozens of American Muslims who were, who had the courage and the commitment and the resolve to run for office. Dozens of them won, others did not. They will win next time. What Allah promises is guaranteed 100%.” “How many phone calls have you made? How many protests have you tried to attend? Have you met or called your elected officials, your member of Congress? Have you gone to call the White House? Have you joined the efforts, the political efforts happening in every city to organize the Muslim votes as we deal with elections? Ask yourself, where am I in the equation? Because until there is a critical mass, Allah is withholding what he has promised us, because we haven't fulfilled our part of the deal” “Mahmoud Saifi in Redlands. Dr. Asif Mahmud, running for Congress. Fatima Eqbal Zubair in LA for Assembly, and many others. But as important as running is, it is equally important to build the power of the grassroots at the grassroots level. This year, we've established the Muslim Community Action Network, we know it as MCAN, which aims to train activists as community organizers who can inform and mobilize their local community, set up candidate forums, engage with local politicians, and advocate for local, state, and national issues of importance to our community.“

Wall Street Apes

339,304 просмотров • 11 месяцев назад