Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

Alert🚨 This could be by far the most impressive video about 4D human motion generation! 🔥🔥🔥 We present TRUMANS, a pioneering and solid effort that scales up 4D human-scene interactions with both static and dynamic objects. With our model, we could eventually generate diverse and physically plausible human motions... show more

Siyuan Huang

5,173 subscribers

13,689 görüntüleme • 2 yıl önce •via X (Twitter)

Eğitim Bilim & Teknoloji Haberler & Politika

Anya Rossi• Live Now

Private livecam show

7 Yorum

Siyuan Huang profil fotoğrafı

Siyuan Huang2 yıl önce

Hi @_akhaliq, please check out our full video here

Jingbo Wang profil fotoğrafı

Jingbo Wang2 yıl önce

Looks great!

Siyuan Huang profil fotoğrafı

Siyuan Huang2 yıl önce

thanks!

German Barquero profil fotoğrafı

German Barquero2 yıl önce

Impressive work! Congrats!

David Ferrera profil fotoğrafı

David Ferrera2 yıl önce

I'm primarily focused on 3D for VFX, but I'm curious, do these models come with a rig, for instance, to facilitate animation retargeting?

LEO LI profil fotoğrafı

LEO LI2 yıl önce

I think your work could lead to some innovative visual effects, some amazing effects, and of course great use in games like Max Payne's bullet Time

Siyuan Huang profil fotoğrafı

Siyuan Huang2 yıl önce

Thank you!

Benzer Videolar

Robot Learning needs 4D world models! Robot Learning needs 4D world models! Robot Learning needs 4D world models! We introduce TesserAct, a 4D embodied world model that can simulate how agents interact with the 3D world over time! We achieve this by simply extending a pre-trained 2D video generation model to jointly predict RGB, depth, and surface normals. It enables: 1️⃣ Much better policy learning in the wild 2️⃣ Temporal + spatial coherence in 4D dynamic prediction 3️⃣ Novel view synthesis for embodied scenes Code: Paper Link: Project page:

Robot Learning needs 4D world models! Robot Learning needs 4D world models! Robot Learning needs 4D world models! We introduce TesserAct, a 4D embodied world model that can simulate how agents interact with the 3D world over time! We achieve this by simply extending a pre-trained 2D video generation model to jointly predict RGB, depth, and surface normals. It enables: 1️⃣ Much better policy learning in the wild 2️⃣ Temporal + spatial coherence in 4D dynamic prediction 3️⃣ Novel view synthesis for embodied scenes Code: Paper Link: Project page:

Chuang Gan

43,265 görüntüleme • 1 yıl önce

Wouldn't it be great if we could train robots without any teleoperation! In our latest paper, we train robots to mimic a human video of the task by simply matching the object features using RL. We only need one video and under an hour of robot training.

Wouldn't it be great if we could train robots without any teleoperation! In our latest paper, we train robots to mimic a human video of the task by simply matching the object features using RL. We only need one video and under an hour of robot training.

Lerrel Pinto

46,221 görüntüleme • 1 yıl önce

.Brett Adcock explains why Figure pivoted away from designing their humanoid robot's hands after human hands: "This is extremely important. If we want to solve AGI and get to human intelligence in the physical world—it's all going to start with the hands." "Our first-generation hand is a tendon-driven hand." "The rationale here is that a human hand is like this: most of our motors are in our forearm and little tendons drive all the fingers." "It ended up becoming the wrong engineering choice." "We recently unveiled our high degree of freedom, next-generation hand a month ago. This hand has human-level dexterity, as many joints in the hand as a human."

.Brett Adcock explains why Figure pivoted away from designing their humanoid robot's hands after human hands: "This is extremely important. If we want to solve AGI and get to human intelligence in the physical world—it's all going to start with the hands." "Our first-generation hand is a tendon-driven hand." "The rationale here is that a human hand is like this: most of our motors are in our forearm and little tendons drive all the fingers." "It ended up becoming the wrong engineering choice." "We recently unveiled our high degree of freedom, next-generation hand a month ago. This hand has human-level dexterity, as many joints in the hand as a human."

sourcery

324,457 görüntüleme • 1 ay önce

Excited to share our latest work on 🎧spatial audio-driven human motion generation. We aim to tackle a largely underexplored yet important problem of enabling virtual humans to move naturally in response to spatial audio—capturing not just what is heard, but also where the sound is coming from. To this end, we introduce the Spatial Audio-Driven Human Motion (SAM) dataset—the first comprehensive dataset featuring paired high-quality human motion and spatial audio recordings. For benchmarking, we develop a generative framework for human MOtion generation driven by SPAtial audio, termed MOSPA, which learns to synthesize realistic and diverse human motions conditioned on spatial audio input. We hope this research could provide a foundation for future research in spatial perception, virtual characters, and embodied AI. The dataset and model will be open-sourced soon. A big thank you to our intern, Shuyang Xu, for the wonderful collaboration! Congratulations, Shuyang! Project page: Paper: Video: #Animation #CG #CV #AIGC #DL #Deeplearning #Motion #Graphics #AI #GenerativeAI

Excited to share our latest work on 🎧spatial audio-driven human motion generation. We aim to tackle a largely underexplored yet important problem of enabling virtual humans to move naturally in response to spatial audio—capturing not just what is heard, but also where the sound is coming from. To this end, we introduce the Spatial Audio-Driven Human Motion (SAM) dataset—the first comprehensive dataset featuring paired high-quality human motion and spatial audio recordings. For benchmarking, we develop a generative framework for human MOtion generation driven by SPAtial audio, termed MOSPA, which learns to synthesize realistic and diverse human motions conditioned on spatial audio input. We hope this research could provide a foundation for future research in spatial perception, virtual characters, and embodied AI. The dataset and model will be open-sourced soon. A big thank you to our intern, Shuyang Xu, for the wonderful collaboration! Congratulations, Shuyang! Project page: Paper: Video: #Animation #CG #CV #AIGC #DL #Deeplearning #Motion #Graphics #AI #GenerativeAI

Zhiyang (Frank) Dou

14,683 görüntüleme • 1 yıl önce

Human development could be setback by up to 69 years in #Gaza by the end of 2024. A comprehensive recovery and reconstruction plan is needed to promote recovery-enabling conditions. Read more in our 🆕 #GazaWarImpact assessment with ESCWA:

Human development could be setback by up to 69 years in #Gaza by the end of 2024. A comprehensive recovery and reconstruction plan is needed to promote recovery-enabling conditions. Read more in our 🆕 #GazaWarImpact assessment with ESCWA:

UN Development

42,945 görüntüleme • 1 yıl önce

4D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Models Contributions: • We introduce 4D LangSplat for open-vocabulary 4D spatial-temporal queries. To the best of our knowledge, we are the first to construct 4D language fields with object textual captions generated by MLLMs. • To model smooth transitions across states for objects in 4D scenes, we propose a status deformable network to capture continuous temporal changes. • Experiential results show that our method attains state-of-the-art performance for both time-agnostic and time-sensitive open-vocabulary queries.

4D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Models Contributions: • We introduce 4D LangSplat for open-vocabulary 4D spatial-temporal queries. To the best of our knowledge, we are the first to construct 4D language fields with object textual captions generated by MLLMs. • To model smooth transitions across states for objects in 4D scenes, we propose a status deformable network to capture continuous temporal changes. • Experiential results show that our method attains state-of-the-art performance for both time-agnostic and time-sensitive open-vocabulary queries.

MrNeRF

10,968 görüntüleme • 1 yıl önce

Modern AI is confined to the digital world. At Skild AI, we are building towards AGI for the real world, unconstrained by robot type or task — a single, omni-bodied brain. Today, we are sharing our journey, starting with early milestones, with more to come in the weeks ahead. Our Mission: Artificial General Intelligence grounded in the physical world. We believe AGI that can truly understand and reason in the real world can only be built through grounding in the physical world. Our Vision: Any robot, Any task, One brain. We tackle robotics in its full generality – building a continually improving, omni-bodied brain that can control any hardware for any task. Who are we? A passionate group of scientists & engineers driven by our shared vision. We have been researching AI and robotics for more than a decade. Our team includes pioneers of self-supervised learning, curiosity-driven exploration, end-to-end sim2real for visual locomotion, dexterous manipulation, learning from human videos, robot parkour, and many more. Many of these works have won awards at top-tier AI and Robotics conferences. Our team has also built production-ready systems at Anduril, Tesla, Nvidia, Meta, Kitty Hawk, Google, Everyday Robotics, and Amazon. Join us in our mission to build the robot brains of tomorrow.

Modern AI is confined to the digital world. At Skild AI, we are building towards AGI for the real world, unconstrained by robot type or task — a single, omni-bodied brain. Today, we are sharing our journey, starting with early milestones, with more to come in the weeks ahead. Our Mission: Artificial General Intelligence grounded in the physical world. We believe AGI that can truly understand and reason in the real world can only be built through grounding in the physical world. Our Vision: Any robot, Any task, One brain. We tackle robotics in its full generality – building a continually improving, omni-bodied brain that can control any hardware for any task. Who are we? A passionate group of scientists & engineers driven by our shared vision. We have been researching AI and robotics for more than a decade. Our team includes pioneers of self-supervised learning, curiosity-driven exploration, end-to-end sim2real for visual locomotion, dexterous manipulation, learning from human videos, robot parkour, and many more. Many of these works have won awards at top-tier AI and Robotics conferences. Our team has also built production-ready systems at Anduril, Tesla, Nvidia, Meta, Kitty Hawk, Google, Everyday Robotics, and Amazon. Join us in our mission to build the robot brains of tomorrow.

Skild AI

386,149 görüntüleme • 1 yıl önce

.President Donald J. Trump: "In 250 Years, the Free People of this land have accomplished more with our Liberty than any other society has accomplished even in thousands and thousands of years... What our critics will never understand is that America is not the sum of its mistakes. Our mistakes make us human—our achievements make us American... We are the nation that dreamed and created the modern world—we laid the railroads, we raised up those big, beautiful skyscrapers, harnessed electricity, and invented the light bulb, the telephone, the airplane, the assembly line, the television, the microchip, the personal computer, the internet, GPS, the smartphone, and almost everything else that has ever been invented—including... a thing called air conditioning. We charted the human genome to cure diseases, we powered entire cities by splitting single atoms, and planted our flag on the Moon. Americans filled the airwaves of the planet with our music and our culture. We invented baseball, basketball, football, volleyball, NASCAR, and the Rodeos of the West. Americans have won the most Olympic medals of any country in the world by far, the most Nobel Prizes... and the most world records. We publish by far the most patents, we produce the best movies, we make the best music, and we raise up the greatest entertainers and strongest athletes the world has ever seen. We built the biggest and most dynamic economy... with, as of last week, 19.2 trillion dollars pouring into the United States from all over the world... And thanks to our great election win and tariffs, plants and factories are being built all over the United States right now... We created the strongest and most powerful military. We won Two World Wars, the Cold War, and left America’s enemies in the depths of history."

.President Donald J. Trump: "In 250 Years, the Free People of this land have accomplished more with our Liberty than any other society has accomplished even in thousands and thousands of years... What our critics will never understand is that America is not the sum of its mistakes. Our mistakes make us human—our achievements make us American... We are the nation that dreamed and created the modern world—we laid the railroads, we raised up those big, beautiful skyscrapers, harnessed electricity, and invented the light bulb, the telephone, the airplane, the assembly line, the television, the microchip, the personal computer, the internet, GPS, the smartphone, and almost everything else that has ever been invented—including... a thing called air conditioning. We charted the human genome to cure diseases, we powered entire cities by splitting single atoms, and planted our flag on the Moon. Americans filled the airwaves of the planet with our music and our culture. We invented baseball, basketball, football, volleyball, NASCAR, and the Rodeos of the West. Americans have won the most Olympic medals of any country in the world by far, the most Nobel Prizes... and the most world records. We publish by far the most patents, we produce the best movies, we make the best music, and we raise up the greatest entertainers and strongest athletes the world has ever seen. We built the biggest and most dynamic economy... with, as of last week, 19.2 trillion dollars pouring into the United States from all over the world... And thanks to our great election win and tariffs, plants and factories are being built all over the United States right now... We created the strongest and most powerful military. We won Two World Wars, the Cold War, and left America’s enemies in the depths of history."

Rapid Response 47

274,275 görüntüleme • 2 ay önce

In this defining moment, we must stand with those whose creativity shapes our culture, our economy, and our shared human story. Algorithms may calculate, but the human creativity behind it all is what pours heart, history, hope and the human into and out of every note, frame and story. AI cannot be allowed to redefine the soul of creation. If we erode the rights that protect our creators, we don’t just risk economic loss - we risk a strangulation of those voices that tell our stories, reflect our struggles, and inspire our futures. Let’s affirm that in Britain, we value not just innovation, but the irreplaceable human spirit behind creativity and protect the rights that means we thrive. For now and generations yet to imagine, to dream, and create.

In this defining moment, we must stand with those whose creativity shapes our culture, our economy, and our shared human story. Algorithms may calculate, but the human creativity behind it all is what pours heart, history, hope and the human into and out of every note, frame and story. AI cannot be allowed to redefine the soul of creation. If we erode the rights that protect our creators, we don’t just risk economic loss - we risk a strangulation of those voices that tell our stories, reflect our struggles, and inspire our futures. Let’s affirm that in Britain, we value not just innovation, but the irreplaceable human spirit behind creativity and protect the rights that means we thrive. For now and generations yet to imagine, to dream, and create.

James Frith MP

28,082 görüntüleme • 1 yıl önce

Exciting updates on Project GR00T! We discover a systematic way to scale up robot data, tackling the most painful pain point in robotics. The idea is simple: human collects demonstration on a real robot, and we multiply that data 1000x or more in simulation. Let’s break it down: 1. We use Apple Vision Pro (yes!!) to give the human operator first person control of the humanoid. Vision Pro parses human hand pose and retargets the motion to the robot hand, all in real time. From the human’s point of view, they are immersed in another body like the Avatar. Teleoperation is slow and time-consuming, but we can afford to collect a small amount of data. 2. We use RoboCasa, a generative simulation framework, to multiply the demonstration data by varying the visual appearance and layout of the environment. In Jensen’s keynote video below, the humanoid is now placing the cup in hundreds of kitchens with a huge diversity of textures, furniture, and object placement. We only have 1 physical kitchen at the GEAR Lab in NVIDIA HQ, but we can conjure up infinite ones in simulation. 3. Finally, we apply MimicGen, a technique to multiply the above data even more by varying the motion of the robot. MimicGen generates vast number of new action trajectories based on the original human data, and filters out failed ones (e.g. those that drop the cup) to form a much larger dataset. To sum up, given 1 human trajectory with Vision Pro -> RoboCasa produces N (varying visuals) -> MimicGen further augments to NxM (varying motions). This is the way to trade compute for expensive human data by GPU-accelerated simulation. A while ago, I mentioned that teleoperation is fundamentally not scalable, because we are always limited by 24 hrs/robot/day in the world of atoms. Our new GR00T synthetic data pipeline breaks this barrier in the world of bits. Scaling has been so much fun for LLMs, and it's finally our turn to have fun in robotics! We are building tools to enable everyone in the ecosystem to scale up with us. Links in thread:

Jim Fan

364,670 görüntüleme • 2 yıl önce

How can we build a general-purpose “foundation model” for robot motion? Zhengyi “Zen” Luo joins us to talk about SONIC, which uses motion tracking as a foundational task for humanoid robot control, and scales humanoid control training to 9k GPU hours and 100 million frames worth of data. The result: a model with a generally-useful embedding space that can be controlled by a VLA, or from human video, to perform a wide variety of humanoid whole-body-control tasks, including with zero-shot transfer to previously unseen motions. Watch episode 72 of RoboPapers, with Michael Cho - Rbt/Acc and Jiafei Duan, now!

How can we build a general-purpose “foundation model” for robot motion? Zhengyi “Zen” Luo joins us to talk about SONIC, which uses motion tracking as a foundational task for humanoid robot control, and scales humanoid control training to 9k GPU hours and 100 million frames worth of data. The result: a model with a generally-useful embedding space that can be controlled by a VLA, or from human video, to perform a wide variety of humanoid whole-body-control tasks, including with zero-shot transfer to previously unseen motions. Watch episode 72 of RoboPapers, with Michael Cho - Rbt/Acc and Jiafei Duan, now!

RoboPapers

24,802 görüntüleme • 5 ay önce

The team l work with Sema Ukweli is facing the closure of our physical office and the vital work we do. We are a justice and human rights media organization that seeks to tell human interest stories. As an independent media platform, we expose injustices and human rights violations faced by ordinary Kenyans, with the aim of getting justice for the victims. We work closely with various organizations and authorities to achieve this aim. We also run a rapid response desk that responds to urgent calls and bails out innocent people arrested by the police. We work closely with young people and train them in citizen journalism, human rights, and how to organize in their communities to fight against injustices. Kindly spare a few minutes to watch the video of our work. I need your support to continue doing this important and vital work. Help us deliver the independent, and bold journalism that Kenya needs. Support Brave Media by making a contribution. #SemaUkweli

The team l work with Sema Ukweli is facing the closure of our physical office and the vital work we do. We are a justice and human rights media organization that seeks to tell human interest stories. As an independent media platform, we expose injustices and human rights violations faced by ordinary Kenyans, with the aim of getting justice for the victims. We work closely with various organizations and authorities to achieve this aim. We also run a rapid response desk that responds to urgent calls and bails out innocent people arrested by the police. We work closely with young people and train them in citizen journalism, human rights, and how to organize in their communities to fight against injustices. Kindly spare a few minutes to watch the video of our work. I need your support to continue doing this important and vital work. Help us deliver the independent, and bold journalism that Kenya needs. Support Brave Media by making a contribution. #SemaUkweli

The People’s President

46,373 görüntüleme • 1 yıl önce

Even if the future goes extremely well, even if we manage to preserve and promote human values, that future could still be incomprehensible to us - because among our values is a belief in the importance of change and moral progress. Joe Carlsmith

Even if the future goes extremely well, even if we manage to preserve and promote human values, that future could still be incomprehensible to us - because among our values is a belief in the importance of change and moral progress. Joe Carlsmith

Dwarkesh Patel

29,148 görüntüleme • 4 ay önce

DisCo: Disentangled Control for Referring Human Dance Generation in Real World paper page: Generative AI has made significant strides in computer vision, particularly in image/video synthesis conditioned on text descriptions. Despite the advancements, it remains challenging especially in the generation of human-centric content such as dance synthesis. Existing dance synthesis methods struggle with the gap between synthesized content and real-world dance scenarios. In this paper, we define a new problem setting: Referring Human Dance Generation, which focuses on real-world dance scenarios with three important properties: (i) Faithfulness: the synthesis should retain the appearance of both human subject foreground and background from the reference image, and precisely follow the target pose; (ii) Generalizability: the model should generalize to unseen human subjects, backgrounds, and poses; (iii) Compositionality: it should allow for composition of seen/unseen subjects, backgrounds, and poses from different sources. To address these challenges, we introduce a novel approach, DISCO, which includes a novel model architecture with disentangled control to improve the faithfulness and compositionality of dance synthesis, and an effective human attribute pre-training for better generalizability to unseen humans. Extensive qualitative and quantitative results demonstrate that DISCO can generate high-quality human dance images and videos with diverse appearances and flexible motions.

DisCo: Disentangled Control for Referring Human Dance Generation in Real World paper page: Generative AI has made significant strides in computer vision, particularly in image/video synthesis conditioned on text descriptions. Despite the advancements, it remains challenging especially in the generation of human-centric content such as dance synthesis. Existing dance synthesis methods struggle with the gap between synthesized content and real-world dance scenarios. In this paper, we define a new problem setting: Referring Human Dance Generation, which focuses on real-world dance scenarios with three important properties: (i) Faithfulness: the synthesis should retain the appearance of both human subject foreground and background from the reference image, and precisely follow the target pose; (ii) Generalizability: the model should generalize to unseen human subjects, backgrounds, and poses; (iii) Compositionality: it should allow for composition of seen/unseen subjects, backgrounds, and poses from different sources. To address these challenges, we introduce a novel approach, DISCO, which includes a novel model architecture with disentangled control to improve the faithfulness and compositionality of dance synthesis, and an effective human attribute pre-training for better generalizability to unseen humans. Extensive qualitative and quantitative results demonstrate that DISCO can generate high-quality human dance images and videos with diverse appearances and flexible motions.

AK

161,479 görüntüleme • 3 yıl önce

We’ve just open-sourced JOSH, our method for 4D human–scene reconstruction in the wild. Huge credit to the first author, my PhD student Zhizheng, who will present this work at ICLR in Brazil next month 🇧🇷 🌐 Project page: 💻 Code: A trivia is that this work was finished more than one year ago, and has been rejected twice...Be resilient!

We’ve just open-sourced JOSH, our method for 4D human–scene reconstruction in the wild. Huge credit to the first author, my PhD student Zhizheng, who will present this work at ICLR in Brazil next month 🇧🇷 🌐 Project page: 💻 Code: A trivia is that this work was finished more than one year ago, and has been rejected twice...Be resilient!

Bolei Zhou

25,599 görüntüleme • 6 ay önce

I transformed my physical door into a mixed-reality portal that can bring you either to your next room or to magical virtual worlds! You can select where you want to go (like when you choose the floor in an elevator) and then when you open the door, you can exactly go to that place, physical or virtual that it may be. What I love the most is that this demo connects the physicality of the door with mixed reality, so you use a real tool to be able to access virtual realities. I've made this demo using #unity3d and #MetaQuest SDK. I've used Meta Scene Setup, so the demo is fully dynamic: it finds my door and adapts all the interfaces to it. Theoretically, it could work with all sliding doors that work like mine with no modifications to the APK. As usual, I'm thinking of making a blog post where I explain how I did it... let me know if you could be interested! And let me know also if you could be interested in some collaborations with me ;) The full video of the demo is on Youtube: #metaverse #VirtualReality #SpatialComputing

I transformed my physical door into a mixed-reality portal that can bring you either to your next room or to magical virtual worlds! You can select where you want to go (like when you choose the floor in an elevator) and then when you open the door, you can exactly go to that place, physical or virtual that it may be. What I love the most is that this demo connects the physicality of the door with mixed reality, so you use a real tool to be able to access virtual realities. I've made this demo using #unity3d and #MetaQuest SDK. I've used Meta Scene Setup, so the demo is fully dynamic: it finds my door and adapts all the interfaces to it. Theoretically, it could work with all sliding doors that work like mine with no modifications to the APK. As usual, I'm thinking of making a blog post where I explain how I did it... let me know if you could be interested! And let me know also if you could be interested in some collaborations with me ;) The full video of the demo is on Youtube: #metaverse #VirtualReality #SpatialComputing

TonyVT SkarredGhost

20,084 görüntüleme • 2 yıl önce

MotionGPT: Human Motion as a Foreign Language paper page: Though the advancement of pre-trained large language models unfolds, the exploration of building a unified model for language and other multi-modal data, such as motion, remains challenging and untouched so far. Fortunately, human motion displays a semantic coupling akin to human language, often perceived as a form of body language. By fusing language data with large-scale motion models, motion-language pre-training that can enhance the performance of motion-related tasks becomes feasible. Driven by this insight, we propose MotionGPT, a unified, versatile, and user-friendly motion-language model to handle multiple motion-relevant tasks. Specifically, we employ the discrete vector quantization for human motion and transfer 3D motion into motion tokens, similar to the generation process of word tokens. Building upon this "motion vocabulary", we perform language modeling on both motion and text in a unified manner, treating human motion as a specific language. Moreover, inspired by prompt learning, we pre-train MotionGPT with a mixture of motion-language data and fine-tune it on prompt-based question-and-answer tasks. Extensive experiments demonstrate that MotionGPT achieves state-of-the-art performances on multiple motion tasks including text-driven motion generation, motion captioning, motion prediction, and motion in-between.

MotionGPT: Human Motion as a Foreign Language paper page: Though the advancement of pre-trained large language models unfolds, the exploration of building a unified model for language and other multi-modal data, such as motion, remains challenging and untouched so far. Fortunately, human motion displays a semantic coupling akin to human language, often perceived as a form of body language. By fusing language data with large-scale motion models, motion-language pre-training that can enhance the performance of motion-related tasks becomes feasible. Driven by this insight, we propose MotionGPT, a unified, versatile, and user-friendly motion-language model to handle multiple motion-relevant tasks. Specifically, we employ the discrete vector quantization for human motion and transfer 3D motion into motion tokens, similar to the generation process of word tokens. Building upon this "motion vocabulary", we perform language modeling on both motion and text in a unified manner, treating human motion as a specific language. Moreover, inspired by prompt learning, we pre-train MotionGPT with a mixture of motion-language data and fine-tune it on prompt-based question-and-answer tasks. Extensive experiments demonstrate that MotionGPT achieves state-of-the-art performances on multiple motion tasks including text-driven motion generation, motion captioning, motion prediction, and motion in-between.

AK

125,353 görüntüleme • 3 yıl önce

We are fighting against a terrible enemy, one that cannot be called human and is infinitely far from true Christianity. Its essence is ruins, and the death it brings is something we must overcome. Ukraine cannot agree to anything less than to live, to preserve itself, and to remain human. Ukraine will not succumb to the evil that sheds blood for its own sick self-assertion, that despises truth—both human and divine—and devalues everyone except itself. Russia builds its statehood precisely on this. But we are different. We are already separated from this enemy by our spirit. We must defeat this evil, and Ukraine will do it. There will always be Ukraine here: our history, our people, our state. Congratulations on the Day of Ukrainian Statehood! And I thank everyone who stands with Ukraine! 🇺🇦🇺🇦🇺🇦

We are fighting against a terrible enemy, one that cannot be called human and is infinitely far from true Christianity. Its essence is ruins, and the death it brings is something we must overcome. Ukraine cannot agree to anything less than to live, to preserve itself, and to remain human. Ukraine will not succumb to the evil that sheds blood for its own sick self-assertion, that despises truth—both human and divine—and devalues everyone except itself. Russia builds its statehood precisely on this. But we are different. We are already separated from this enemy by our spirit. We must defeat this evil, and Ukraine will do it. There will always be Ukraine here: our history, our people, our state. Congratulations on the Day of Ukrainian Statehood! And I thank everyone who stands with Ukraine! 🇺🇦🇺🇦🇺🇦

Volodymyr Zelenskyy / Володимир Зеленський

669,126 görüntüleme • 2 yıl önce

We have 13B hours of player interaction on the platform monthly. This data enables us to train intelligent NPCs that can reason and interact in 3D worlds. Our training goes beyond videos of gameplay and simple WASD actions, utilizing our full data model for a more detailed representation of human interactions. Our video below shows Roblox NPCs figuring out how to build a campfire by reasoning backwards to find an axe, cut down a tree, and bring the wood to the firepit. This is still early research but we imagine a future where intelligent NPCs could play alongside real players. 4/4

We have 13B hours of player interaction on the platform monthly. This data enables us to train intelligent NPCs that can reason and interact in 3D worlds. Our training goes beyond videos of gameplay and simple WASD actions, utilizing our full data model for a more detailed representation of human interactions. Our video below shows Roblox NPCs figuring out how to build a campfire by reasoning backwards to find an axe, cut down a tree, and bring the wood to the firepit. This is still early research but we imagine a future where intelligent NPCs could play alongside real players. 4/4

Roblox

288,814 görüntüleme • 7 ay önce