Загрузка видео...

Не удалось загрузить видео

На главную

What if we could model human input/output channels with multi-modal #AI? Congratulations to our amazing intern Bruce Liu for the Honorable Mentions Award #CHI2024 with amazing collaboration w/ Jiahao “Nick” Li, David Kim, and Xiang 'Anthony' Chen ! ACM SIGCHI UCLA #a11y

DuRuofei's profile picture

Ruofei Du

2,317 subscribers

10,790 просмотров • 2 лет назад •via X (Twitter)

Наука и технологии#AI#CHI2024#a11y
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Excited to share our latest work on 🎧spatial audio-driven human motion generation. We aim to tackle a largely underexplored yet important problem of enabling virtual humans to move naturally in response to spatial audio—capturing not just what is heard, but also where the sound is coming from. To this end, we introduce the Spatial Audio-Driven Human Motion (SAM) dataset—the first comprehensive dataset featuring paired high-quality human motion and spatial audio recordings. For benchmarking, we develop a generative framework for human MOtion generation driven by SPAtial audio, termed MOSPA, which learns to synthesize realistic and diverse human motions conditioned on spatial audio input. We hope this research could provide a foundation for future research in spatial perception, virtual characters, and embodied AI. The dataset and model will be open-sourced soon. A big thank you to our intern, Shuyang Xu, for the wonderful collaboration! Congratulations, Shuyang! Project page: Paper: Video: #Animation #CG #CV #AIGC #DL #Deeplearning #Motion #Graphics #AI #GenerativeAI
3:58

Excited to share our latest work on 🎧spatial audio-driven human motion generation. We aim to tackle a largely underexplored yet important problem of enabling virtual humans to move naturally in response to spatial audio—capturing not just what is heard, but also where the sound is coming from. To this end, we introduce the Spatial Audio-Driven Human Motion (SAM) dataset—the first comprehensive dataset featuring paired high-quality human motion and spatial audio recordings. For benchmarking, we develop a generative framework for human MOtion generation driven by SPAtial audio, termed MOSPA, which learns to synthesize realistic and diverse human motions conditioned on spatial audio input. We hope this research could provide a foundation for future research in spatial perception, virtual characters, and embodied AI. The dataset and model will be open-sourced soon. A big thank you to our intern, Shuyang Xu, for the wonderful collaboration! Congratulations, Shuyang! Project page: Paper: Video: #Animation #CG #CV #AIGC #DL #Deeplearning #Motion #Graphics #AI #GenerativeAI

Zhiyang (Frank) Dou

14,603 просмотров • 11 месяцев назад

Content creators, we’ve got your back! 🔥 Creating posts and banners takes time—but what if AI could do it for you? 🤯 With #Inferium, just: ✅ Picking the perfect model (you can use our Magic Search and compare models if you dont know what to use) ✅ Entering your input ✅ Getting output in seconds No stress, no struggle—just high-quality content & stunning visuals in seconds! 🚀 Run inference with our free serverless API today 👉
1:05

Content creators, we’ve got your back! 🔥 Creating posts and banners takes time—but what if AI could do it for you? 🤯 With #Inferium, just: ✅ Picking the perfect model (you can use our Magic Search and compare models if you dont know what to use) ✅ Entering your input ✅ Getting output in seconds No stress, no struggle—just high-quality content & stunning visuals in seconds! 🚀 Run inference with our free serverless API today 👉

Inferium

91,042 просмотров • 1 год назад

“Many years ago I was thinking that what would inhibit alignment of collective human will with artificial intelligence and the low data rate of humans. Human have slow output rate that would necessarily just because the communication is so slow would diminish the link between humans and computers? We could better align collective human will with AI if the output rate dramatically increased.” — Elon Musk
2:46

“Many years ago I was thinking that what would inhibit alignment of collective human will with artificial intelligence and the low data rate of humans. Human have slow output rate that would necessarily just because the communication is so slow would diminish the link between humans and computers? We could better align collective human will with AI if the output rate dramatically increased.” — Elon Musk

Apurv Kochara

20,546 просмотров • 1 месяц назад

Together with the Ego4D consortium, we recently released Ego-Exo4D: A diverse, large-scale multi-modal, multi-view, video dataset and benchmark. Learn more about the work ➡️ Access the dataset ➡️ This work could help to advance AI models' understanding of complex human skills & enable new applications for AR systems, robotics & more.
0:49

Together with the Ego4D consortium, we recently released Ego-Exo4D: A diverse, large-scale multi-modal, multi-view, video dataset and benchmark. Learn more about the work ➡️ Access the dataset ➡️ This work could help to advance AI models' understanding of complex human skills & enable new applications for AR systems, robotics & more.

AI at Meta

78,039 просмотров • 2 лет назад

🚨AMAZING They load our food, air, and water with chemicals… that’s “okay”? But the second someone mentions borax? They warn you not to consume it. What if this simple mineral actually helps with arthritis, osteoporosis, parasites, insomnia, and more?
1:10

🚨AMAZING They load our food, air, and water with chemicals… that’s “okay”? But the second someone mentions borax? They warn you not to consume it. What if this simple mineral actually helps with arthritis, osteoporosis, parasites, insomnia, and more?

Dr. Dawn Michael

131,383 просмотров • 1 месяц назад

izna's Best Performance Award Speech at the 40th Golden Disc Awards🏆❤️ Jeemin: When we came to Golden Disc Awards last time, our goal was to leave with an amazing award the next time we come. Thank you so much for giving us this meaningful award! We'd like to say thank you to a lot of people. Firstly Wakeone management and all staffs. As well as CJ staffs! And to The Black Label Teddy Producer-nim for always giving us amazing songs and for guiding and leading us on the right direction. We'd also like to thank our performance director Soyoung for always helping us make our stages complete. And our naya! We love you so much! Thanks to naya, we were able to receive this amazing award. We will be an izna that can repay you with more amazing stages. Jungeun: As much as this award is for Best Performance, we will continue to work hard so that we can put on even more amazing performances in the future! Please love izna a lot, thank you 🫶
1:20

izna's Best Performance Award Speech at the 40th Golden Disc Awards🏆❤️ Jeemin: When we came to Golden Disc Awards last time, our goal was to leave with an amazing award the next time we come. Thank you so much for giving us this meaningful award! We'd like to say thank you to a lot of people. Firstly Wakeone management and all staffs. As well as CJ staffs! And to The Black Label Teddy Producer-nim for always giving us amazing songs and for guiding and leading us on the right direction. We'd also like to thank our performance director Soyoung for always helping us make our stages complete. And our naya! We love you so much! Thanks to naya, we were able to receive this amazing award. We will be an izna that can repay you with more amazing stages. Jungeun: As much as this award is for Best Performance, we will continue to work hard so that we can put on even more amazing performances in the future! Please love izna a lot, thank you 🫶

iznavibe

22,988 просмотров • 5 месяцев назад

It’s amazing seeing Dr David Unwin (Dr David Unwin) on such a large platform sharing his knowledge. Dr David Unwin is a founding member of the Public Health Collaboration and a trusted voice within the health industry. We are incredibly grateful for the work he has done with our charity over the years. If you’d like to watch the full video: To read our thoughts on the conversation:
1:39

It’s amazing seeing Dr David Unwin (Dr David Unwin) on such a large platform sharing his knowledge. Dr David Unwin is a founding member of the Public Health Collaboration and a trusted voice within the health industry. We are incredibly grateful for the work he has done with our charity over the years. If you’d like to watch the full video: To read our thoughts on the conversation:

Public Health Collaboration

14,018 просмотров • 1 месяц назад

If you missed the AMAZING Patrick De Haan on NinjaTrader Live with Anthony Crudele and me, here is what he had to say about when product disruption from the Strait of Hormuz closure, could hit CPI and what this means
1:28

If you missed the AMAZING Patrick De Haan on NinjaTrader Live with Anthony Crudele and me, here is what he had to say about when product disruption from the Strait of Hormuz closure, could hit CPI and what this means

Tracy Shuchart (𝒞𝒽𝒾 )

39,777 просмотров • 3 месяцев назад

NOW you can BUILD REAL Multi-Modal Agents with our API! 🚀 Excited to announce our API is now publicly available Memories.ai 😃 Memories.ai is building the visual memory layer for AI, it enables AI to see and remember like humans do. 2025 is the year of agents, 2026 is the year of multi-modal agents! 🌟
1:03

NOW you can BUILD REAL Multi-Modal Agents with our API! 🚀 Excited to announce our API is now publicly available Memories.ai 😃 Memories.ai is building the visual memory layer for AI, it enables AI to see and remember like humans do. 2025 is the year of agents, 2026 is the year of multi-modal agents! 🌟

Shawn Shen

530,527 просмотров • 10 месяцев назад

Excited to release two new AI papers. First, we report what we believe to be the first truly multi-modal visual language model for cardiology. Second, we report surprising findings related to how visual language models reason.
0:56

Excited to release two new AI papers. First, we report what we believe to be the first truly multi-modal visual language model for cardiology. Second, we report surprising findings related to how visual language models reason.

euan ashley

15,388 просмотров • 2 месяцев назад

“..what an amazing opportunity for Ireland, we could form a new state that’s inclusive for everybody and looks at the social issues that our generation are really suffering with.” - Doireann Ní Ghlacáin, How to Gael
2:02

“..what an amazing opportunity for Ireland, we could form a new state that’s inclusive for everybody and looks at the social issues that our generation are really suffering with.” - Doireann Ní Ghlacáin, How to Gael

Irish Unity 🇮🇪🇵🇸

71,107 просмотров • 3 месяцев назад

Did Nick Fuentes really just sign a deal with Patrick Bet David and goes from never Vance to we will vote for Vance if he lies to our faces and tells us what we want to hear?
7:16

Did Nick Fuentes really just sign a deal with Patrick Bet David and goes from never Vance to we will vote for Vance if he lies to our faces and tells us what we want to hear?

RyanMatta 🇺🇸 🦅

161,240 просмотров • 7 месяцев назад

It's #SUPERTUESDAY, and boy, we are in trouble! With the support from @redlightdistrictbytwo learn how to support us in #fulldecrimin Get some input from our amazing coalition group members @nj_rua and @bestpracticespolicyproject Read more about support for our profession over
2:19

Sensitive content

It's #SUPERTUESDAY, and boy, we are in trouble! With the support from @redlightdistrictbytwo learn how to support us in #fulldecrimin Get some input from our amazing coalition group members @nj_rua and @bestpracticespolicyproject Read more about support for our profession over

Black Sex Workers

28,239 просмотров • 2 лет назад

"Cori Close led with experience... This is amazing for our game... It adds more parity to our game. We no longer just worry about Geno Auriemma, or Dawn Staley, or Kim Mulkey." Isis “Ice” Young praises UCLA Women's Basketball's dominant National Championship victory
0:48

"Cori Close led with experience... This is amazing for our game... It adds more parity to our game. We no longer just worry about Geno Auriemma, or Dawn Staley, or Kim Mulkey." Isis “Ice” Young praises UCLA Women's Basketball's dominant National Championship victory

CBS Sports College Basketball 🏀

11,951 просмотров • 2 месяцев назад

Nick Sirianni with amazing telekinesis here to throw the ball FOR Jalen Hurts.
0:47

Nick Sirianni with amazing telekinesis here to throw the ball FOR Jalen Hurts.

Kei

24,093 просмотров • 1 год назад

We heard the criticism and we understand that some are frustrated with what the future AI will bring. It's scary to see such amazing results with just the click of the button. But AI isn't going anywhere. And to our 4 fans who pre ordered with us, we would like in introduce the 2nd trailer made with Claude 4.8, Polymarket, and our new employee. Klashi to understand the political markets.
0:40

We heard the criticism and we understand that some are frustrated with what the future AI will bring. It's scary to see such amazing results with just the click of the button. But AI isn't going anywhere. And to our 4 fans who pre ordered with us, we would like in introduce the 2nd trailer made with Claude 4.8, Polymarket, and our new employee. Klashi to understand the political markets.

Mizkif

34,479 просмотров • 17 дней назад

We took a robot to RSS in LA running our new Gemini Robotics On-Device VLA model. People interacted with the model with new objects and instructions in a brand new environment and the results were amazing!
0:48

We took a robot to RSS in LA running our new Gemini Robotics On-Device VLA model. People interacted with the model with new objects and instructions in a brand new environment and the results were amazing!

Ayzaan Wahid

19,622 просмотров • 11 месяцев назад

The October update for the VS Code AI Toolkit ( is out with so many exciting new features! 🔥Explore the most popular GenAI models in the Model Catalog and experiment with multi-modal capabilities in the Model Playground, all from within VS Code!
1:11

The October update for the VS Code AI Toolkit ( is out with so many exciting new features! 🔥Explore the most popular GenAI models in the Model Catalog and experiment with multi-modal capabilities in the Model Playground, all from within VS Code!

Visual Studio Code

154,207 просмотров • 1 год назад

Excited to share RoCo: Dialectic Multi-Robot Collaboration with Large Language Models. We propose a novel approach to multi-robot collaboration that leverages LLMs for both high-level communication and low-level path planning. w/ Shreeya Jain, Shuran Song
0:26

Excited to share RoCo: Dialectic Multi-Robot Collaboration with Large Language Models. We propose a novel approach to multi-robot collaboration that leverages LLMs for both high-level communication and low-level path planning. w/ Shreeya Jain, Shuran Song

Mandi Zhao

88,704 просмотров • 2 лет назад

Congratulations to my NVIDIA colleagues: Zhaoshuo Li, Thomas Müller, Alex Evans, Ming-Yu Liu, Chen-Hsuan Lin, and collaborators from Johns Hopkins: Russell H. Taylor, Mathias Unberath! The project is, in the literal sense, the Digital Renaissance (16th century art meets AI)!
0:57

Congratulations to my NVIDIA colleagues: Zhaoshuo Li, Thomas Müller, Alex Evans, Ming-Yu Liu, Chen-Hsuan Lin, and collaborators from Johns Hopkins: Russell H. Taylor, Mathias Unberath! The project is, in the literal sense, the Digital Renaissance (16th century art meets AI)!

Jim Fan

24,735 просмотров • 3 лет назад