Загрузка видео...

Не удалось загрузить видео

На главную

Want to experience humanoid behavior foundation model in your browser? SONIC Web demo now live at Featuring: - Motion tracking - Text to motion using Kimodo Try it out!

zhengyiluo's profile picture

Zhengyi “Zen” Luo

6,160 subscribers

38,637 просмотров • 5 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Introducing our new Text-to-Motion model, built in-house at Viggle, now live in PINOC! Type a motion, get the animation. High-energy, expressive action is where it shines. Block shots, prototype gameplay, fill your world with NPCs that actually move. Save your keyframes for the hero shots. Try it for free on PINOC👇
1:10

Introducing our new Text-to-Motion model, built in-house at Viggle, now live in PINOC! Type a motion, get the animation. High-energy, expressive action is where it shines. Block shots, prototype gameplay, fill your world with NPCs that actually move. Save your keyframes for the hero shots. Try it for free on PINOC👇

ViggleAI

25,857 просмотров • 2 месяцев назад

figured out how to do motion blurs in the browser using svg filters and css
0:35

figured out how to do motion blurs in the browser using svg filters and css

ravarcheon

24,707 просмотров • 10 месяцев назад

robust weight transfer in the web browser. a little demo i made to try. check it out! link below 👇
0:31

robust weight transfer in the web browser. a little demo i made to try. check it out! link below 👇

Sent From Space 👽

12,829 просмотров • 1 год назад

Congratulations to our NVIDIA Research team for SONIC being published in Science Magazine. 🦾 Built by NVIDIA Robotics researchers and collaborators, SONIC demonstrates scaling motion tracking for natural, robust humanoid whole-body control. Read the paper 📄
0:36

Congratulations to our NVIDIA Research team for SONIC being published in Science Magazine. 🦾 Built by NVIDIA Robotics researchers and collaborators, SONIC demonstrates scaling motion tracking for natural, robust humanoid whole-body control. Read the paper 📄

NVIDIA Robotics

52,565 просмотров • 1 месяц назад

ChatGPT can now create motion designs. Introducing the Motion MCP for ChatGPT Connect it to motion through the MCP, give it your assets and describe what you want. ChatGPT handles the ideas, animations and transitions directly inside motion. This launch video was created using the Motion MCP 👇
0:30

ChatGPT can now create motion designs. Introducing the Motion MCP for ChatGPT Connect it to motion through the MCP, give it your assets and describe what you want. ChatGPT handles the ideas, animations and transitions directly inside motion. This launch video was created using the Motion MCP 👇

Motion

90,939 просмотров • 5 дней назад

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.
0:58

TWIST: a real-time teleoperation system for humanoid robots to mimic whole-body motions. Reference motion data is generated by retargeting human motion-capture data to the robot. Then, the controller is trained in simulation using reinforcement learning and behavior cloning.

The Humanoid Hub

46,715 просмотров • 1 год назад

It’s here. Veo 3 is now live for all Pro users in LTX Studio. Text-to-video just leveled up. More motion, more detail, more cinematic control. Try it today.
0:41

It’s here. Veo 3 is now live for all Pro users in LTX Studio. Text-to-video just leveled up. More motion, more detail, more cinematic control. Try it today.

LTX.io

667,773 просмотров • 1 год назад

NVIDIA researchers present SONIC, a generalist humanoid controller: It scales motion tracking on a single policy to achieve natural, robust whole-body movement. The scalable foundation avoids manual reward engineering and features a universal token space and kinematic planner to seamlessly integrate diverse inputs, including VR/video teleoperation and VLA foundation models, for real-world tasks.
2:39

NVIDIA researchers present SONIC, a generalist humanoid controller: It scales motion tracking on a single policy to achieve natural, robust whole-body movement. The scalable foundation avoids manual reward engineering and features a universal token space and kinematic planner to seamlessly integrate diverse inputs, including VR/video teleoperation and VLA foundation models, for real-world tasks.

The Humanoid Hub

31,445 просмотров • 10 месяцев назад

How can we build a general-purpose “foundation model” for robot motion? Zhengyi “Zen” Luo joins us to talk about SONIC, which uses motion tracking as a foundational task for humanoid robot control, and scales humanoid control training to 9k GPU hours and 100 million frames worth of data. The result: a model with a generally-useful embedding space that can be controlled by a VLA, or from human video, to perform a wide variety of humanoid whole-body-control tasks, including with zero-shot transfer to previously unseen motions. Watch episode 72 of RoboPapers, with Michael Cho - Rbt/Acc and Jiafei Duan, now!
59:44

How can we build a general-purpose “foundation model” for robot motion? Zhengyi “Zen” Luo joins us to talk about SONIC, which uses motion tracking as a foundational task for humanoid robot control, and scales humanoid control training to 9k GPU hours and 100 million frames worth of data. The result: a model with a generally-useful embedding space that can be controlled by a VLA, or from human video, to perform a wide variety of humanoid whole-body-control tasks, including with zero-shot transfer to previously unseen motions. Watch episode 72 of RoboPapers, with Michael Cho - Rbt/Acc and Jiafei Duan, now!

RoboPapers

24,802 просмотров • 5 месяцев назад

The humanoid robot Lingxi X2 can easily dodge thrown balls… powered by AGIBOT’s newly launched AGILE perception-motion foundation model. With this motion intelligence, it can avoid interference and make real-time perceptual adjustments when working in complex environments. I’m curious whether it could dodge a human’s flying kick? (They always seem to kick humanoid robots during testing.)
0:24

The humanoid robot Lingxi X2 can easily dodge thrown balls… powered by AGIBOT’s newly launched AGILE perception-motion foundation model. With this motion intelligence, it can avoid interference and make real-time perceptual adjustments when working in complex environments. I’m curious whether it could dodge a human’s flying kick? (They always seem to kick humanoid robots during testing.)

CyberRobo

32,796 просмотров • 3 месяцев назад

A professional motion studio now runs entirely in your browser. Meet Lottie Creator 2.0: describe an animation & Motion Copilot builds it, shape every curve in the new graph editor, add interactivity with State Machines & export production-ready Lottie. No installs, nothing to maintain. Try it free 👇
1:19

A professional motion studio now runs entirely in your browser. Meet Lottie Creator 2.0: describe an animation & Motion Copilot builds it, shape every curve in the new graph editor, add interactivity with State Machines & export production-ready Lottie. No installs, nothing to maintain. Try it free 👇

LottieFiles

28,752 просмотров • 2 месяцев назад

Introducing TTS WebGPU: The first ever text-to-speech web app built with WebGPU acceleration! 🔥 High-quality and natural speech generation that runs 100% locally in your browser, powered by OuteTTS and Transformers.js.🤗 Try it out yourself! Demo + source code below 👇
0:32

Introducing TTS WebGPU: The first ever text-to-speech web app built with WebGPU acceleration! 🔥 High-quality and natural speech generation that runs 100% locally in your browser, powered by OuteTTS and Transformers.js.🤗 Try it out yourself! Demo + source code below 👇

Xenova

20,541 просмотров • 1 год назад

Want to achieve extreme performance in motion tracking—and go beyond it? Our preprint tech report is now online, with open-source code available!
0:49

Want to achieve extreme performance in motion tracking—and go beyond it? Our preprint tech report is now online, with open-source code available!

Qiayuan Liao

367,018 просмотров • 1 год назад

TextOp: A real-time text-to-motion framework for humanoid robots. It allows users to instruct the robot using natural language and to modify commands on the fly, producing smooth, whole-body motions instantly.
1:11

TextOp: A real-time text-to-motion framework for humanoid robots. It allows users to instruct the robot using natural language and to modify commands on the fly, producing smooth, whole-body motions instantly.

The Humanoid Hub

25,125 просмотров • 10 месяцев назад

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥
1:32

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥

Zhengyi “Zen” Luo

62,674 просмотров • 10 месяцев назад

End to end, autonomous whole body motion generation. You can see this demo in “live”(not video) at ICRA2024.
0:27

End to end, autonomous whole body motion generation. You can see this demo in “live”(not video) at ICRA2024.

Tetsuya Ogata / 尾形哲也

42,928 просмотров • 2 лет назад

Codex can now make launch videos. Introducing the Motion MCP for Codex Connect it to motion through the MCP, give it your assets and describe what you want. Codex builds the scenes, animations and transitions directly inside motion. This video was created using the MCP 👇
0:30

Codex can now make launch videos. Introducing the Motion MCP for Codex Connect it to motion through the MCP, give it your assets and describe what you want. Codex builds the scenes, animations and transitions directly inside motion. This video was created using the MCP 👇

Motion

93,073 просмотров • 7 дней назад

Want free, local AI in your browser? Chrome's built-in Prompt API is ready to try and is also shipped for Chrome Extensions. Powered by Gemini Nano. Demo featuring Y Combinator 😅
3:20

Want free, local AI in your browser? Chrome's built-in Prompt API is ready to try and is also shipped for Chrome Extensions. Powered by Gemini Nano. Demo featuring Y Combinator 😅

Addy Osmani

45,845 просмотров • 1 год назад