Loading video...

Video Failed to Load

Go Home

Sony's new motion tracking VR system brings you into the Metaverse

mashable's profile picture

Mashable

8,604,055 subscribers

11,091 views • 1 year ago •via X (Twitter)

Science & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

1 Comments

Kevin T. White's profile picture
Kevin T. White1 year ago

@allcell9 This has some really promising implications for devs. I wonder how well this might sync up with an avatar in something like @Blender or a gaming engine to rig something with animation? Maybe sync up to @Polycam3D for animation. Curious on price point.

Related Videos

DJs are performing in the metaverse thanks to this VR school #FutureBlink
0:56

DJs are performing in the metaverse thanks to this VR school #FutureBlink

Mashable

191,096 views • 3 years ago

Any2Track: Galbot’s whole-body motion tracking system.
0:39

Any2Track: Galbot’s whole-body motion tracking system.

The Humanoid Hub

66,724 views • 8 months ago

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥
1:32

How do you give a humanoid the general motion capability? Not just single motions, but all motion? Introducing SONIC, our new work on supersizing motion tracking for natural humanoid control. We argue that motion tracking is the scalable foundation task for humanoids. So we "supersized" it: 9k+ GPU hours and 100M+ motion frames. But tracking alone is not enough; we show how to make a useful control system out of it: - Universal Kinematic Planner: Enables game-like gamepad control and high-level teleoperation, just like controlling a character in a game. - VR Full-Body Teleop: Direct, real-time whole-body control by a human wearing a VR headset. - VR Keypoint Teleop: Control the upper body (hands/head) while our planner handles robust locomotion automatically. - VLA Integration: We connect this motion tracker to autonomous Visual-Language-Action (VLA) models for autonomous task execution! We use a Universal Token Space to UNIFY this command space, turning our robust tracker into a general-purpose, programmable humanoid brain. This is the generalist "System 1" for humanoids. 🚀 Project: #Humanoids #Robotics #AI #FoundationModels #NVIDIAResearch 🧠🔥

Zhengyi “Zen” Luo

62,040 views • 8 months ago

SkyrimVR FBT - Full Body Tracking System for Skyrim Available now - You can Kick a Dragon #vr #skyrim #gaming
0:36

SkyrimVR FBT - Full Body Tracking System for Skyrim Available now - You can Kick a Dragon #vr #skyrim #gaming

GingasVR

18,431 views • 14 days ago

FluxPose wants to be the new 6DoF VR body tracking system of choice, and its Kickstarter campaign has already raised over $2 million. Details here:
3:05

FluxPose wants to be the new 6DoF VR body tracking system of choice, and its Kickstarter campaign has already raised over $2 million. Details here:

UploadVR

80,338 views • 7 months ago

You can now easily make your own 3D avatar with Sony's wireless mobile motion capture system Mocopi. It costs less than you might expect. #tech #TechNews #mocap #motioncapture #sony #gamedev #gamedevelopment
0:34

You can now easily make your own 3D avatar with Sony's wireless mobile motion capture system Mocopi. It costs less than you might expect. #tech #TechNews #mocap #motioncapture #sony #gamedev #gamedevelopment

80 LEVEL

54,475 views • 3 years ago

Today I'm shipping PortalVR Motion, which turns VR into Wii-style gaming by tracking Joy-Cons in 3D with an iPhone. VRChat, Half-Life: Alyx, and countless VR titles are now playable in 2D on any PC using Joy-Cons for motion controls. 🧵 Get it now:
1:09

Today I'm shipping PortalVR Motion, which turns VR into Wii-style gaming by tracking Joy-Cons in 3D with an iPhone. VRChat, Half-Life: Alyx, and countless VR titles are now playable in 2D on any PC using Joy-Cons for motion controls. 🧵 Get it now:

gfodor.id

290,434 views • 2 months ago

jungkook playing with his new camera’s motion tracking ☝️
0:33

jungkook playing with his new camera’s motion tracking ☝️

ajk ⋆

16,505 views • 8 months ago

SkyrimVR FBT is an Upcoming Mod I made that adds a Full working Fullbody Tracking System into Skyrim with Physics. You can now Kick a Dragon with your actual Legs. #vr #skyrimvr #skyrim #gaming #virtualreality
0:50

SkyrimVR FBT is an Upcoming Mod I made that adds a Full working Fullbody Tracking System into Skyrim with Physics. You can now Kick a Dragon with your actual Legs. #vr #skyrimvr #skyrim #gaming #virtualreality

GingasVR

10,879 views • 18 days ago

🔥The VR MixVerse is booming!🔥 Put on your headset to catch the #VR craze! #Metaverse
0:20

🔥The VR MixVerse is booming!🔥 Put on your headset to catch the #VR craze! #Metaverse

mixverse

20,492 views • 3 years ago

🏝 #CEEK's #Land #Sale: A New Era Of #VirtualRealEstate In The #Metaverse #CEEKVR connects #creators directly to their #fans in the Metaverse. 🌐 🏝 Ceek 🏙 #ad #Crypto #Web3 #VR #EntertainmentIndustry
1:36

🏝 #CEEK's #Land #Sale: A New Era Of #VirtualRealEstate In The #Metaverse #CEEKVR connects #creators directly to their #fans in the Metaverse. 🌐 🏝 Ceek 🏙 #ad #Crypto #Web3 #VR #EntertainmentIndustry

Benzinga

81,593 views • 3 years ago

We are happy to share a new video 1-to-1 capturing a legendary Lagoon 55 in VR! We recreated every part of the boat precisely so you wouldn’t tell the difference! It's a new way to present luxury items, and we're very excited to be a part of it! #VictoriaVR #VR $VR #Metaverse
1:29

We are happy to share a new video 1-to-1 capturing a legendary Lagoon 55 in VR! We recreated every part of the boat precisely so you wouldn’t tell the difference! It's a new way to present luxury items, and we're very excited to be a part of it! #VictoriaVR #VR $VR #Metaverse

Victoria VR

28,830 views • 3 years ago

🤖✨ Victoria VR: All You Need to Know! 🌟🏆 🎥 Want to perfectly understand Victoria VR? Our new video features Robot Gigi and CEO Adam and offers a clear look at the virtual world we're crafting, straight from the source. ❓ Have questions left unanswered? Visit our website for even more info on our VR Metaverse! P.S. Oops! Yugo the Turtle popped in unexpectedly—she's looking forward to your visit to Asugea! 🐢🌲 $VR #VictoriaVR #VR #VirtualReality #Metaverse #VRcrypto #p2E #Cryptogaming
5:38

🤖✨ Victoria VR: All You Need to Know! 🌟🏆 🎥 Want to perfectly understand Victoria VR? Our new video features Robot Gigi and CEO Adam and offers a clear look at the virtual world we're crafting, straight from the source. ❓ Have questions left unanswered? Visit our website for even more info on our VR Metaverse! P.S. Oops! Yugo the Turtle popped in unexpectedly—she's looking forward to your visit to Asugea! 🐢🌲 $VR #VictoriaVR #VR #VirtualReality #Metaverse #VRcrypto #p2E #Cryptogaming

Victoria VR

96,780 views • 2 years ago

Showcasing Rebocap at Anime Nights Kaunas! its a pretty easy to setup Vtuber Full body Motion Tracking system!
0:21

Showcasing Rebocap at Anime Nights Kaunas! its a pretty easy to setup Vtuber Full body Motion Tracking system!

Gloria - 3D artist 🪡✂️

18,107 views • 2 months ago

Teruaki Tsubokura's invisible sculptures are obtained with the 3D tracking system "Lighthouse" adopted by HTC Vive. Unlike VR or AR, the shadows are reflected in the real space.
0:32

Teruaki Tsubokura's invisible sculptures are obtained with the 3D tracking system "Lighthouse" adopted by HTC Vive. Unlike VR or AR, the shadows are reflected in the real space.

Massimo

853,869 views • 2 years ago

Trivia Crack is coming to #VR soon! 🤩 Get ready to become champions of the #metaverse and experience a new world of trivia fun. Are you excited!? 👏 #10YearsOfTrivia #TriviaCrack
0:25

Trivia Crack is coming to #VR soon! 🤩 Get ready to become champions of the #metaverse and experience a new world of trivia fun. Are you excited!? 👏 #10YearsOfTrivia #TriviaCrack

Trivia Crack

135,564 views • 3 years ago

You don’t cross into the new financial system… without passing the bridge first. XRP is that bridge... The keys to the new financial system
2:51

You don’t cross into the new financial system… without passing the bridge first. XRP is that bridge... The keys to the new financial system

XRP Bags💰👨🏽‍🚀 BagMan

21,263 views • 3 months ago

New work! We redesigned MetaMask 🦊 into a scalable digital design system, built with motion principles and WebGL-powered 3D animations of the reimagined mascot, the new face of web3. →
0:56

New work! We redesigned MetaMask 🦊 into a scalable digital design system, built with motion principles and WebGL-powered 3D animations of the reimagined mascot, the new face of web3. →

Antinomy Studio

26,176 views • 1 year ago

The Biometric tracking system
0:21

The Biometric tracking system

Vision4theBlind

30,935 views • 1 year ago

Sony's booth at #CES2024 is mind-blowing with a Ghostbusters-themed setup! Imagine screens surrounding you and haptic feedback underfoot - it's like stepping into a basic VR world without needing a headset. Absolutely amazing experience! #CES2024
0:39

Sony's booth at #CES2024 is mind-blowing with a Ghostbusters-themed setup! Imagine screens surrounding you and haptic feedback underfoot - it's like stepping into a basic VR world without needing a headset. Absolutely amazing experience! #CES2024

Tansu Yegen

146,218 views • 2 years ago