Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

RynnWorld-4D 4D Embodied World Models for Robotic Manipulation

_akhaliq's profile picture

AK

514,304 subscribers

33,467 görüntüleme • 22 gün önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Robot Learning needs 4D world models! Robot Learning needs 4D world models! Robot Learning needs 4D world models! We introduce TesserAct, a 4D embodied world model that can simulate how agents interact with the 3D world over time! We achieve this by simply extending a pre-trained 2D video generation model to jointly predict RGB, depth, and surface normals. It enables: 1️⃣ Much better policy learning in the wild 2️⃣ Temporal + spatial coherence in 4D dynamic prediction 3️⃣ Novel view synthesis for embodied scenes Code: Paper Link: Project page:
0:32

Robot Learning needs 4D world models! Robot Learning needs 4D world models! Robot Learning needs 4D world models! We introduce TesserAct, a 4D embodied world model that can simulate how agents interact with the 3D world over time! We achieve this by simply extending a pre-trained 2D video generation model to jointly predict RGB, depth, and surface normals. It enables: 1️⃣ Much better policy learning in the wild 2️⃣ Temporal + spatial coherence in 4D dynamic prediction 3️⃣ Novel view synthesis for embodied scenes Code: Paper Link: Project page:

Chuang Gan

43,265 görüntüleme • 1 yıl önce

4D LangSplat 4D Language Gaussian Splatting via Multimodal Large Language Models
2:46

4D LangSplat 4D Language Gaussian Splatting via Multimodal Large Language Models

AK

30,848 görüntüleme • 1 yıl önce

InsertAnywhere Bridging 4D Scene Geometry and Diffusion Models for Realistic Video Object Insertion
0:21

InsertAnywhere Bridging 4D Scene Geometry and Diffusion Models for Realistic Video Object Insertion

AK

26,123 görüntüleme • 7 ay önce

4Dは来ないのか！ 4Dは来ないのか！ 4D来た、4D来た、4D来た、4D来た、4D来た、4D来た！！ 4D版、めちゃくちゃ良かったからみんな見に行こうね
0:31

4Dは来ないのか！ 4Dは来ないのか！ 4D来た、4D来た、4D来た、4D来た、4D来た、4D来た！！ 4D版、めちゃくちゃ良かったからみんな見に行こうね

Quicot

216,817 görüntüleme • 2 yıl önce

4D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Models Contributions: • We introduce 4D LangSplat for open-vocabulary 4D spatial-temporal queries. To the best of our knowledge, we are the first to construct 4D language fields with object textual captions generated by MLLMs. • To model smooth transitions across states for objects in 4D scenes, we propose a status deformable network to capture continuous temporal changes. • Experiential results show that our method attains state-of-the-art performance for both time-agnostic and time-sensitive open-vocabulary queries.
0:29

4D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Models Contributions: • We introduce 4D LangSplat for open-vocabulary 4D spatial-temporal queries. To the best of our knowledge, we are the first to construct 4D language fields with object textual captions generated by MLLMs. • To model smooth transitions across states for objects in 4D scenes, we propose a status deformable network to capture continuous temporal changes. • Experiential results show that our method attains state-of-the-art performance for both time-agnostic and time-sensitive open-vocabulary queries.

MrNeRF

10,953 görüntüleme • 1 yıl önce

PhysisForcing Physics Reinforced World Simulator for Robotic Manipulation
2:30

PhysisForcing Physics Reinforced World Simulator for Robotic Manipulation

AK

24,439 görüntüleme • 1 ay önce

What happens when vision🤝 robotics meet? Happy to share our new work on Pretraining Robotic Foundational Models!🔥 ARM4R is an Autoregressive Robotic Model that leverages low-level 4D Representations learned from human video data to yield a better robotic model. Berkeley AI Research😊
0:49

What happens when vision🤝 robotics meet? Happy to share our new work on Pretraining Robotic Foundational Models!🔥 ARM4R is an Autoregressive Robotic Model that leverages low-level 4D Representations learned from human video data to yield a better robotic model. Berkeley AI Research😊

Roei Herzig

62,805 görüntüleme • 1 yıl önce

Who's ready for Bubsy 4D?!
1:00

Who's ready for Bubsy 4D?!

Fabraz: Demon Tides & Bubsy 4D

74,286 görüntüleme • 3 ay önce

#AGIBOTAIWeek Day4: Introducing GE-Sim 2.0 (Genie Envisioner World Simulator 2.0) , a comprehensive embodied world simulator for robotic manipulation. By integrating future video generation, proprioceptive state estimation, and reward-based policy assessment, GE-Sim 2.0 moves beyond visual simulation toward an embodied world simulator with built-in evaluation capability, laying the foundation for a world-model-centric platform for closed-loop and interactive policy learning. It provides a practical framework for scalable evaluation and training of robotic manipulation policies. Project page: #AGIBOT #AGIBOTAIWeek #GenieEnvisioner #Robotics #visualsimulation
2:52

#AGIBOTAIWeek Day4: Introducing GE-Sim 2.0 (Genie Envisioner World Simulator 2.0) , a comprehensive embodied world simulator for robotic manipulation. By integrating future video generation, proprioceptive state estimation, and reward-based policy assessment, GE-Sim 2.0 moves beyond visual simulation toward an embodied world simulator with built-in evaluation capability, laying the foundation for a world-model-centric platform for closed-loop and interactive policy learning. It provides a practical framework for scalable evaluation and training of robotic manipulation policies. Project page: #AGIBOT #AGIBOTAIWeek #GenieEnvisioner #Robotics #visualsimulation

AGIBOT

28,219 görüntüleme • 3 ay önce

Google presents CAT4D Create Anything in 4D with Multi-View Video Diffusion Models
2:12

Google presents CAT4D Create Anything in 4D with Multi-View Video Diffusion Models

AK

61,949 görüntüleme • 1 yıl önce

VerseCrafter Dynamic Realistic Video World Model with 4D Geometric Control
0:44

VerseCrafter Dynamic Realistic Video World Model with 4D Geometric Control

AK

26,856 görüntüleme • 6 ay önce

INSPATIO-WORLD A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling paper:
1:32

INSPATIO-WORLD A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling paper:

AK

15,603 görüntüleme • 3 ay önce

Kyle Berkshire’s swing in 4D 🤯 The 3x World Long Drive Champion stopped by the Radiant Images 4D stage at the PGA Championship … and didn’t disappoint!
0:22

Kyle Berkshire’s swing in 4D 🤯 The 3x World Long Drive Champion stopped by the Radiant Images 4D stage at the PGA Championship … and didn’t disappoint!

PGA of America

95,333 görüntüleme • 2 ay önce

Can't believe we got Bubsy 4D before [insert literally anything you're waiting for here]. 😼 Bubsy 4D is OUT NOW. 👏
1:10

Can't believe we got Bubsy 4D before [insert literally anything you're waiting for here]. 😼 Bubsy 4D is OUT NOW. 👏

Atari

401,051 görüntüleme • 2 ay önce

NeoVerse Enhancing 4D World Model with in-the-wild Monocular Videos
0:36

NeoVerse Enhancing 4D World Model with in-the-wild Monocular Videos

AK

23,598 görüntüleme • 6 ay önce

Diffuman4D 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models
0:58

Diffuman4D 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models

AK

12,518 görüntüleme • 1 yıl önce

🚀 MiniCPM enters the physical world — enabling robots to understand, remember, and act. We open-source MiniCPM-Robot, our first embodied AI model series, including: 🤖 MiniCPM-RobotManip — a 1.5B general-purpose Vision-Language-Action (VLA) model for robotic manipulation. 🐕 MiniCPM-RobotTrack — a compact model for real-world target tracking. ⚡ PhyAI — a high-performance inference framework built for embodied models. Together, they bring efficient, practical, and open embodied intelligence closer to real-world robots. ⭐ GitHub: 🤗 MiniCPM-RobotManip: 🤗 MiniCPM-RobotTrack:
1:17

🚀 MiniCPM enters the physical world — enabling robots to understand, remember, and act. We open-source MiniCPM-Robot, our first embodied AI model series, including: 🤖 MiniCPM-RobotManip — a 1.5B general-purpose Vision-Language-Action (VLA) model for robotic manipulation. 🐕 MiniCPM-RobotTrack — a compact model for real-world target tracking. ⚡ PhyAI — a high-performance inference framework built for embodied models. Together, they bring efficient, practical, and open embodied intelligence closer to real-world robots. ⭐ GitHub: 🤗 MiniCPM-RobotManip: 🤗 MiniCPM-RobotTrack:

OpenBMB

326,364 görüntüleme • 11 gün önce

Zhou et al., "PAGE-4D: Disentangled Pose and Geometry Estimation for 4D Perception" VGGT extended to dynamic scenes with a dynamic mask predictor.
0:25

Zhou et al., "PAGE-4D: Disentangled Pose and Geometry Estimation for 4D Perception" VGGT extended to dynamic scenes with a dynamic mask predictor.

Kwang Moo Yi

11,546 görüntüleme • 8 ay önce