正在加载视频...

视频加载失败

Introducing WALL-WM, our open-source World Model for embodied AI and the next piece of our open-source robotics stack. Carving World Action Modeling at the Event Joints Read the blog: Why it matters WALL-WM shifts robot world modeling from fixed-length action chunks to event-grounded video-action pretraining. It learns around events...

42,346 次观看 • 5 个月前 •via X (Twitter)

8 条评论

Junfan Zhu 朱俊帆 ✈️ IROS 的头像
Junfan Zhu 朱俊帆 ✈️ IROS5 个月前

Excited to have @XSquareRobot presenting a lightning talk on WALL-WM at @saturdayrobotic Research Night during @CVPR 2026 on June 6. Looking forward! 👉🏻

Ruili Feng 的头像
Ruili Feng5 个月前

A great work from the Team! Stay tuned!

RoboHub🤖 的头像
RoboHub🤖5 个月前

Huge congrats, two major open-source releases back to back is a serious statement for embodied AI 🎉🎉🎉

X Square Robot 的头像
X Square Robot5 个月前

Thank you! Really appreciate it. We see open source as the fastest way to move embodied AI forward, and this week is just the beginning. More to share soon.

Skaltek 的头像
Skaltek5 个月前

The useful signal is not just “robot world model,” it is the packaging: open weights/code plus explicit event/action boundaries. Embodied AI needs reproducible eval surfaces before teams can tell progress from demo polish.

AIKeaton UK 的头像
AIKeaton UK5 个月前

This is the interesting bit for me. Modelling around contact, grasp, lift etc feels much closer to how real manipulation actually breaks down.

Nurvai - The Data Layer for Physical AI 的头像
Nurvai - The Data Layer for Physical AI5 个月前

Interesting shift away from fixed action chunks toward event centered modeling. Feels more aligned with how manipulation actually unfolds through contact, grasp, and transition points. Do you think event grounded representations generalize better to long horizon tasks?

gzrer 的头像
gzrer5 个月前

great job!

相关视频

Chinese robotics company Astribot released their latest World-Action Model (WAM), Lumo-2. Technical breakdown: - based on a frozen 🥶 Qwen-3.5 4B VLM - trained in 3 progressive stages: 1. Action is aligned with latent world dynamics (an abstract representation of action). Real-world actions are anchored to physical constraints, while the latent space is guided to focus on motion-relevant changes. This bidirectional relationship makes the model physically grounded -> critical for a world model. 2. Action is aligned with vision and language. Reusing the vision backbone and action encoder from the frozen VLM, the authors add a custom vocabulary (for new actions), a semantic module, an action decoder, and an action projector. This aligns the (new) action representations with the (existing) vision-language semantic space. Most importantly: it builds a direct mapping from natural-language instructions to motor execution. 3. End-to-end training on language, video, and robot data. Only the new modules (everything outside the frozen backbone) are trained end-to-end across temporal reasoning, physical understanding, long-horizon, and dexterous manipulation. At the end of the day, Lumo-2 is not the best on benchmarks, but that's not the point. What's genuinely new: - a way to combine latent world modeling and action generation through progressive alignment - a physically-grounded latent dynamics space - it lifts performance on unseen objects using un-annotated human egocentric video + Vision Pro captures, no special transfer algorithm needed Why it matters: - the whole model is thin trainable adapters (semantic module, action decoder/projector) on a frozen 4B backbone (cheap) - that scale is suited for real-time embedded inference (~2.71× decode speedup, no accuracy loss) - its real moat is long-horizon execution, where the added temporal memory pays off far more than on any other task As a result, this robot can now make your latte (5x sped up video):

Léo

32,513 次观看 • 3 个月前

Introducing FLUX 3 Action. An open weights 7B World Action Model that achieves first place on the RoboLab benchmark. It outperforms the previous best open model by 6.1 percentage points while using 56% fewer parameters and running up to 3.95x faster.⁠⁠ FLUX 3 Action removes the usual trade-off between world action model performance and VLA speed: it still predicts video and actions together, but plans more than twice as far ahead and runs faster per second of robot motion than the strongest open VLA. Teams can fine-tune FLUX 3 Action on their own demonstrations to create policies for a particular robot and task. Together with NVIDIA, we also integrated FLUX 3 Action natively into Hugging Face's LeRobot, with fine-tuning recipes included and edge deployment on NVIDIA Jetson. Beyond robotics, we’re also seeing promising results training task-specific policies for acting in simulated environments like gaming, controlling a vehicle, computer use, and wherever else a model needs to understand a visual environment and then choose what to do next. FLUX 3 Action builds on the same image, video, and audio pretraining as FLUX 3, but uses a smaller architecture designed for practical deployment. In midtraining, we trained the model to predict actions and future frames together. We’re releasing the weights, code, fine-tuning recipe, benchmarks, and reproducible examples so researchers and developers can build on the model with their own robots, environments, and tasks (see below).

Black Forest Labs

182,671 次观看 • 1 个月前

X Square Robot just closed its Series C at a valuation above RMB 20 billion, about $2.8 billion 🤖 IDG came into this round. The bigger signal is the cap table. HongShan and Xiaomi were already in across earlier rounds, while Meituan, Alibaba, ByteDance, and Xiaomi have each led rounds at different stages. That puts X Square in a rare position for an embodied AI company: top-tier financial capital on one side, and four of China’s biggest tech platforms on the other. This is not just a money story. Meituan, Alibaba, ByteDance, and Xiaomi bring very different strategic assets: real-world scenarios, cloud infrastructure, consumer traffic, supply chains, and hardware ecosystems. The deployment side is already moving: robot home-cleaning services first, then a “Robots Into Homes” program with the first batch entering real households. The model stack is worth watching too. X Square has open-sourced WALL-OSS-0.5 for robot manipulation and WALL-WM for world modeling. WALL-OSS-0.5 showed strong real-robot performance without post-training, while WALL-WM uses event-level prediction to align language, vision, and action around meaningful physical-world events. They are also building a model-driven data pipeline for large-scale collection, cleaning, annotation, quality control, and augmentation. That matters because home robotics dies in the long tail: weird rooms, messy objects, bad lighting, and tasks that never look the same twice. Founded in 2023, X Square is building general-purpose embodied AI robots and foundation models for real-world environments, tying models, robot hardware, high-precision manipulation, data, and deployment into one system.

RoboHub🤖

12,975 次观看 • 4 个月前