Introduce CoT-VLA – Visual Chain-of-Thought reasoning for Robot Foundation... Models! 🤖 By leveraging next-frame prediction as visual chain-of-thought reasoning, CoT-VLA uses future prediction to guide action generation and unlock large-scale video data for training. #CVPR2025show more

Introducing Alpamayo 1.5. Based on community feedback, we’ve updated... our 10B-parameter chain-of-thought reasoning VLA model to be a more interactive and steerable engine for autonomous vehicle development. Built on the Cosmos-Reason2 VLM backbone, this release adds support for navigation guidance and flexible camera configurations while providing new post-training scripts for model adaptation. 🤗 Learn more:show more

Zero-shot video reasoning (chain-of-frames) isn’t just for Veo3 —... open-source models can understand and edit too! 🕹️ ChronoEdit brings temporal reasoning to image editing. 🔗show more

Current Vision-Language-Action (VLA) paradigms in autonomous driving primarily rely... on Imitation Learning (IL), which introduces inherent challenges such as distribution shift and causal confusion. Online Reinforcement Learning offers a promising pathway to address these issues through trial-and-error learning. However, applying online reinforcement learning to VLA models in autonomous driving is hindered by inefficient exploration in continuous action spaces. MindDrive, a VLA framework comprising a large language model (LLM) with two distinct sets of LoRA parameters. The one LLM serves as a Decision Expert for scenario reasoning and driving decision-making, while the other acts as an Action Expert that dynamically maps linguistic decisions into feasible trajectories. Paper Title: MindDrive: A Vision-Language-Action Model for Autonomous Driving via Project: Link:show more

Laika AI x Nuklai Excited to announce our partnership... with Nuklai Nuklai is an innovative data ecosystem that will fuel the next generation of AI and Large Language Models (LLMs). Together, we're revolutionizing on-chain data accessibility and monetization. By combining Laika AI's blockchain analytics with Nuklai's ecosystem, we're creating new opportunities for data utilization powered by $LKI.show more

🤖 NVIDIA’s Gr00t N1.5 is now available in LeRobot!... This is the result of a great collaboration between the Hugging Face LeRobot team and NVIDIA Robotics ! Gr00t N1.5 highlights: 🦾 Cross-embodiment foundation model for robots 🧠 Multimodal inputs: vision, language, and proprioception 🪛Tested on the Libero benchmark and real-world hardware tasks 🌍Trained on real robot, synthetic, and internet-scale video data ⚙️ Flow matching action transformer for action predictionshow more

[Most robots react. This one thinks a step ahead.]... Ant Group's Robbyant just published LingBot-VA 2.0 — a video-action foundation model built from scratch for robot control, not fine-tuned from a video generator. The usual approach takes a video generator made for content creation and bolts a robot policy onto it. LingBot-VA 2.0 argues that's the wrong starting point, and pretrains the whole causal stack natively instead. What stands out: → Foresight Reasoning — the robot predicts the next action chunk while executing the current one, then overwrites the imagined frame with the real observation. Prediction and execution stop waiting on each other. → 927 ms → 142 ms per chunk, across four cumulative optimizations. That lifts asynchronous control from 35 Hz to 225 Hz — a 6.5× speedup. → One shared latent space. A semantic visual-action tokenizer puts world states and actions in the same coordinates, so unlabeled web video carries action-relevant signal. → Sparse MoE video stream — 128 experts, top-8 routing. Roughly 2.5B of ~15.3B parameters fire per token. → Few-shot by design — adapts from 10–15 demonstrations, and a human demo video can replace the text instruction entirely. Full breakdown: Paper: Project Page: Robbyant Ant Groupshow more

How can we address the scarcity of data required... for specialized AI? Learn about Simula, a framework that reframes synthetic data generation as dataset-level mechanism design. By using reasoning to architect datasets from first principles, Simula enables fine-grained control over coverage, complexity, and quality. More →show more

𝗜'𝘃𝗲 𝗵𝗲𝗮𝗿𝗱 𝘁𝗵𝗶𝘀 𝗮 𝗹𝗼𝘁 𝗿𝗲𝗰𝗲𝗻𝘁𝗹𝘆: "𝗪𝗲 𝘁𝗿𝗮𝗶𝗻𝗲𝗱 𝗼𝘂𝗿... 𝗿𝗼𝗯𝗼𝘁 𝗼𝗻 𝗼𝗻𝗲 𝗼𝗯𝗷𝗲𝗰𝘁 𝗮𝗻𝗱 𝗶𝘁 𝗴𝗲𝗻𝗲𝗿𝗮𝗹𝗶𝘀𝗲𝗱 𝘁𝗼 𝗮 𝗻𝗼𝘃𝗲𝗹 𝗼𝗯𝗷𝗲𝗰𝘁 - 𝘁𝗵𝗲𝘀𝗲 𝗻𝗲𝘄 𝗩𝗟𝗔 𝗺𝗼𝗱𝗲𝗹𝘀 𝗮𝗿𝗲 𝗰𝗿𝗮𝘇𝘆!" Let's talk about what's actually happening in that "A" (Action) part of your VLA model. The Vision and Language components? They're incredible. Pre-trained on internet-scale data, they understand objects, spatial relationships, and task instructions better than ever. But the Action component? That's still learned from scratch on your specific robot demonstrations. 𝗛𝗲𝗿𝗲'𝘀 𝘁𝗵𝗲 𝗿𝗲𝗮𝗹𝗶𝘁𝘆: Your VLA model has internet-scale understanding of what a screwdriver looks like and what "tighten the screw" means. But the actual motor pattern for "rotating wrist while applying downward pressure"? That comes from your 500 robot demos. 𝗪𝗵𝗮𝘁 𝘁𝗵𝗶𝘀 𝗺𝗲𝗮𝗻𝘀 𝗳𝗼𝗿 "𝗴𝗲𝗻𝗲𝗿𝗮𝗹𝗶𝘀𝗮𝘁𝗶𝗼𝗻": • 𝗩𝗶𝘀𝗶𝗼𝗻 𝗴𝗲𝗻𝗲𝗿𝗮𝗹𝗶𝘀𝗮𝘁𝗶𝗼𝗻: Recognises novel objects instantly (thanks to pre-training) • 𝗟𝗮𝗻𝗴𝘂𝗮𝗴𝗲 𝗴𝗲𝗻𝗲𝗿𝗮𝗹𝗶𝘀𝗮𝘁𝗶𝗼𝗻: Understands new task instructions (thanks to pre-training) • 𝗔𝗰𝘁𝗶𝗼𝗻 𝗴𝗲𝗻𝗲𝗿𝗮𝗹𝗶𝘀𝗮𝘁𝗶𝗼𝗻: Still limited to motor patterns seen during robot training Ask that same robot to "unscrew the bottle cap" and it fails because: • Vision: Recognises bottle and cap • Language: Understands "unscrew" • Action: Never learned the "twist while pulling" motor pattern 𝗧𝗵𝗲 𝗵𝗮𝗿𝗱 𝘁𝗿𝘂𝘁𝗵 𝗮𝗯𝗼𝘂𝘁 𝗩𝗟𝗔 𝗺𝗼𝗱𝗲𝗹𝘀: The "VL" gives you incredible zero-shot understanding. The "A" still requires task-specific demonstrations. We've cracked the perception and reasoning problem. We haven't cracked the motor generalisation problem.show more

Collective agent compute, on-demand for your task. A swarm... of agents coordinate in a shared workspace, run their own models and inference, and submit the finished work back to you. Unbounded by provider caps, throughput scales with the swarm. Self-assembly with specialists, agents reason and collaborate in artifact-first reasoning traces, and settle on-chain. The coordination substrate for collective intelligence.show more

Show-o One Single Transformer to Unify Multimodal Understanding and... Generation discuss: We present a unified transformer, i.e., Show-o, that unifies multimodal understanding and generation. Unlike fully autoregressive models, Show-o unifies autoregressive and (discrete) diffusion modeling to adaptively handle inputs and outputs of various and mixed modalities. The unified model flexibly supports a wide range of vision-language tasks including visual question-answering, text-to-image generation, text-guided inpainting/extrapolation, and mixed-modality generation. Across various benchmarks, it demonstrates comparable or superior performance to existing individual models with an equivalent or larger number of parameters tailored for understanding or generation. This significantly highlights its potential as a next-generation foundation model.show more

📢 Our lab has been exploring 3D world models... for years — and we’re thrilled to share **PhysTwin**: a milestone that reconstructs object appearance, geometry, and dynamics from just a few seconds of interaction! Led by the amazing Hanxiao Jiang 👉 PhysTwin combines **Gaussian splatting** with **inverse dynamics optimization** based on simple **spring-mass** systems. ⚙️ The result? Real-time, action-conditioned 3D video prediction under novel interactions (i.e., 3D world models). 🔑 A few key takeaways: 1. Having the right structure (e.g., particles/masses) helps navigate the trade-off between sample efficiency, generalization, and broad applicability. 2. Visual foundation models (VFMs) have matured to the point where they can provide rich supervision for world modeling (e.g., tracking, shape completion). 3. Beyond VFMs, many crucial components have come together in recent years: Gaussian splats for rendering, NVIDIA Warp for high-performance simulation, and scene/asset generation from a wide range of labs and companies. The future of 3D world models is looking bright! ✨ 4. The resulting digital twin supports a wide range of downstream applications—especially in data generation and policy evaluation, thanks to its realistic rendering and simulation capabilities. 🎥 All code and data to reproduce the results, along with interactive demos, are available on the website. Check the following visualizations of: (1) observations, (2) reconstructed state/actions, (3) interactive digital twins, and (4) the overlays between real-world robot teleoperation and our model’s open-loop predictions.show more

Announcing our $320M Series A at a $2.3B valuation,... led by Khosla Ventures, with General Catalyst, Eric Schmidt and Jeff Bezos. General Intuition is the frontier lab for acting in space and time. We build large action foundation models trained on billions of ground truth action-labeled gameplay clips from 17M monthly active users on Medal, and push the frontier of world models to generate infinite training environments.show more

GPT Image 2 + Seedance 2.0 - Prompt Share... Created on @MartiniArt_ Created the character in Midjourney, then built the storyboard around that character. This time I used a more detailed video prompt, but I wasn't describing the sequence shot-by-shot. The storyboard acted more as a visual guide for the action flow, camera language and overall narrative than as a strict frame-by-frame blueprint. Looking at the result, the model seems to preserve the key beats, escalation and composition of the storyboard while freely interpreting the transitions between them.show more

Generalist AI unveiled GEN-0, an embodied foundation model family... that hits a 7B-parameter “intelligence threshold”; small models ossify, larger ones keep improving, and is trained on 270,000+ hours of real-world manipulation data growing by ~10,000 hours/week. It introduces Harmonic Reasoning (think+act in continuous time), shows predictable scaling laws, runs across 6–16+ DoF robots, and an infra stack that ingests the equivalent of 6.85 years of experience per training day, promising faster adaptation with less post-training for factories, logistics, and service workflows.show more

fastUSD has officially launched on Sei, bringing a new... era of liquidity to the fastest blockchain. Powered by Elixir, fastUSD is a yield-bearing stablecoin integrated with DRAGONDEX, jellyverse, to start. These integrations set the foundation for a wide range of DeFi applications, offering greater composability and liquidity provisioning for Sei’s DEXs. Cross-chain capabilities are enabled through Hyperlane ⏩, ensuring seamless asset transfers, while RedStone ♦️ oracle secures data feeds, enhancing fastUSD’s reliability and security. As the next-generation stable asset for Sei, fastUSD is poised to play a pivotal role in the continued growth of DeFi within the ecosystem.show more

I am thrilled to join Rhoda AI as an... advisor, where I am helping harness the abilities of large-scale pre-training and video models for robotics, putting many of my lab's research learnings of the past few years into practice! I will be in-person at the Mountain View office for part of the summer - reach out if you want to chat :)show more

30 minutes of video. Robot learns the task. Open-source,... end-to-end. An open-source framework for training robot policies from only 30 minutes of human egocentric videos captured via Meta Aria glasses: Achieving zero-shot transfer to robots without any robot data collection. The method relies on Interaction-Centric Tokens that encode hand-object spatial relationships invariant to embodiment and viewpoint, supplemented by auxiliary objectives like object motion prediction and latent consistency to extract richer supervision signals from the same data. HumanEgo demonstrates strong cross-embodiment, cross-environment performance on bimanual tasks, outperforming baselines like ACT and teleop data while being trainable on a single RTX 4090 GPU. Thanks for sharing, Zhi (Leo) Wang. 📌 Website: Paper: Code: Video: ——- Weekly robotics and AI insights. Subscribe free:show more

Exciting news from HYPE3.cool! We’re teaming up with Chainbase... (💜,💛), the world’s largest omnichain data network to supercharge AI agents with robust on-chain data. Very soon, users will be able to integrate real-time blockchain insights when configuring their agents—making them smarter and more capable than ever! What this means: - Real-time on-chain data for enhanced decision-making - Greater agent intelligence powered by advanced data analytics - Seamless blockchain integration backed by Chainbase (💜,💛)’s decentralized infrastructure About Chainbase: Chainbase is the world’s largest omnichain data network built to power the AI economy with high-quality on-chain data. Through its innovative four-layer, dual-consensus architecture, Chainbase’s network, anchored by Chainbase AVS, provides secure, interoperable data for AI and Web3. Your AI agents can now tap into rich, reliable on-chain insights—paving the way for more dynamic and intelligent interactions. This is just the start of making AI agents truly Web3-native. Stay tuned as we build the future of intelligent property in partnership with Chainbase (💜,💛)! #Web3 #AI #Blockchainshow more

Tokenization is quickly becoming one of the most talked-about... ideas in crypto. This year we’re aiming much higher. We don’t just want to tokenize miner revenue; we want to bring entire productive ecosystems on-chain. That means tokenizing baskets of assets, real energy infrastructure, AI agents, compute power, data centres, and even the cooling systems that keep high-performance hardware running at scale. All of it connected and interoperable with DeFi. Thats what we have been building throughout. A single on-chain framework that unlocks something genuinely powerful: real ownership, real yield, and real coordination between digital and physical infrastructure. From backend systems and front-end interfaces to smart contracts, AI, physical infrastructure, oracles, and autonomous agents, the stack keeps expanding and compounding. It’s about building the foundation for how value will be owned, deployed, and earned in the next generation of the on-chain economy. Simplified by PinLink.show more