正在加载视频...

视频加载失败

While Anthropic and OpenAI race on AI Agents/LLMs, Mistral continues expanding its footprint in physical AI. They just released Robostral Navigate (8B VLA model). It shows strong potential in delivery, logistics, manufacturing, and hospitality--for example, enabling humanoid robots to autonomously navigate multiple rooms to hand a glass of water...

10,704 次观看 • 6 天前 •via X (Twitter)

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Mistral AI Releases Robostral Navigate: An 8B Model Enabling Robots to Navigate Complex Environments Hitting 76.6% on R2R-CE With One RGB Camera. No LiDAR. No depth sensor. No multi-camera rig. Here's how it works. 👇 1. Pointing, not metric commands The model predicts the pixel coordinates of the next target in the camera view, plus the arrival orientation. Working in pixel space keeps it robust to camera intrinsics and world scale. When the target leaves the frame, it falls back to local displacements ("2m forward, 1.5m left, turn 25°"). 2. Grounding-first No open-source VLM base. It starts from Mistral's grounding model (pointing, counting, localization). Navigation emerges once the model knows where things are. → ~400,000 trajectories across 6,000 simulated scenes 3. Prefix-caching for training A tree-based attention mask packs a full episode into one sequence — all time steps in a single forward pass. → 22× fewer training tokens; months of training done in days 4. Online RL on top After supervised training, CISPO adds trial-and-error learning to fight distribution shift from behavior cloning. → +3.2% success rate from RL alone 5. The numbers (R2R-CE, Matterport3D) → 76.6% success on validation unseen → +9.7 pts over best single-camera approach → +4.5 pts over best depth/multi-camera system The key takeaway: state-of-the-art continuous VLN without a sensor stack — grounding-init, pixel-space actions, prefix-cached SFT, and online RL, on one RGB camera. Full analysis: Technical details: Mistral AI Mistral AI for Developers

Marktechpost AI

39,955 次观看 • 4 天前

Excited to announce GR00T N1, the world’s first open foundation model for humanoid robots! We are on a mission to democratize Physical AI. The power of general robot brain, in the palm of your hand - with only 2B parameters, N1 learns from the most diverse physical action dataset ever compiled and punches above its weight: - Real humanoid teleoperation data. - Large-scale simulation data: we are open-sourcing 300K+ trajectories! - Neural trajectories: we apply SOTA video generation models to “hallucinate” new synthetic data that features accurate physics in pixels. Using Jensen’s words, “systematically infinite data”! - Latent actions: we develop novel algorithms to extract action tokens from in-the-wild human videos and neural generated videos. GR00T N1 is a single end-to-end neural net, from photons to actions: - Vision-Language Model (System 2) that interprets the physical world through vision and language instructions, enabling robots to reason about their environment and instructions, and plan the right actions. - Diffusion Transformer (System 1) that “renders” smooth and precise motor actions at 120 Hz, executing the latent plan made by System 2. We deploy N1 on GR1 robot, 1X Neo robot, and a large collection of simulation benchmarks. N1 achieves up to +30% boost in diverse manipulation tasks for household and industrial settings. While humanoid robots are the main focus of N1, our model also supports cross-embodiment. We finetune it to work on the $110 HuggingFace LeRobot SO100 robot arm! Open robot brain runs on open hardware. Sounds just right. Let’s solve robotics, together, one token at a time. Links to our Whitepaper, Github repo, HuggingFace model, and open dataset page in the thread: 🧵

Jim Fan

465,968 次观看 • 1 年前

Japan Just Built a HouseBot You Control Without Speaking and It Changes Everything! Donut Robotics has officially unveiled its first bipedal humanoid, Cinnamon 1, and instead of focusing on louder voices or bigger motors, the company went in the opposite direction. Silence. Cinnamon 1 introduces what Donut Robotics calls Silent Gesture Control, a system that allows the humanoid to be guided using simple hand and finger movements rather than spoken commands. This approach feels especially well suited for real world environments where traditional voice control falls apart. Busy factory floors. Construction sites filled with constant noise. Even quiet indoor settings where voice commands feel awkward or intrusive. It also opens the door for far more accessible human robot interaction, particularly for users with impairments. While the current Cinnamon 1 hardware is built on an OEM platform, the intelligence driving it is where Donut Robotics is placing its long term bet. The team is actively developing custom Vision Language Action AI that allows the robot to interpret what it sees, understand intent, and respond with physical action. The goal is not just smarter robots, but robots that feel more natural. Even more ambitious is the company’s plan for full domestic production. Donut Robotics has stated its intention to localize both manufacturing and AI development in Japan, reinforcing the country’s reputation for precision engineering and thoughtful robotics design. If timelines hold, Cinnamon 1 units are expected to begin deployment in factories and construction environments by the end of 2026. That puts this humanoid squarely in the category of near term reality rather than distant concept. The takeaway is simple but important. As humanoid robots move out of labs and into daily work environments, the winners may not be the loudest or flashiest machines. They may be the ones that understand us without a word being spoken.

The AI Robot Guy on X

257,928 次观看 • 5 个月前