Загрузка видео...

Не удалось загрузить видео

На главную

Working on a new topic and hardware for a while: Feet Language Action models. VLAs teach robots to act through vision and language FLAs teach legged robots to act through contact Given a task, terrain, body state, and instruction - decide where, when, and how to make contact

irvinxyz's profile picture

Irvin (in Japan 🇯🇵)

16,454 subscribers

14,004 просмотров • 2 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Travis Hunter Run Blocking Teach Tape 🎥 • Runs feet through contact • Fights to get hands inside • Understands where run is going and positions himself accordingly
0:14

Travis Hunter Run Blocking Teach Tape 🎥 • Runs feet through contact • Fights to get hands inside • Understands where run is going and positions himself accordingly

Jake Franklin Football

663,431 просмотров • 11 месяцев назад

Introducing ✨ Aya Vision ✨ - an open-weights model to connect our world through language and vision Aya Vision adds breakthrough multimodal capabilities to our state-of-the-art multilingual 8B and 32B models. 🌿
0:13

Introducing ✨ Aya Vision ✨ - an open-weights model to connect our world through language and vision Aya Vision adds breakthrough multimodal capabilities to our state-of-the-art multilingual 8B and 32B models. 🌿

Cohere Labs

206,877 просмотров • 1 год назад

Qualia has been selected for the Google DeepMind Robotics Program. We train embodied models that put a robot on a real manual task and make it work, on the floor, not in a demo. Foundation models and reasoning are where robotics is heading, and doing that work alongside DeepMind, who are pushing this frontier, is exactly where we want to be. If you are a company looking to see how a new generation of robots can help your manual tasks, contact us at hello@qualiastudios.dev More soon
0:16

Qualia has been selected for the Google DeepMind Robotics Program. We train embodied models that put a robot on a real manual task and make it work, on the floor, not in a demo. Foundation models and reasoning are where robotics is heading, and doing that work alongside DeepMind, who are pushing this frontier, is exactly where we want to be. If you are a company looking to see how a new generation of robots can help your manual tasks, contact us at [email protected] More soon

Qualia

87,991 просмотров • 3 месяцев назад

Selvaggia and Daniela met around five years ago on an Ersties shoot, and now they’re back together to teach us the science of flirting 🤭🔥 The two girls discuss the green and red flags; from eye contact, question asking and body language, there’s a lot to dissect from the art of seduction 🥰💕 Watch here! ➡️
0:14

Selvaggia and Daniela met around five years ago on an Ersties shoot, and now they’re back together to teach us the science of flirting 🤭🔥 The two girls discuss the green and red flags; from eye contact, question asking and body language, there’s a lot to dissect from the art of seduction 🥰💕 Watch here! ➡️

The Ersties Spot ✨

23,159 просмотров • 11 месяцев назад

gemini: teach me how to fly using mediapipe computer vision and threejs to make a first-person flappy bird game
0:17

gemini: teach me how to fly using mediapipe computer vision and threejs to make a first-person flappy bird game

AA

40,130 просмотров • 9 месяцев назад

How can we leverage diverse human videos to improve robot manipulation? Excited to introduce EgoVLA — a Vision-Language-Action model trained on egocentric human videos by explicitly modeling wrist & hand motion. We build a shared action space between humans and robots, enabling seamless transfer. With some robot demos, EgoVLA becomes a powerful, generalizable robot policy.
0:14

How can we leverage diverse human videos to improve robot manipulation? Excited to introduce EgoVLA — a Vision-Language-Action model trained on egocentric human videos by explicitly modeling wrist & hand motion. We build a shared action space between humans and robots, enabling seamless transfer. With some robot demos, EgoVLA becomes a powerful, generalizable robot policy.

Ruihan Yang

58,854 просмотров • 1 год назад

A new Science Robotics study highlights a reinforcement learning-based, zero-shot approach that uses motion capture and animation to train humanoid and four-legged robots to perform acrobatics.
0:12

A new Science Robotics study highlights a reinforcement learning-based, zero-shot approach that uses motion capture and animation to train humanoid and four-legged robots to perform acrobatics.

Science Magazine

56,242 просмотров • 8 дней назад

This #CVPR2026 paper from our research team is trending #1 on Hugging Face 🤗 Meet LocateAnything: a vision-language detection model that rethinks bounding box prediction. For AI agents and robots, “seeing” is only useful if a model can pinpoint where something is fast enough to act. Trained on 138M high-quality samples, LocateAnything decodes bounding boxes in parallel instead of one coordinate at a time, improving localization accuracy while dramatically increasing throughput for visual grounding and detection. Project page:
0:16

This #CVPR2026 paper from our research team is trending #1 on Hugging Face 🤗 Meet LocateAnything: a vision-language detection model that rethinks bounding box prediction. For AI agents and robots, “seeing” is only useful if a model can pinpoint where something is fast enough to act. Trained on 138M high-quality samples, LocateAnything decodes bounding boxes in parallel instead of one coordinate at a time, improving localization accuracy while dramatically increasing throughput for visual grounding and detection. Project page:

NVIDIA AI

341,322 просмотров • 3 месяцев назад

A Gaussian Splat can become a world where Robots and AI agents can act. In our latest OVER Research experiment, we placed a robot inside a real-world 3D capture, with a VLM making decisions based on what it sees. At every step, the robot holds a pose in the reconstruction, gets a newly rendered view of the environment, takes an action, moves, and sees the world again from its new position. Why does this matter? Because 3D captures can become more than reconstructions to explore. They can become environments where embodied AI and robots can navigate, act, be evaluated and eventually train across real-world spaces at scale. Capture a place once. Then turn it into a world where AI and Robots can act. The full experiment, including what we discovered once we actually put the loop to the test:
0:14

A Gaussian Splat can become a world where Robots and AI agents can act. In our latest OVER Research experiment, we placed a robot inside a real-world 3D capture, with a VLM making decisions based on what it sees. At every step, the robot holds a pose in the reconstruction, gets a newly rendered view of the environment, takes an action, moves, and sees the world again from its new position. Why does this matter? Because 3D captures can become more than reconstructions to explore. They can become environments where embodied AI and robots can navigate, act, be evaluated and eventually train across real-world spaces at scale. Capture a place once. Then turn it into a world where AI and Robots can act. The full experiment, including what we discovered once we actually put the loop to the test:

Over the Reality 🌐

14,975 просмотров • 17 дней назад

Current Vision-Language-Action (VLA) paradigms in autonomous driving primarily rely on Imitation Learning (IL), which introduces inherent challenges such as distribution shift and causal confusion. Online Reinforcement Learning offers a promising pathway to address these issues through trial-and-error learning. However, applying online reinforcement learning to VLA models in autonomous driving is hindered by inefficient exploration in continuous action spaces. MindDrive, a VLA framework comprising a large language model (LLM) with two distinct sets of LoRA parameters. The one LLM serves as a Decision Expert for scenario reasoning and driving decision-making, while the other acts as an Action Expert that dynamically maps linguistic decisions into feasible trajectories. Paper Title: MindDrive: A Vision-Language-Action Model for Autonomous Driving via Project: Link:
0:12

Current Vision-Language-Action (VLA) paradigms in autonomous driving primarily rely on Imitation Learning (IL), which introduces inherent challenges such as distribution shift and causal confusion. Online Reinforcement Learning offers a promising pathway to address these issues through trial-and-error learning. However, applying online reinforcement learning to VLA models in autonomous driving is hindered by inefficient exploration in continuous action spaces. MindDrive, a VLA framework comprising a large language model (LLM) with two distinct sets of LoRA parameters. The one LLM serves as a Decision Expert for scenario reasoning and driving decision-making, while the other acts as an Action Expert that dynamically maps linguistic decisions into feasible trajectories. Paper Title: MindDrive: A Vision-Language-Action Model for Autonomous Driving via Project: Link:

AI Bites | YouTube Channel

43,496 просмотров • 7 месяцев назад

During missions in The Expanse: Osiris Reborn, you'll be pulled into constant action where focus and ability to act without hesitation make all the difference. Sometimes you'll have only a moment to decide, and it will determine how everything ends. Ready to test yourself?
0:11

During missions in The Expanse: Osiris Reborn, you'll be pulled into constant action where focus and ability to act without hesitation make all the difference. Sometimes you'll have only a moment to decide, and it will determine how everything ends. Ready to test yourself?

The Expanse: Osiris Reborn

34,934 просмотров • 6 месяцев назад

🤖 NVIDIA’s Gr00t N1.5 is now available in LeRobot! This is the result of a great collaboration between the Hugging Face LeRobot team and NVIDIA Robotics ! Gr00t N1.5 highlights: 🦾 Cross-embodiment foundation model for robots 🧠 Multimodal inputs: vision, language, and proprioception 🪛Tested on the Libero benchmark and real-world hardware tasks 🌍Trained on real robot, synthetic, and internet-scale video data ⚙️ Flow matching action transformer for action prediction
0:17

🤖 NVIDIA’s Gr00t N1.5 is now available in LeRobot! This is the result of a great collaboration between the Hugging Face LeRobot team and NVIDIA Robotics ! Gr00t N1.5 highlights: 🦾 Cross-embodiment foundation model for robots 🧠 Multimodal inputs: vision, language, and proprioception 🪛Tested on the Libero benchmark and real-world hardware tasks 🌍Trained on real robot, synthetic, and internet-scale video data ⚙️ Flow matching action transformer for action prediction

LeRobot

115,194 просмотров • 11 месяцев назад

Yesterday, I visited a student learning camp to teach young boys and girls how to shake hands confidently, greet respectfully, maintain eye contact, and carry themselves with composure. I also spoke to them about the importance of time management in today's highly distracting world. Simple lessons that open big doors. We are building great men and women for Africa through faith, discipline, and character.
0:13

Yesterday, I visited a student learning camp to teach young boys and girls how to shake hands confidently, greet respectfully, maintain eye contact, and carry themselves with composure. I also spoke to them about the importance of time management in today's highly distracting world. Simple lessons that open big doors. We are building great men and women for Africa through faith, discipline, and character.

Alex Onyia

15,613 просмотров • 3 месяцев назад

Wishlist our new game Catechesis and let a demon teach you how to play baseball.
0:10

Wishlist our new game Catechesis and let a demon teach you how to play baseball.

Wishlist our new game: Catechesis

21,853 просмотров • 1 месяц назад

Beginning a series called How to Edit: for language and for life, from my experience as an Indian journalist. I talk about editing basics through the lens of how we experience and live life
0:18

Beginning a series called How to Edit: for language and for life, from my experience as an Indian journalist. I talk about editing basics through the lens of how we experience and live life

Sunalini Mathew

10,734 просмотров • 2 лет назад

Rare-event discovery for robots training is what we’ve been working on lately How would a robot react to an unusual event? What if a firefighter drone won’t be able to choke a fire (like on the video below)? Robo-doctors use cases? How to mass-produce these situations to train robots to see & react the best way? I think that open-sourced, world models like LTX can become the solution for such training process. And they might become the differentiator for the future of robotics. Of course, I’m not an expert in robotics and ML, but this topic makes me curious - and I’m curious about your thoughts
0:10

Rare-event discovery for robots training is what we’ve been working on lately How would a robot react to an unusual event? What if a firefighter drone won’t be able to choke a fire (like on the video below)? Robo-doctors use cases? How to mass-produce these situations to train robots to see & react the best way? I think that open-sourced, world models like LTX can become the solution for such training process. And they might become the differentiator for the future of robotics. Of course, I’m not an expert in robotics and ML, but this topic makes me curious - and I’m curious about your thoughts

AmirMušić

41,839 просмотров • 1 месяц назад

and it works on hardware, inference on a macbook m3 pro. also great at handling highly precise placement / drop thanks to dense patch features solves the task more efficiently that ACT and diffusion.
0:12

and it works on hardware, inference on a macbook m3 pro. also great at handling highly precise placement / drop thanks to dense patch features solves the task more efficiently that ACT and diffusion.

atharva ☆

12,785 просмотров • 1 месяц назад

How can we responsibly deploy agentic AI robots in real-world environments? As we close the gap between AI reasoning and physical action, developing a new safety framework is key to advancing helpful robots. 🤖
0:13

How can we responsibly deploy agentic AI robots in real-world environments? As we close the gap between AI reasoning and physical action, developing a new safety framework is key to advancing helpful robots. 🤖

Google DeepMind

47,887 просмотров • 11 месяцев назад

Converting video models ➡️ ego-centric world models capable of humanoids manipulating objects, robots navigating through paintings, and beyond! Huge effort led by Anurag Bagchi over a year! Special thanks to 1X for releasing so much data!
0:12

Converting video models ➡️ ego-centric world models capable of humanoids manipulating objects, robots navigating through paintings, and beyond! Huge effort led by Anurag Bagchi over a year! Special thanks to 1X for releasing so much data!

Homanga Bharadhwaj

10,478 просмотров • 7 месяцев назад