Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Most robotics AI models suffer from the "stop-and-think" problem. They take a static picture, pause to reason, execute an action, and repeat. In the real world, that latency causes spills, collisions, and failed tasks. Google DeepMind just launched Gemini Robotics ER 2: an embodied reasoning model that thinks and...

kweinmeister's profile picture

Karl Weinmeister

2,086 subscribers

26,179 Aufrufe • vor 1 Tag •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

For decades, we’ve dreamed of robots that can seamlessly step into our world and lend a hand. Today, we take a major stride toward making that dream a reality: Introducing Gemini Robotics 2 from Google DeepMind, the intelligence layer powering the next generation of truly adaptable robots. This major advance unlocks intelligent whole-body control, advanced dexterity, and even multi-robot collaboration 🤯. Ok but... how does a robot actually "think"? Real-world tasks take time and planning. To manage that complexity, our new embodied reasoning model, Gemini Robotics ER 2, acts as the robot’s high-level brain, enhancing the robot’s capabilities to: — Observe the environment — Reason about the actions needed to complete the task — Coordinate with the vision-language-action model to carry out actions — Track progress until the job is done This setup allows robots to execute complex multi-step workflows, self-correct if a step fails, and adapt to completely novel situations. Learn more about Gemini Robotics ER 2 (and our two other brand new models) here:
2:16

For decades, we’ve dreamed of robots that can seamlessly step into our world and lend a hand. Today, we take a major stride toward making that dream a reality: Introducing Gemini Robotics 2 from Google DeepMind, the intelligence layer powering the next generation of truly adaptable robots. This major advance unlocks intelligent whole-body control, advanced dexterity, and even multi-robot collaboration 🤯. Ok but... how does a robot actually "think"? Real-world tasks take time and planning. To manage that complexity, our new embodied reasoning model, Gemini Robotics ER 2, acts as the robot’s high-level brain, enhancing the robot’s capabilities to: — Observe the environment — Reason about the actions needed to complete the task — Coordinate with the vision-language-action model to carry out actions — Track progress until the job is done This setup allows robots to execute complex multi-step workflows, self-correct if a step fails, and adapt to completely novel situations. Learn more about Gemini Robotics ER 2 (and our two other brand new models) here:

Google AI

333,073 Aufrufe • vor 1 Tag

Sundar Pichai on the robotics opportunity: ⦿ He's impressed by recent humanoid progress - so much so that he sometimes has to look closely to tell if a robot video is real or fake. ⦿ Google initially moved too early into the application layer, but now sees the combination of AI and robotics as the “sweet spot.” ⦿ He believes we’re 2–3 years away from a “magical moment” in robotics. ⦿ Google is working on playing a role similar to Android in robotics - one of its internal bets is already focused on supporting robotics manufacturers. ⦿ Gemini robotics models will work very well - how to productize them is still an open question at the company.
2:43

Sundar Pichai on the robotics opportunity: ⦿ He's impressed by recent humanoid progress - so much so that he sometimes has to look closely to tell if a robot video is real or fake. ⦿ Google initially moved too early into the application layer, but now sees the combination of AI and robotics as the “sweet spot.” ⦿ He believes we’re 2–3 years away from a “magical moment” in robotics. ⦿ Google is working on playing a role similar to Android in robotics - one of its internal bets is already focused on supporting robotics manufacturers. ⦿ Gemini robotics models will work very well - how to productize them is still an open question at the company.

The Humanoid Hub

87,088 Aufrufe • vor 1 Jahr

Not the flashiest demos, but what’s under the hood represents a foundational shift for general-purpose robotics. World models are the next-gen foundation of Physical AI, not the VLM backbones found in typical VLAs. DreamZero is a 14B-parameter World Action Model (WAM) by NVIDIA that treats robotics as a joint video-and-action prediction task. Unlike traditional Vision-Language-Action (VLA) models that map images directly to motor commands, DreamZero leverages a pretrained video diffusion backbone to predict future world states and actions simultaneously. - achieves 2× better zero-shot generalization to unseen tasks and environments compared to state-of-the-art VLAs. - learns effectively from heterogeneous, non-repetitive data (500 hours), breaking the need for thousands of repeated demonstrations. - adapts to new robot embodiments with just 30 minutes of play data. - enables 7Hz closed-loop control via system optimizations and "DreamZero-Flash," making high-capacity diffusion models viable for real-time use.
1:01

Not the flashiest demos, but what’s under the hood represents a foundational shift for general-purpose robotics. World models are the next-gen foundation of Physical AI, not the VLM backbones found in typical VLAs. DreamZero is a 14B-parameter World Action Model (WAM) by NVIDIA that treats robotics as a joint video-and-action prediction task. Unlike traditional Vision-Language-Action (VLA) models that map images directly to motor commands, DreamZero leverages a pretrained video diffusion backbone to predict future world states and actions simultaneously. - achieves 2× better zero-shot generalization to unseen tasks and environments compared to state-of-the-art VLAs. - learns effectively from heterogeneous, non-repetitive data (500 hours), breaking the need for thousands of repeated demonstrations. - adapts to new robot embodiments with just 30 minutes of play data. - enables 7Hz closed-loop control via system optimizations and "DreamZero-Flash," making high-capacity diffusion models viable for real-time use.

The Humanoid Hub

35,204 Aufrufe • vor 5 Monaten

China-based TARS Robotics demonstrated a humanoid robot performing two-handed hand embroidery during a public showcase on December 22, marking a notable step in fine motor control for humanoid systems. The robot threaded a needle and stitched a logo using both hands with sub-millimeter accuracy, working with soft, flexible materials that are difficult for traditional industrial robots to handle due to deformation and variability. According to the company, this capability is enabled by a closed-loop "Data-Al-Physics" system that connects real-world data collection, embodied Al models, and physical execution, reducing the gap between simulation and real deployment. The models are said to be open source when released. Founded in February 2025, TARS Robotics has moved quickly from research to live demonstrations and has raised over $240 million in early funding from the Chinese government, reflecting growing interest in general-purpose humanoid robots for precision and dexterous tasks.
0:58

China-based TARS Robotics demonstrated a humanoid robot performing two-handed hand embroidery during a public showcase on December 22, marking a notable step in fine motor control for humanoid systems. The robot threaded a needle and stitched a logo using both hands with sub-millimeter accuracy, working with soft, flexible materials that are difficult for traditional industrial robots to handle due to deformation and variability. According to the company, this capability is enabled by a closed-loop "Data-Al-Physics" system that connects real-world data collection, embodied Al models, and physical execution, reducing the gap between simulation and real deployment. The models are said to be open source when released. Founded in February 2025, TARS Robotics has moved quickly from research to live demonstrations and has raised over $240 million in early funding from the Chinese government, reflecting growing interest in general-purpose humanoid robots for precision and dexterous tasks.

Brian Roemmele

82,611 Aufrufe • vor 7 Monaten

My conversation with Sergey Levine (Sergey Levine). Sergey is the co-founder of Physical Intelligence -- a company building foundation models that can control any robot to do any task in any environment. The company's thesis is that generality is more scalable than specialization, meaning that a model trained across many different robots and tasks will ultimately outperform any system built to do one thing well (eg, just wash dishes). Sergey is a researcher by background, but I think you will appreciate how practical and commercially grounded this conversation is. We discuss: - Why changing a diaper will be the last task a robot masters - The simulation v. real-world data debate - How multimodal LLMs give robots common sense - Moravec's Paradox + Robot Olympics - Why robots can do long-horizon tasks now - A realistic timeline for robots in our homes I should note that I am an investor in Physical Intelligence -- I made the investment because I believe it is one of the most important companies tackling the problem of robotics. Enjoy! Timestamps: 0:00 Intro 2:39 Defining Physical Intelligence 5:19 The Challenge of Building General Models 6:34 The Stakes and Future of General Purpose Robotics 8:15 Pros and Cons of Humanoid Robots 10:12 Historical Milestones in Robotics Research 15:31 Combining Generative AI and Deep RL 21:24 Moravec's Paradox 25:33 Kitchen Robots 29:30 Simulation vs. Real-World Data 30:48 The Robot Olympics 36:31 The Physiological Reality of Embodiment 38:56 Controversies in the Robotics Community 44:18 What Makes a Great Researcher 48:27 How Businesses Should Prepare for Robotics 54:09 Tracking Progress Through Research Papers 57:02 The Next Step: Mid-Level Reasoning 1:02:00 The Kindest Thing
1:15:15

My conversation with Sergey Levine (Sergey Levine). Sergey is the co-founder of Physical Intelligence -- a company building foundation models that can control any robot to do any task in any environment. The company's thesis is that generality is more scalable than specialization, meaning that a model trained across many different robots and tasks will ultimately outperform any system built to do one thing well (eg, just wash dishes). Sergey is a researcher by background, but I think you will appreciate how practical and commercially grounded this conversation is. We discuss: - Why changing a diaper will be the last task a robot masters - The simulation v. real-world data debate - How multimodal LLMs give robots common sense - Moravec's Paradox + Robot Olympics - Why robots can do long-horizon tasks now - A realistic timeline for robots in our homes I should note that I am an investor in Physical Intelligence -- I made the investment because I believe it is one of the most important companies tackling the problem of robotics. Enjoy! Timestamps: 0:00 Intro 2:39 Defining Physical Intelligence 5:19 The Challenge of Building General Models 6:34 The Stakes and Future of General Purpose Robotics 8:15 Pros and Cons of Humanoid Robots 10:12 Historical Milestones in Robotics Research 15:31 Combining Generative AI and Deep RL 21:24 Moravec's Paradox 25:33 Kitchen Robots 29:30 Simulation vs. Real-World Data 30:48 The Robot Olympics 36:31 The Physiological Reality of Embodiment 38:56 Controversies in the Robotics Community 44:18 What Makes a Great Researcher 48:27 How Businesses Should Prepare for Robotics 54:09 Tracking Progress Through Research Papers 57:02 The Next Step: Mid-Level Reasoning 1:02:00 The Kindest Thing

Patrick OShaughnessy

133,833 Aufrufe • vor 4 Monaten

Physical Intelligence (Physical Intelligence) is building a foundation model that can control any robot to do any task — what the team describes as the GPT moment for robotics. The company's cross-embodiment approach trains across many different robot platforms, and recent results show tasks being performed zero-shot that last year required hundreds of hours of data collection. In this episode of the Lightcone Podcast , co-founder Quan Vuong (Quan Vuong) sat down with Garry Tan, Jared Friedman, Diana, and Harj Taggar to talk about why robotics is finally ready for its scaling moment, how PI runs its models in the cloud rather than on-device, and the playbook for what Quan sees as a Cambrian explosion of vertical robotics companies. 00:00 — Robotics just got cheaper 00:41 — The GPT moment for robotics 02:24 — Why robots didn’t work before 05:30 — The breakthrough that changed everything 09:12 — The data problem 13:33 — Robots learning without data 15:05 — Robots folding laundry (for real) 22:18 — From engineering problem → ops problem 29:12 — The startup playbook 38:46 — Thousands of robotics startups are coming
49:26

Physical Intelligence (Physical Intelligence) is building a foundation model that can control any robot to do any task — what the team describes as the GPT moment for robotics. The company's cross-embodiment approach trains across many different robot platforms, and recent results show tasks being performed zero-shot that last year required hundreds of hours of data collection. In this episode of the Lightcone Podcast , co-founder Quan Vuong (Quan Vuong) sat down with Garry Tan, Jared Friedman, Diana, and Harj Taggar to talk about why robotics is finally ready for its scaling moment, how PI runs its models in the cloud rather than on-device, and the playbook for what Quan sees as a Cambrian explosion of vertical robotics companies. 00:00 — Robotics just got cheaper 00:41 — The GPT moment for robotics 02:24 — Why robots didn’t work before 05:30 — The breakthrough that changed everything 09:12 — The data problem 13:33 — Robots learning without data 15:05 — Robots folding laundry (for real) 22:18 — From engineering problem → ops problem 29:12 — The startup playbook 38:46 — Thousands of robotics startups are coming

Y Combinator

115,590 Aufrufe • vor 3 Monaten

Excited to share what we've been cooking Google DeepMind to bring Gemini into the physical world! 🦾🧠 Here is an uncut interaction of the Gemini Robotics VLA helping me clean up my desk. 🔊 Interacting with a robot through voice is the most surreal experience, and parallels the giddy excitement I had playing with early LLMs that is hard to put in words. You've got to try it to believe it! Over the next few days, we'll be sharing more such interactions that go beyond shiny demos and expose raw capabilities of our models. Stay tuned for more raw videos! Tech Report: Blog: YouTube Playlist:
2:43

Excited to share what we've been cooking Google DeepMind to bring Gemini into the physical world! 🦾🧠 Here is an uncut interaction of the Gemini Robotics VLA helping me clean up my desk. 🔊 Interacting with a robot through voice is the most surreal experience, and parallels the giddy excitement I had playing with early LLMs that is hard to put in words. You've got to try it to believe it! Over the next few days, we'll be sharing more such interactions that go beyond shiny demos and expose raw capabilities of our models. Stay tuned for more raw videos! Tech Report: Blog: YouTube Playlist:

Dhruv Shah

68,630 Aufrufe • vor 1 Jahr

Better data for robot hands! 🤲🏼 Embodied reasoning is the bottleneck now. It’s the data we are missing. Specifically, understanding what the robot's hands are doing throughout a task. Perceptron AI new Egocentric offering tracks both hands through an entire video instead of guessing from sampled frames. That matters because a lot happens between frames. Hand positions shift. Contacts change. The robot adjusts grip. You miss all that if you're sampling. 0.280 semantic end-to-end F1 score on WGO-Bench vs 0.158 from the best pipelines built on Gemini Robotics-ER 1.6. Training a robot to manipulate objects requires understanding every moment of hand-object interaction. If your training data has gaps: missing frames, missed contacts, unclear hand positions, the policy learns from incomplete information. You end up with robots that work in demos but fail in real tasks. Continuous hand tracking gives you the full picture. The policy learns from cleaner, more complete data. That compounds into better real-world performance. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:25

Better data for robot hands! 🤲🏼 Embodied reasoning is the bottleneck now. It’s the data we are missing. Specifically, understanding what the robot's hands are doing throughout a task. Perceptron AI new Egocentric offering tracks both hands through an entire video instead of guessing from sampled frames. That matters because a lot happens between frames. Hand positions shift. Contacts change. The robot adjusts grip. You miss all that if you're sampling. 0.280 semantic end-to-end F1 score on WGO-Bench vs 0.158 from the best pipelines built on Gemini Robotics-ER 1.6. Training a robot to manipulate objects requires understanding every moment of hand-object interaction. If your training data has gaps: missing frames, missed contacts, unclear hand positions, the policy learns from incomplete information. You end up with robots that work in demos but fail in real tasks. Continuous hand tracking gives you the full picture. The policy learns from cleaner, more complete data. That compounds into better real-world performance. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

18,261 Aufrufe • vor 22 Tagen

The next evolution: VLA+ models Just yesterday Microsoft Research released Rho-alpha (ρα) – their first robotics model, built on the Phi family. While most Vision-Language-Action (VLA) models stop at vision and language, Rho-alpha adds: ▪️ Tactile sensing to feel objects during manipulation ▪️ Online learning that lets it improve from human corrections (via teleoperation, 3D mouse or other tools) in real-time even after deployment. Both these sides make adaptability central rather than incidental. Microsoft calls it a VLA+ model, positioning it as an extension beyond what current VLA systems support. ➡️ Today Rho-alpha can control dual-arm robot setups to perform tasks such as: • Manipulating the BusyBox following natural-language instructions • Plug insertion • Toolbox packing and object arrangement with bimanual coordination But to understand why this "plus" matters, we need to understand what came before. Here, we'll take you through the entire landscape of VLA models – Gemini Robotics, π0, SmolVLA, Helix, ACoT-VLA and others:
0:24

The next evolution: VLA+ models Just yesterday Microsoft Research released Rho-alpha (ρα) – their first robotics model, built on the Phi family. While most Vision-Language-Action (VLA) models stop at vision and language, Rho-alpha adds: ▪️ Tactile sensing to feel objects during manipulation ▪️ Online learning that lets it improve from human corrections (via teleoperation, 3D mouse or other tools) in real-time even after deployment. Both these sides make adaptability central rather than incidental. Microsoft calls it a VLA+ model, positioning it as an extension beyond what current VLA systems support. ➡️ Today Rho-alpha can control dual-arm robot setups to perform tasks such as: • Manipulating the BusyBox following natural-language instructions • Plug insertion • Toolbox packing and object arrangement with bimanual coordination But to understand why this "plus" matters, we need to understand what came before. Here, we'll take you through the entire landscape of VLA models – Gemini Robotics, π0, SmolVLA, Helix, ACoT-VLA and others:

Turing Post

62,362 Aufrufe • vor 6 Monaten

I usually skip benchmark comparisons. They're almost always picked to flatter. But EgoSchema is different. It measures first-person, egocentric video understanding. The AI equivalent of “look through the robot's eyes and tell me what happened.” I spent some time testing Perceptron Mk1 (“Mark One”) on the robotics workflows Perceptron walked me through, and the EgoSchema result suddenly made a lot more sense. Perceptron Mk1 scored 80.60% on it. Gemini 3.1 Flash Lite scored 62.4%. That's a completely different level of understanding. Most frontier models were trained on the internet through text, images, and static content. The physical world works differently. Context lives across time. The critical moment rarely exists in a single frame. And that's exactly where production deployments start mattering. Manufacturing QC. Robotics data pipelines. Security footage. Everything is temporal. Native video reasoning. Temporal grounding. Structured output. Perceptron calls it “Mk1” because it marks the beginning of their closed-model series for physical-world intelligence, and honestly, the name fits. It feels engineered for deployment, not just demos. Feels like one of the first video AI systems being built around how the physical world actually behaves instead of adapting static-image intelligence into video later.
0:21

I usually skip benchmark comparisons. They're almost always picked to flatter. But EgoSchema is different. It measures first-person, egocentric video understanding. The AI equivalent of “look through the robot's eyes and tell me what happened.” I spent some time testing Perceptron Mk1 (“Mark One”) on the robotics workflows Perceptron walked me through, and the EgoSchema result suddenly made a lot more sense. Perceptron Mk1 scored 80.60% on it. Gemini 3.1 Flash Lite scored 62.4%. That's a completely different level of understanding. Most frontier models were trained on the internet through text, images, and static content. The physical world works differently. Context lives across time. The critical moment rarely exists in a single frame. And that's exactly where production deployments start mattering. Manufacturing QC. Robotics data pipelines. Security footage. Everything is temporal. Native video reasoning. Temporal grounding. Structured output. Perceptron calls it “Mk1” because it marks the beginning of their closed-model series for physical-world intelligence, and honestly, the name fits. It feels engineered for deployment, not just demos. Feels like one of the first video AI systems being built around how the physical world actually behaves instead of adapting static-image intelligence into video later.

Jaymin Shah

116,425 Aufrufe • vor 2 Monaten

Boston Dynamics just gave its robot dog a brain that reasons about the physical world. Google DeepMind's Gemini Robotics model is now running inside Spot, the four-legged robot already deployed at thousands of facilities worldwide. The upgrade centers on something called embodied reasoning. Basically, instead of following rigid instructions, Spot now interprets what it sees and makes decisions on its own. One standout example: Spot can now look at a pressure gauge, zoom in on the needle, calculate the intervals between tick marks, and deliver an accurate reading. All autonomously. The model also introduces: > Multi-view reasoning, combining feeds from multiple cameras to understand its environment even when objects are blocked from one angle > Built-in success detection, so Spot knows when it's failed and decides whether to retry or move on That last part is a key requirement for true autonomy. Most companies building AI-powered robots are still stuck in the demo phase. Boston Dynamics is one of the few with actual paying customers... which means thousands of Spots collecting real-world data that feeds back into making the AI smarter. That flywheel is hard to compete with.
1:39

Boston Dynamics just gave its robot dog a brain that reasons about the physical world. Google DeepMind's Gemini Robotics model is now running inside Spot, the four-legged robot already deployed at thousands of facilities worldwide. The upgrade centers on something called embodied reasoning. Basically, instead of following rigid instructions, Spot now interprets what it sees and makes decisions on its own. One standout example: Spot can now look at a pressure gauge, zoom in on the needle, calculate the intervals between tick marks, and deliver an accurate reading. All autonomously. The model also introduces: > Multi-view reasoning, combining feeds from multiple cameras to understand its environment even when objects are blocked from one angle > Built-in success detection, so Spot knows when it's failed and decides whether to retry or move on That last part is a key requirement for true autonomy. Most companies building AI-powered robots are still stuck in the demo phase. Boston Dynamics is one of the few with actual paying customers... which means thousands of Spots collecting real-world data that feeds back into making the AI smarter. That flywheel is hard to compete with.

Rowan Cheung

54,376 Aufrufe • vor 3 Monaten

Robotics has a massive, silent bottleneck. It isn’t just data collection—it’s the brutal 1x speed of the physical world. Genesis AI Genesis AI just unveiled Genesis World 1.0, and they are attempting to turn the notorious Sim2Real gap into a pure compute problem. Evaluating a robotics foundation model across edge cases usually means hundreds of hours of physical lab testing. With Genesis World 1.0, what traditionally takes nearly a week of continuous, real-world operation is being compressed into 30 minutes in simulation. What makes this different from just dropping a robot model into an off-the-shelf game engine? 1️⃣ Nyx Renderer: A custom, real-time path-traced engine rendering noise-free 1080p frames in under 4ms. Game engines use rasterization tricks that confuse AI; Nyx uses physically accurate multi-bounce lighting so the model's "eyes" see exactly what real sensors see. 2️⃣ Quadrants Compiler: A custom Python-to-GPU compiler to run heavily parallelized multi-physics simulations (rigid bodies, fluids, deformables) natively across architectures. 3️⃣ Evaluation First: They aren't rushing to train on synthetic data. They are using this purely for closed-loop evaluation to perfect the physics first, currently claiming an impressive 89% correlation with real-world hardware tests. If the industry can accurately evaluate models in simulation without the physical world bottleneck, humanoid development stops moving at wall-clock time and starts scaling with compute.
1:36

Robotics has a massive, silent bottleneck. It isn’t just data collection—it’s the brutal 1x speed of the physical world. Genesis AI Genesis AI just unveiled Genesis World 1.0, and they are attempting to turn the notorious Sim2Real gap into a pure compute problem. Evaluating a robotics foundation model across edge cases usually means hundreds of hours of physical lab testing. With Genesis World 1.0, what traditionally takes nearly a week of continuous, real-world operation is being compressed into 30 minutes in simulation. What makes this different from just dropping a robot model into an off-the-shelf game engine? 1️⃣ Nyx Renderer: A custom, real-time path-traced engine rendering noise-free 1080p frames in under 4ms. Game engines use rasterization tricks that confuse AI; Nyx uses physically accurate multi-bounce lighting so the model's "eyes" see exactly what real sensors see. 2️⃣ Quadrants Compiler: A custom Python-to-GPU compiler to run heavily parallelized multi-physics simulations (rigid bodies, fluids, deformables) natively across architectures. 3️⃣ Evaluation First: They aren't rushing to train on synthetic data. They are using this purely for closed-loop evaluation to perfect the physics first, currently claiming an impressive 89% correlation with real-world hardware tests. If the industry can accurately evaluate models in simulation without the physical world bottleneck, humanoid development stops moving at wall-clock time and starts scaling with compute.

Humanoids daily

17,240 Aufrufe • vor 2 Monaten

Robots might learn better from video than from language! 📼 Most Vision-Language-Action (VLA) models learn what to do from text, but still struggle with how things move in the real world. That makes them data-hungry and slow to train. mimic video takes a different route. Instead of grounding robot control in text, it grounds it in video, using large pre-trained video models that already capture physical motion and dynamics. The idea is straightforward: let the video model handle “what will happen next,” and let a smaller control model focus only on turning that visual plan into robot actions. The result is big gains in practice. Robots trained this way need 10× less data, converge twice as fast, and perform better on both simulated benchmarks and real bimanual manipulation tasks. If robots can “imagine” motion using video, control becomes a much simpler problem. Shoutout to Jonas Pai, Liam Achenbach, Oier Mees, Elvis Nava and the rest of the team! Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:47

Robots might learn better from video than from language! 📼 Most Vision-Language-Action (VLA) models learn what to do from text, but still struggle with how things move in the real world. That makes them data-hungry and slow to train. mimic video takes a different route. Instead of grounding robot control in text, it grounds it in video, using large pre-trained video models that already capture physical motion and dynamics. The idea is straightforward: let the video model handle “what will happen next,” and let a smaller control model focus only on turning that visual plan into robot actions. The result is big gains in practice. Robots trained this way need 10× less data, converge twice as fast, and perform better on both simulated benchmarks and real bimanual manipulation tasks. If robots can “imagine” motion using video, control becomes a much simpler problem. Shoutout to Jonas Pai, Liam Achenbach, Oier Mees, Elvis Nava and the rest of the team! Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

50,063 Aufrufe • vor 7 Monaten

Over the past couple of years, you’ve heard us reference “agents” and “agentic capabilities,” nebulous concepts that are designed to help you with coding, booking trips, and other complex multi-step tasks. But, what actually IS an agent? We think of AI agents as systems that combine the intelligence of advanced AI models with access to tools so they can take actions on your behalf, under your control. Whether it’s a coding agent or our recently unveiled experimental tool Gemini Agent in the Google Gemini, these are systems that will meet you where you are, in the products that you love, to help take the tedious tasks you want off your plate.
0:57

Over the past couple of years, you’ve heard us reference “agents” and “agentic capabilities,” nebulous concepts that are designed to help you with coding, booking trips, and other complex multi-step tasks. But, what actually IS an agent? We think of AI agents as systems that combine the intelligence of advanced AI models with access to tools so they can take actions on your behalf, under your control. Whether it’s a coding agent or our recently unveiled experimental tool Gemini Agent in the Google Gemini, these are systems that will meet you where you are, in the products that you love, to help take the tedious tasks you want off your plate.

Google AI

120,813 Aufrufe • vor 8 Monaten

Most robotics teams can make a robot move… very few can make it work every day in the real world! @roboforce_inc was just featured in Jensen Huang’s GTC keynote, not for a demo but for a robot they claim is already working in the field. Their system, TITAN, is built for industrial environments: ✅ 40 kg dual-arm payload ✅ millimeter-level precision ✅ 8 hours runtime ✅ early pilots in energy, logistics, and manufacturing They call it Physical AI: The focus is on getting robots to do the kind of labor that still depends on people: repetitive, risky, and physical. IMO, what stands out isn’t the specs. It’s the claim of 11,000 robot orders❗️ If even a fraction of that turns into real deployments, it would make RoboForce one of the most widely scaled robot platforms in the world!!?? The open question is whether this shift from prototype to production is real or just the next phase of robotics storytelling. It looks very promising to me. It’s also interesting how their founder openly pushes back against the humanoid trend, arguing for wheels over legs in real industrial settings. It’s an unusual perspective in a time when humanoids get most of the attention. If they are right, the next humanoid robotics wave might look less like a human and more like an industrial version. Seen at —- Weekly robotics and AI insights. Subscribe free:
0:29

Most robotics teams can make a robot move… very few can make it work every day in the real world! @roboforce_inc was just featured in Jensen Huang’s GTC keynote, not for a demo but for a robot they claim is already working in the field. Their system, TITAN, is built for industrial environments: ✅ 40 kg dual-arm payload ✅ millimeter-level precision ✅ 8 hours runtime ✅ early pilots in energy, logistics, and manufacturing They call it Physical AI: The focus is on getting robots to do the kind of labor that still depends on people: repetitive, risky, and physical. IMO, what stands out isn’t the specs. It’s the claim of 11,000 robot orders❗️ If even a fraction of that turns into real deployments, it would make RoboForce one of the most widely scaled robot platforms in the world!!?? The open question is whether this shift from prototype to production is real or just the next phase of robotics storytelling. It looks very promising to me. It’s also interesting how their founder openly pushes back against the humanoid trend, arguing for wheels over legs in real industrial settings. It’s an unusual perspective in a time when humanoids get most of the attention. If they are right, the next humanoid robotics wave might look less like a human and more like an industrial version. Seen at —- Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

27,741 Aufrufe • vor 9 Monaten

Demis Hassabis says world models are his longest standing passion and explains benefits vs. language models: ▫️ “I think language models are able to understand a lot about the world. More than we expected because language is actually probably richer than we thought. But there's still a lot about the spatial dynamics of the world, spatial awareness and the physical context we're in — and how that works mechanically — that is hard to describe in words and isn't generally described in corpuses of words. Alot of this is allied to learning from experience. There's a lot of things which you can't really describe something. You have to just experience it. Maybe the senses and so on are very hard to put into words. Whether that's motor angles and smell and these kinds of senses, it's very difficult to describe that in any kind of language.”▫️ This is what Demis and Google Deepmind is trying to solve with Genie. He also says that the video models (Veo) will play a part in training the world models and this is all key for AI robotics.
2:32

Demis Hassabis says world models are his longest standing passion and explains benefits vs. language models: ▫️ “I think language models are able to understand a lot about the world. More than we expected because language is actually probably richer than we thought. But there's still a lot about the spatial dynamics of the world, spatial awareness and the physical context we're in — and how that works mechanically — that is hard to describe in words and isn't generally described in corpuses of words. Alot of this is allied to learning from experience. There's a lot of things which you can't really describe something. You have to just experience it. Maybe the senses and so on are very hard to put into words. Whether that's motor angles and smell and these kinds of senses, it's very difficult to describe that in any kind of language.”▫️ This is what Demis and Google Deepmind is trying to solve with Genie. He also says that the video models (Veo) will play a part in training the world models and this is all key for AI robotics.

Bearly AI

123,703 Aufrufe • vor 7 Monaten

For developers, Gemini 3 Pro offers unparalleled results across every major AI benchmark compared to Gemini 2.5 Pro. Here three ways Gemini 3 Pro can improve your workflow today: 1. Gemini 3 Pro fits right into existing production agent and coding workflows. It is also integrated into development environment experiences across the ecosystem of developer products like Google AI Studio, Gemini CLI, and Android Studio. 2. We introduced Google Google Antigravity, a new agentic development platform that reimagines how the model and IDE work together. It enables developers to manage agents to work at a higher, task-oriented level collaborating with agents while they build. 3. We’ve built Google AI Studio to be your fastest path from a prompt to an AI-native app. Build mode lets you add AI capabilities faster than ever, automatically wiring up the right models and APIs, while features like annotations enable fast and intuitive iteration. Whether you’re building a one-shot prompt game or an interactive landing page from unstructured voice notes, you can bring any idea to life with Gemini 3.
0:48

For developers, Gemini 3 Pro offers unparalleled results across every major AI benchmark compared to Gemini 2.5 Pro. Here three ways Gemini 3 Pro can improve your workflow today: 1. Gemini 3 Pro fits right into existing production agent and coding workflows. It is also integrated into development environment experiences across the ecosystem of developer products like Google AI Studio, Gemini CLI, and Android Studio. 2. We introduced Google Google Antigravity, a new agentic development platform that reimagines how the model and IDE work together. It enables developers to manage agents to work at a higher, task-oriented level collaborating with agents while they build. 3. We’ve built Google AI Studio to be your fastest path from a prompt to an AI-native app. Build mode lets you add AI capabilities faster than ever, automatically wiring up the right models and APIs, while features like annotations enable fast and intuitive iteration. Whether you’re building a one-shot prompt game or an interactive landing page from unstructured voice notes, you can bring any idea to life with Gemini 3.

Google AI

136,648 Aufrufe • vor 8 Monaten

Manish Gupta, Senior Director at Google DeepMind India, sits down with Aakrit Vaish and Pratyush Choudhury at Mumbai Tech Week for a rare on-record conversation about the frontier AI research happening out of Bangalore. Gupta makes a pointed case against the narrative that India lacks AI research talent: a team of roughly 75 researchers, a third of them fresh out of college, producing work on par with the best in the world and feeding directly into Gemini. The conversation goes deep on what DeepMind India actually builds, why Gemini is considered the most efficient model on the planet, and what India needs to become a research leader rather than a fast follower. In this conversation, they go deep on: 0:00 Intro: Manish Gupta of DeepMind India at Mumbai Tech Week 1:23 What DeepMind India does, and why it's a "mystery" 1:59 The three roles: languages, efficiency, continual learning 2:19 The Haryanvi demo at Google I/O and the cultural playbook 2:38 Making models efficient: from mobile to servers 3:25 Matryoshka transformers and why nested models win 4:20 Why Gemini is the most efficient model on the planet 5:11 Continual learning: using Gemini to improve Gemini 5:50 Google's India plans: consumers, agents, enterprise, government 7:44 Government officials live-coding with AI Studio and NotebookLM 8:30 The India AI talent debate and how the team is structured 10:25 Why India lacks courage and R&D investment, not talent 11:16 DeepMind's global labs and India's outsized impact 13:15 On-device AI: Gemma 3n and 4n 14:08 The headline: 75 world-class researchers in Bangalore 14:58 25 of the 75 are fresh out of college If you're a founder, builder or researcher thinking about AI, frontier models, or India's place in global AI research, this one's for you. Aakrit Vaish Pratyush Choudhury (PC) Google DeepMind Google India Manish Gupta
15:41

Manish Gupta, Senior Director at Google DeepMind India, sits down with Aakrit Vaish and Pratyush Choudhury at Mumbai Tech Week for a rare on-record conversation about the frontier AI research happening out of Bangalore. Gupta makes a pointed case against the narrative that India lacks AI research talent: a team of roughly 75 researchers, a third of them fresh out of college, producing work on par with the best in the world and feeding directly into Gemini. The conversation goes deep on what DeepMind India actually builds, why Gemini is considered the most efficient model on the planet, and what India needs to become a research leader rather than a fast follower. In this conversation, they go deep on: 0:00 Intro: Manish Gupta of DeepMind India at Mumbai Tech Week 1:23 What DeepMind India does, and why it's a "mystery" 1:59 The three roles: languages, efficiency, continual learning 2:19 The Haryanvi demo at Google I/O and the cultural playbook 2:38 Making models efficient: from mobile to servers 3:25 Matryoshka transformers and why nested models win 4:20 Why Gemini is the most efficient model on the planet 5:11 Continual learning: using Gemini to improve Gemini 5:50 Google's India plans: consumers, agents, enterprise, government 7:44 Government officials live-coding with AI Studio and NotebookLM 8:30 The India AI talent debate and how the team is structured 10:25 Why India lacks courage and R&D investment, not talent 11:16 DeepMind's global labs and India's outsized impact 13:15 On-device AI: Gemma 3n and 4n 14:08 The headline: 75 world-class researchers in Bangalore 14:58 25 of the 75 are fresh out of college If you're a founder, builder or researcher thinking about AI, frontier models, or India's place in global AI research, this one's for you. Aakrit Vaish Pratyush Choudhury (PC) Google DeepMind Google India Manish Gupta

Activate

14,136 Aufrufe • vor 2 Monaten