Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Robots assembling robot brain -- imagine this kind of robustness on every precision manufacturing line! Live demo of GPU rack assembly at #NVIDIAGTC: - end-to-end neural network (Skild Brain) finetuned with little data - memory to perform long horizon task (placing jigs, 16 screwes, removing jigs) - robust to...

pathak2206's profile picture

Deepak Pathak

28,727 subscribers

45,749 Aufrufe • vor 3 Monaten •via X (Twitter)

Wissenschaft & Technologie#NVIDIAGTC
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Nearly every system today, from energy to chips to food, is bottlenecked by scarce human capital. We are changing that by building AI-powered industries of the future. Check out Skild Brain robustly assembling GPU racks, a highly precise task, live at #NvidiaGTC.
1:13

Nearly every system today, from energy to chips to food, is bottlenecked by scarce human capital. We are changing that by building AI-powered industries of the future. Check out Skild Brain robustly assembling GPU racks, a highly precise task, live at #NvidiaGTC.

Skild AI

280,352 Aufrufe • vor 3 Monaten

Skild Brain uses in-context memory to adapt to disturbances on the fly and keeps working.
1:28

Skild Brain uses in-context memory to adapt to disturbances on the fly and keeps working.

The Humanoid Hub

32,057 Aufrufe • vor 3 Monaten

At GTC 2026 Skild booth, Shikhar Bahl & Katerina Marinou demo Skild Brain operating autonomously from pixels to robot actions, doing busbar assembly for NVIDIA GB300 compute tray. Skild uses the same omni-bodied base model for humanoids, quadrupeds, and variety of industrial robots.
6:32

At GTC 2026 Skild booth, Shikhar Bahl & Katerina Marinou demo Skild Brain operating autonomously from pixels to robot actions, doing busbar assembly for NVIDIA GB300 compute tray. Skild uses the same omni-bodied base model for humanoids, quadrupeds, and variety of industrial robots.

The Humanoid Hub

66,156 Aufrufe • vor 3 Monaten

Skild Brain preparing an omelet with everyday human tools. The robot drops an eggshell into the bowl at one point but recovers and continues the task. The ability to self-correct during edge cases is what will make robots dependable for complex, long-horizon missions.
5:01

Skild Brain preparing an omelet with everyday human tools. The robot drops an eggshell into the bowl at one point but recovers and continues the task. The ability to self-correct during edge cases is what will make robots dependable for complex, long-horizon missions.

The Humanoid Hub

14,846 Aufrufe • vor 2 Monaten

How to teach robots to perform long-horizon tasks efficiently and robustly🦾? Introducing MimicPlay - an imitation learning algorithm that uses "cheap human play data". Our approach unlocks both real-time planning through raw perception and strong robustness to disturbances!🧵👇
1:15

How to teach robots to perform long-horizon tasks efficiently and robustly🦾? Introducing MimicPlay - an imitation learning algorithm that uses "cheap human play data". Our approach unlocks both real-time planning through raw perception and strong robustness to disturbances!🧵👇

Chen Wang

288,500 Aufrufe • vor 3 Jahren

Skild Brain putting AirPods in cases and assembling a GPU compute tray
0:42

Skild Brain putting AirPods in cases and assembling a GPU compute tray

The Humanoid Hub

24,507 Aufrufe • vor 8 Monaten

Excited to announce that Skild AI has completed the acquisition of Zebra Technologies’ robotics arm (formerly Fetch Robotics). By combining Zebra's human-robot orchestration platform with omnibodied Skild Brain, we plan to turn warehouses everywhere into hubs of hyper-efficiency. Imagine a single platform, single brain optimizing every movement of robots as well as human workers in warehouses. Many of us in the robotics community have used Fetch Robots in the past and have rooted for them over the years, so this acquisition is special for us in many ways.
1:20

Excited to announce that Skild AI has completed the acquisition of Zebra Technologies’ robotics arm (formerly Fetch Robotics). By combining Zebra's human-robot orchestration platform with omnibodied Skild Brain, we plan to turn warehouses everywhere into hubs of hyper-efficiency. Imagine a single platform, single brain optimizing every movement of robots as well as human workers in warehouses. Many of us in the robotics community have used Fetch Robots in the past and have rooted for them over the years, so this acquisition is special for us in many ways.

Deepak Pathak

79,031 Aufrufe • vor 2 Monaten

Using monkey brain data to operate robotic arms! 🙉 Project Jenkins explores brain-computer interfaces by decoding neural activity into robotic movement and generating synthetic brain data from motion patterns. Using neural recordings from a macaque monkey named Jenkins, researchers developed models to decode brain signals into robotic arm movements and encode movement data into simulated neural activity. The project utilizes robotic arms and an interactive web console for real-time brain data generation from joystick inputs. The research paves the way for adaptive brain-computer interfaces by modeling brain activity more flexibly. Congrats to authors Dima Yanovsky, and Andrii Zahorodnii! 🦾
0:26

Using monkey brain data to operate robotic arms! 🙉 Project Jenkins explores brain-computer interfaces by decoding neural activity into robotic movement and generating synthetic brain data from motion patterns. Using neural recordings from a macaque monkey named Jenkins, researchers developed models to decode brain signals into robotic arm movements and encode movement data into simulated neural activity. The project utilizes robotic arms and an interactive web console for real-time brain data generation from joystick inputs. The research paves the way for adaptive brain-computer interfaces by modeling brain activity more flexibly. Congrats to authors Dima Yanovsky, and Andrii Zahorodnii! 🦾

Lukas Ziegler

21,504 Aufrufe • vor 1 Jahr

Technology and Innovation: Sparks fly across the production line as advanced robotic arms perform precision welding on automotive body components, showcasing the growing strength of Shenyang’s high end manufacturing and robotics industry.
0:35

Technology and Innovation: Sparks fly across the production line as advanced robotic arms perform precision welding on automotive body components, showcasing the growing strength of Shenyang’s high end manufacturing and robotics industry.

Shenyang

188,377 Aufrufe • vor 15 Tagen

Brain-controlled exoskeletons to train humanoid robots! 🧠 Fourier just presented human tele-operators using brain control interfaces and exoskeletal arms to train humanoid robots on home tasks. The brain control interface is the interesting part. Instead of using a controller or joystick to teleoperate, the operator's movements and intentions are captured more naturally through the exoskeleton and BCI. This means the demonstrations are more fluid, more human-like, and better suited for training robots to perform delicate home tasks. Multiple tele-operators are simultaneously generating training data across multiple robots. This is how you build the dataset needed for eventual full autonomy, without waiting years for it to arrive. This might be the bridge between "robots that work in controlled environments" and "robots that work in homes." Not full autonomy right away, but trusted human intelligence operating through a robot body, getting better with every task completed. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:56

Brain-controlled exoskeletons to train humanoid robots! 🧠 Fourier just presented human tele-operators using brain control interfaces and exoskeletal arms to train humanoid robots on home tasks. The brain control interface is the interesting part. Instead of using a controller or joystick to teleoperate, the operator's movements and intentions are captured more naturally through the exoskeleton and BCI. This means the demonstrations are more fluid, more human-like, and better suited for training robots to perform delicate home tasks. Multiple tele-operators are simultaneously generating training data across multiple robots. This is how you build the dataset needed for eventual full autonomy, without waiting years for it to arrive. This might be the bridge between "robots that work in controlled environments" and "robots that work in homes." Not full autonomy right away, but trusted human intelligence operating through a robot body, getting better with every task completed. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

20,874 Aufrufe • vor 4 Monaten

At Generalist, we’re working towards a future where robots can do anything. To that end, the robots build now, too. We’ve trained a robot to do one-shot assembly, constructing Legos end-to-end: no custom engineering, just pixels in → Lego copies out.
0:58

At Generalist, we’re working towards a future where robots can do anything. To that end, the robots build now, too. We’ve trained a robot to do one-shot assembly, constructing Legos end-to-end: no custom engineering, just pixels in → Lego copies out.

Generalist

103,012 Aufrufe • vor 9 Monaten

San Mateo, California–based Generalist showcases their real-time, end-to-end neural network that controls robots at 100Hz for dexterous manipulation tasks. The model handles fine-motor control, bi-manual coordination, tool use, and generalization across arms and environments.
2:21

San Mateo, California–based Generalist showcases their real-time, end-to-end neural network that controls robots at 100Hz for dexterous manipulation tasks. The model handles fine-motor control, bi-manual coordination, tool use, and generalization across arms and environments.

The Humanoid Hub

42,524 Aufrufe • vor 1 Jahr

Truly general-purpose robots must be able to navigate spaces they have never seen before. ⦿ Skild Brain enables end-to-end autonomous locomotion from raw vision and joint inputs, without mapping or pre-planning. ⦿ The model adapts in real time to new terrain such as stairs, gaps, and clutter, reacting instinctively like a human. There is no “stair mode” or “step-over mode”: the transition between walking behaviors is continuous and instinctive. ⦿ A single neural policy supports a wide range of locomotion tasks and can transfer across different robot platforms.
4:37

Truly general-purpose robots must be able to navigate spaces they have never seen before. ⦿ Skild Brain enables end-to-end autonomous locomotion from raw vision and joint inputs, without mapping or pre-planning. ⦿ The model adapts in real time to new terrain such as stairs, gaps, and clutter, reacting instinctively like a human. There is no “stair mode” or “step-over mode”: the transition between walking behaviors is continuous and instinctive. ⦿ A single neural policy supports a wide range of locomotion tasks and can transfer across different robot platforms.

The Humanoid Hub

28,439 Aufrufe • vor 10 Monaten

NEWS: Humanoid robotics company Figure has released Helix 02, what they claim in their most capable humanoid model yet. "A single neural system that controls the full body directly from pixels, enabling dexterous, long horizon autonomy across an entire room: • Autonomous, long‑horizon loco-manipulation: Helix 02 unloads and reloads a dishwasher across a full-sized kitchen - a four-minute, end-to-end autonomous task that integrates walking, manipulation, and balance with no resets and no human intervention. We believe this is the longest horizon, most complex task completed autonomously by a humanoid robot to date. • All sensors in. All actuators out: Helix 02 connects every onboard sensor - vision, touch, and proprioception - directly to every actuator through a single unified visuomotor neural network. • Human-like whole body control from human data: All results are enabled by System 0, a learned whole‑body controller trained on over 1,000 hours of human motion data and sim‑to‑real reinforcement learning. System 0 replaces 109,504 lines of hand‑engineered C++ with a single neural prior for stable, natural motion. • New classes of dexterity: With Figure 03’s embedded tactile sensing and palm cameras, Helix 02 performs manipulation that was previously out of reach: extracting individual pills, dispensing precise syringe volumes, and singulating small, irregular objects from clutter despite self‑occlusion. Helix 02 is trained on over 1,000 hours of human motion data and integrates vision, touch, and proprioception."
3:25

NEWS: Humanoid robotics company Figure has released Helix 02, what they claim in their most capable humanoid model yet. "A single neural system that controls the full body directly from pixels, enabling dexterous, long horizon autonomy across an entire room: • Autonomous, long‑horizon loco-manipulation: Helix 02 unloads and reloads a dishwasher across a full-sized kitchen - a four-minute, end-to-end autonomous task that integrates walking, manipulation, and balance with no resets and no human intervention. We believe this is the longest horizon, most complex task completed autonomously by a humanoid robot to date. • All sensors in. All actuators out: Helix 02 connects every onboard sensor - vision, touch, and proprioception - directly to every actuator through a single unified visuomotor neural network. • Human-like whole body control from human data: All results are enabled by System 0, a learned whole‑body controller trained on over 1,000 hours of human motion data and sim‑to‑real reinforcement learning. System 0 replaces 109,504 lines of hand‑engineered C++ with a single neural prior for stable, natural motion. • New classes of dexterity: With Figure 03’s embedded tactile sensing and palm cameras, Helix 02 performs manipulation that was previously out of reach: extracting individual pills, dispensing precise syringe volumes, and singulating small, irregular objects from clutter despite self‑occlusion. Helix 02 is trained on over 1,000 hours of human motion data and integrates vision, touch, and proprioception."

Sawyer Merritt

624,668 Aufrufe • vor 5 Monaten

What if one AI brain could run every robot on the planet—from a humanoid to a warehouse arm—all at once? 🧠 Deepak Pathak, CEO and Co-Founder, and Abhinav Gupta, President and Co-Founder of Skild AI, explain how they are building "OmniBrain," a universal foundation model designed to generalize intelligence across any robot form factor and task. 📺 Watch the episode:
0:28

What if one AI brain could run every robot on the planet—from a humanoid to a warehouse arm—all at once? 🧠 Deepak Pathak, CEO and Co-Founder, and Abhinav Gupta, President and Co-Founder of Skild AI, explain how they are building "OmniBrain," a universal foundation model designed to generalize intelligence across any robot form factor and task. 📺 Watch the episode:

NVIDIA Robotics

26,155 Aufrufe • vor 2 Monaten

First look at our collaboration with Audi on bringing AI-driven robotics into industrial production. Our end-to-end pixel-to-action model, running on our bi-manual platform, is capable of performing a complex, dexterous and long-horizon insertion task.
1:15

First look at our collaboration with Audi on bringing AI-driven robotics into industrial production. Our end-to-end pixel-to-action model, running on our bi-manual platform, is capable of performing a complex, dexterous and long-horizon insertion task.

mimic

64,907 Aufrufe • vor 4 Monaten

Excited to announce GR00T N1, the world’s first open foundation model for humanoid robots! We are on a mission to democratize Physical AI. The power of general robot brain, in the palm of your hand - with only 2B parameters, N1 learns from the most diverse physical action dataset ever compiled and punches above its weight: - Real humanoid teleoperation data. - Large-scale simulation data: we are open-sourcing 300K+ trajectories! - Neural trajectories: we apply SOTA video generation models to “hallucinate” new synthetic data that features accurate physics in pixels. Using Jensen’s words, “systematically infinite data”! - Latent actions: we develop novel algorithms to extract action tokens from in-the-wild human videos and neural generated videos. GR00T N1 is a single end-to-end neural net, from photons to actions: - Vision-Language Model (System 2) that interprets the physical world through vision and language instructions, enabling robots to reason about their environment and instructions, and plan the right actions. - Diffusion Transformer (System 1) that “renders” smooth and precise motor actions at 120 Hz, executing the latent plan made by System 2. We deploy N1 on GR1 robot, 1X Neo robot, and a large collection of simulation benchmarks. N1 achieves up to +30% boost in diverse manipulation tasks for household and industrial settings. While humanoid robots are the main focus of N1, our model also supports cross-embodiment. We finetune it to work on the $110 HuggingFace LeRobot SO100 robot arm! Open robot brain runs on open hardware. Sounds just right. Let’s solve robotics, together, one token at a time. Links to our Whitepaper, Github repo, HuggingFace model, and open dataset page in the thread: 🧵
2:21

Excited to announce GR00T N1, the world’s first open foundation model for humanoid robots! We are on a mission to democratize Physical AI. The power of general robot brain, in the palm of your hand - with only 2B parameters, N1 learns from the most diverse physical action dataset ever compiled and punches above its weight: - Real humanoid teleoperation data. - Large-scale simulation data: we are open-sourcing 300K+ trajectories! - Neural trajectories: we apply SOTA video generation models to “hallucinate” new synthetic data that features accurate physics in pixels. Using Jensen’s words, “systematically infinite data”! - Latent actions: we develop novel algorithms to extract action tokens from in-the-wild human videos and neural generated videos. GR00T N1 is a single end-to-end neural net, from photons to actions: - Vision-Language Model (System 2) that interprets the physical world through vision and language instructions, enabling robots to reason about their environment and instructions, and plan the right actions. - Diffusion Transformer (System 1) that “renders” smooth and precise motor actions at 120 Hz, executing the latent plan made by System 2. We deploy N1 on GR1 robot, 1X Neo robot, and a large collection of simulation benchmarks. N1 achieves up to +30% boost in diverse manipulation tasks for household and industrial settings. While humanoid robots are the main focus of N1, our model also supports cross-embodiment. We finetune it to work on the $110 HuggingFace LeRobot SO100 robot arm! Open robot brain runs on open hardware. Sounds just right. Let’s solve robotics, together, one token at a time. Links to our Whitepaper, Github repo, HuggingFace model, and open dataset page in the thread: 🧵

Jim Fan

465,826 Aufrufe • vor 1 Jahr

Brett Adcock says the latest autonomous demo of Figure 02 is fully end-to-end and uses a single neural network – camera frames in, actions out. “You cannot code your way out of this problem.”
2:30

Brett Adcock says the latest autonomous demo of Figure 02 is fully end-to-end and uses a single neural network – camera frames in, actions out. “You cannot code your way out of this problem.”

The Humanoid Hub

56,268 Aufrufe • vor 1 Jahr

"Physical AI and robotics will bring about the next industrial revolution.” - Jensen Huang. Join us at Physical AI and Robotics Day at #NVIDIAGTC Washington, D.C. for expert-led sessions and hands-on trainings. Don't miss highlights including: 🦾 Accelerating the Physical AI Era With Digital Twins and Real-Time Simulation 🏭 Shaping the Future of US Manufacturing With AI Agility, 良葛格, Eli Lilly and Company, Siemens, TSMC 🧠 Scalable Robot Intelligence Framework—Any Robot. Any Task. One Brain. Skild AI Explore the full schedule:
0:24

"Physical AI and robotics will bring about the next industrial revolution.” - Jensen Huang. Join us at Physical AI and Robotics Day at #NVIDIAGTC Washington, D.C. for expert-led sessions and hands-on trainings. Don't miss highlights including: 🦾 Accelerating the Physical AI Era With Digital Twins and Real-Time Simulation 🏭 Shaping the Future of US Manufacturing With AI Agility, 良葛格, Eli Lilly and Company, Siemens, TSMC 🧠 Scalable Robot Intelligence Framework—Any Robot. Any Task. One Brain. Skild AI Explore the full schedule:

NVIDIA Omniverse

26,620 Aufrufe • vor 9 Monaten

Skild has been quiet since emerging from stealth in July 2024. They just shared their journey so far, showcasing early milestones. Skild is building toward a single general-purpose, “omni-bodied” robotics foundation model: One Brain – any task, any robot. The Skild Brain can control humanoids, quadrupeds, or manipulators using a unified architecture trained on large-scale action datasets, including internet videos, simulation, and real-world data. Founded by CMU professors in 2023, the company has a strong group of researchers and engineers who have made some of the most seminal contributions to robotics research in the past decade. Now, they’re set to take it from the lab to the real world.
2:48

Skild has been quiet since emerging from stealth in July 2024. They just shared their journey so far, showcasing early milestones. Skild is building toward a single general-purpose, “omni-bodied” robotics foundation model: One Brain – any task, any robot. The Skild Brain can control humanoids, quadrupeds, or manipulators using a unified architecture trained on large-scale action datasets, including internet videos, simulation, and real-world data. Founded by CMU professors in 2023, the company has a strong group of researchers and engineers who have made some of the most seminal contributions to robotics research in the past decade. Now, they’re set to take it from the lab to the real world.

The Humanoid Hub

62,424 Aufrufe • vor 11 Monaten