Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Animal-like robots are the future. Introducing Verdie, a physical agent for sustainable outdoor maintenance capable of learning multiple power tools. Verdie was trained in the NVIDIA Isaac simulator for just 5 hours before string trimming lawns for the first time. Verdie is being deployed in 2024 to work alongside...

sheeprobotics's profile picture

Electric Sheep

2,008 subscribers

27,018 Aufrufe • vor 2 Jahren •via X (Twitter)

Gesundheit & WellnessWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

8 Kommentare

Profilbild von Electric Sheep
Electric Sheepvor 2 Jahren

Link to substack to read more about Verdie's AI :

Profilbild von Electric Sheep
Electric Sheepvor 2 Jahren

Pumped to see some great coverage for little Verdie @sheeprobotics alongside the amazing @Figure_robot and @adcock_brett funding announcement in NBC Bay Area yesterday.

Profilbild von Mani
Manivor 2 Jahren

@nvidia Verdie looks really cute, like Wall-E irl

Profilbild von Yeshua God - Official
Yeshua God - Officialvor 2 Jahren

@nvidia OMG when @the_yanco sees this wielding a chainsaw in his neighbor's yard he's gonna go nuts 🤣

Profilbild von SGM
SGMvor 2 Jahren

@nvidia A bot that can walk/play fetch with the dog is still needed

Profilbild von RabbiJacob
RabbiJacobvor 2 Jahren

@nvidia @SimonNimes

Profilbild von PrimeURL (for Startups 🏆)
PrimeURL (for Startups 🏆)vor 1 Jahr

@nvidia Robot 🤖

Profilbild von Electric Sheep
Electric Sheepvor 2 Jahren

@drew_r_hamilton @nvidia thanks - we think so too!

Ähnliche Videos

We are excited to share a research preview of our generative agent. The agent is being trained to solve the hardest tasks in 3D and beyond, using only keyboard and mouse actions. Join the waitlist: Our agent app runs on Windows or Mac, either locally or with one-click setup for a Windows VM. It’s still early days, but this paves the way for production-level workflows for the first time ever. Blog:
1:37

We are excited to share a research preview of our generative agent. The agent is being trained to solve the hardest tasks in 3D and beyond, using only keyboard and mouse actions. Join the waitlist: Our agent app runs on Windows or Mac, either locally or with one-click setup for a Windows VM. It’s still early days, but this paves the way for production-level workflows for the first time ever. Blog:

Common Sense Machines

155,199 Aufrufe • vor 1 Jahr

New NVIDIA physical AI agent-ready skills are changing how robotics researchers work. 🤖 With NVIDIA robotics skills, researchers can automate the most common development steps from scene preparation to simulation and learning with Omniverse libraries, Isaac frameworks, and physical AI open datasets. Specialized skills like Isaac Mobility extend that even further. Learn more ➡️
0:24

New NVIDIA physical AI agent-ready skills are changing how robotics researchers work. 🤖 With NVIDIA robotics skills, researchers can automate the most common development steps from scene preparation to simulation and learning with Omniverse libraries, Isaac frameworks, and physical AI open datasets. Specialized skills like Isaac Mobility extend that even further. Learn more ➡️

NVIDIA Robotics

99,713 Aufrufe • vor 1 Monat

Major milestone in Reinforcement Learning 🚀 In under just 1 hour of training, our AI Agent can now automate tasks requiring complex physics and object interactions. Done for the first time on 100$ robot arms. Watch as it recovers when the cube gets stuck 🤯
0:25

Major milestone in Reinforcement Learning 🚀 In under just 1 hour of training, our AI Agent can now automate tasks requiring complex physics and object interactions. Done for the first time on 100$ robot arms. Watch as it recovers when the cube gets stuck 🤯

Remi Cadene

62,533 Aufrufe • vor 1 Jahr

The paradigm shift is here: We are moving from a "Human-First" internet to an "Agent-First" internet. 🤖 In the latest episode of the AI on Air podcast, our CTO Scott Shi - e/acc dives deep into the future of the Agent-to-Agent (A2A) economy. Imagine a world where your AI assistant doesn't just search the web, but autonomously hires and pays other specialized agents to complete complex tasks for you. The infrastructure for this autonomous machine economy is being built right now. Are you ready for the future of AI payments? Watch the full episode to learn more⬇️
2:30

The paradigm shift is here: We are moving from a "Human-First" internet to an "Agent-First" internet. 🤖 In the latest episode of the AI on Air podcast, our CTO Scott Shi - e/acc dives deep into the future of the Agent-to-Agent (A2A) economy. Imagine a world where your AI assistant doesn't just search the web, but autonomously hires and pays other specialized agents to complete complex tasks for you. The infrastructure for this autonomous machine economy is being built right now. Are you ready for the future of AI payments? Watch the full episode to learn more⬇️

KITE AI

25,024 Aufrufe • vor 4 Monaten

Real → Sim → Robot — fast. With Gaussian splats, GRID brings physical assets into simulation tools like AirGen and NVIDIA Isaac Sim, enabling AI skills to be tested in sim and deployed to real robots in minutes. #Robotics #PhysicalAI #Simulation
0:58

Real → Sim → Robot — fast. With Gaussian splats, GRID brings physical assets into simulation tools like AirGen and NVIDIA Isaac Sim, enabling AI skills to be tested in sim and deployed to real robots in minutes. #Robotics #PhysicalAI #Simulation

General Robotics

12,257 Aufrufe • vor 10 Monaten

Physical AI is the biggest opportunity most people are sleepwalking past. "Physical AI is a $50 trillion market." - Jensen at The All-In Podcast Robots. Autonomous vehicles. Embodied AI. The infrastructure to power all of it. Nvidia isn't just selling GPUs anymore. They're building the OS for the physical AI era.
5:50

Physical AI is the biggest opportunity most people are sleepwalking past. "Physical AI is a $50 trillion market." - Jensen at The All-In Podcast Robots. Autonomous vehicles. Embodied AI. The infrastructure to power all of it. Nvidia isn't just selling GPUs anymore. They're building the OS for the physical AI era.

Shruti

51,487 Aufrufe • vor 3 Monaten

Hello X family! Presenting RoboGPT skilling series, where we are skilling up our robots with RoboGPT to add meaning to dull, dirty and dangerous tasks. Enjoy the popcorn :) Roboskill Ep #1
2:50

Hello X family! Presenting RoboGPT skilling series, where we are skilling up our robots with RoboGPT to add meaning to dull, dirty and dangerous tasks. Enjoy the popcorn :) Roboskill Ep #1

Orangewood

29,614 Aufrufe • vor 1 Jahr

Experiments in progress. The one on the right has been learning for ~3 hours, the one in the middle for ~1 hour, and the one on the left just started a few minutes ago. The initial motivation for making the physical Atari was just to commit ourselves to a subset of algorithms that can make progress in this setup. This commitment rules out algorithms that require billions of samples to learn (or worse, require multiple environments running in parallel). Atari games are simple enough that we should be able to show learning on them in a short amount of time with no prior knowledge. Since then, I've realized that this setup is also a good way to compare different paradigms in robotics in a principled way. These paradigms are sim2real, learning from tele-operated data, and learning directly on the robots. So far, I have observed that getting sim2real to work reliably is hard. It requires tweaks that don't scale. Policies that can play perfectly in simulation fall apart because of latencies and the messiness of the real world. These aspects could be modeled to improve the simulation, but not without sinking significant human engineering hours. I have higher hopes for learning from tele-operated data, but that requires a human to learn the task first. These experiments are on my to-do list. I have to learn to play some of the games well through the robot. I’m half-decent at playing Pong and Ms Pacman now. Learning directly on robots is looking like the most promising approach. This approach takes away pesky distribution shifts and makes it possible to have algorithms that continually improve with more data and time without any human intervention. It feels great to let experiments run overnight and wake up to find improved policies. With learning on robots, I should, in principle, be able to go on a long vacation and come back to find better policies for complex tasks beyond Atari games. Whether that is possible with current learning algorithms is a different question.
1:05

Experiments in progress. The one on the right has been learning for ~3 hours, the one in the middle for ~1 hour, and the one on the left just started a few minutes ago. The initial motivation for making the physical Atari was just to commit ourselves to a subset of algorithms that can make progress in this setup. This commitment rules out algorithms that require billions of samples to learn (or worse, require multiple environments running in parallel). Atari games are simple enough that we should be able to show learning on them in a short amount of time with no prior knowledge. Since then, I've realized that this setup is also a good way to compare different paradigms in robotics in a principled way. These paradigms are sim2real, learning from tele-operated data, and learning directly on the robots. So far, I have observed that getting sim2real to work reliably is hard. It requires tweaks that don't scale. Policies that can play perfectly in simulation fall apart because of latencies and the messiness of the real world. These aspects could be modeled to improve the simulation, but not without sinking significant human engineering hours. I have higher hopes for learning from tele-operated data, but that requires a human to learn the task first. These experiments are on my to-do list. I have to learn to play some of the games well through the robot. I’m half-decent at playing Pong and Ms Pacman now. Learning directly on robots is looking like the most promising approach. This approach takes away pesky distribution shifts and makes it possible to have algorithms that continually improve with more data and time without any human intervention. It feels great to let experiments run overnight and wake up to find improved policies. With learning on robots, I should, in principle, be able to go on a long vacation and come back to find better policies for complex tasks beyond Atari games. Whether that is possible with current learning algorithms is a different question.

Khurram Javed

52,110 Aufrufe • vor 7 Monaten

When firefighters are sent out in crews of just three in a fire engine, lives are put at risk. The fragmentation of the fire and rescue service has led to a dangerous post-code lottery for firefighter crews. To protect firefighters and the public, we need national standards.
2:32

When firefighters are sent out in crews of just three in a fire engine, lives are put at risk. The fragmentation of the fire and rescue service has led to a dangerous post-code lottery for firefighter crews. To protect firefighters and the public, we need national standards.

Fire Brigades Union

26,563 Aufrufe • vor 1 Jahr

NVIDIA's Jim Fan has verified from reliable sources that the video by EngineAI is a real robot demo and not CGI. The controller is a neural net trained in the NVIDIA Isaac simulator using reinforcement learning. There’s also another video from a different angle.
0:06

NVIDIA's Jim Fan has verified from reliable sources that the video by EngineAI is a real robot demo and not CGI. The controller is a neural net trained in the NVIDIA Isaac simulator using reinforcement learning. There’s also another video from a different angle.

The Humanoid Hub

148,535 Aufrufe • vor 1 Jahr

5 HOURS IN AND THE POWER OF GOD IS BREAKING OUT! These are all lives running down to surrender fully to Jesus for the first time!! HAPPY RESURRECTION DAY FROM MOZAMBIQUE!
0:26

5 HOURS IN AND THE POWER OF GOD IS BREAKING OUT! These are all lives running down to surrender fully to Jesus for the first time!! HAPPY RESURRECTION DAY FROM MOZAMBIQUE!

Sean Feucht

32,971 Aufrufe • vor 1 Jahr

🇨🇦 ROBOT HANDS JUST LEVELED UP IN CANADA Sanctuary AI showed off a robotic hand that uses hydraulic power to grip, twist, and move like a real one. The hand can handle delicate objects, like dice, without crushing them, proving robots are getting scary precise. Hydraulic actuation gives the robot smoother, stronger control, making it better for heavy industrial work and tricky small tasks. This could change how robots work in factories, warehouses, or even in jobs too dangerous for humans. The future of robot hands? Less clunky claws, more human-like grip power with machine muscle. Source: Wevolver
1:36

🇨🇦 ROBOT HANDS JUST LEVELED UP IN CANADA Sanctuary AI showed off a robotic hand that uses hydraulic power to grip, twist, and move like a real one. The hand can handle delicate objects, like dice, without crushing them, proving robots are getting scary precise. Hydraulic actuation gives the robot smoother, stronger control, making it better for heavy industrial work and tricky small tasks. This could change how robots work in factories, warehouses, or even in jobs too dangerous for humans. The future of robot hands? Less clunky claws, more human-like grip power with machine muscle. Source: Wevolver

Mario Nawfal

50,661 Aufrufe • vor 10 Monaten

The new Codex is another jump in what agents will look like for knowledge workers. Agents that can code, work with tools, and use computers, can begin to execute long running tasks in the background for all areas of work. This can mean drafting reports, setting up data rooms for a merger, reviewing contracts, helping onboard clients, generating marketing assets, processing invoices, and more. With the Box plugin inside of the new Codex, you can begin to automate almost any kind of work with enterprise content. And importantly, being able to work across multiple apps is a huge point of leverage because we can now far more easily connect our tools together.
0:41

The new Codex is another jump in what agents will look like for knowledge workers. Agents that can code, work with tools, and use computers, can begin to execute long running tasks in the background for all areas of work. This can mean drafting reports, setting up data rooms for a merger, reviewing contracts, helping onboard clients, generating marketing assets, processing invoices, and more. With the Box plugin inside of the new Codex, you can begin to automate almost any kind of work with enterprise content. And importantly, being able to work across multiple apps is a huge point of leverage because we can now far more easily connect our tools together.

Aaron Levie

71,589 Aufrufe • vor 2 Monaten

Introducing SIMA: the first generalist AI agent to follow natural-language instructions in a broad range of 3D virtual environments and video games. 🕹️ It can complete tasks similar to a human, and outperforms an agent trained in just one setting. 🧵
0:23

Introducing SIMA: the first generalist AI agent to follow natural-language instructions in a broad range of 3D virtual environments and video games. 🕹️ It can complete tasks similar to a human, and outperforms an agent trained in just one setting. 🧵

Google DeepMind

1,061,548 Aufrufe • vor 2 Jahren

Tencent announces AppAgent Multimodal Agents as Smartphone Users paper page: Recent advancements in large language models (LLMs) have led to the creation of intelligent agents capable of performing complex tasks. This paper introduces a novel LLM-based multimodal agent framework designed to operate smartphone applications. Our framework enables the agent to operate smartphone applications through a simplified action space, mimicking human-like interactions such as tapping and swiping. This novel approach bypasses the need for system back-end access, thereby broadening its applicability across diverse apps. Central to our agent's functionality is its innovative learning method. The agent learns to navigate and use new apps either through autonomous exploration or by observing human demonstrations. This process generates a knowledge base that the agent refers to for executing complex tasks across different applications. To demonstrate the practicality of our agent, we conducted extensive testing over 50 tasks in 10 different applications, including social media, email, maps, shopping, and sophisticated image editing tools. The results affirm our agent's proficiency in handling a diverse array of high-level tasks.
1:57

Tencent announces AppAgent Multimodal Agents as Smartphone Users paper page: Recent advancements in large language models (LLMs) have led to the creation of intelligent agents capable of performing complex tasks. This paper introduces a novel LLM-based multimodal agent framework designed to operate smartphone applications. Our framework enables the agent to operate smartphone applications through a simplified action space, mimicking human-like interactions such as tapping and swiping. This novel approach bypasses the need for system back-end access, thereby broadening its applicability across diverse apps. Central to our agent's functionality is its innovative learning method. The agent learns to navigate and use new apps either through autonomous exploration or by observing human demonstrations. This process generates a knowledge base that the agent refers to for executing complex tasks across different applications. To demonstrate the practicality of our agent, we conducted extensive testing over 50 tasks in 10 different applications, including social media, email, maps, shopping, and sophisticated image editing tools. The results affirm our agent's proficiency in handling a diverse array of high-level tasks.

AK

343,834 Aufrufe • vor 2 Jahren

The same kinds of productivity gains we've seen in coding with AI agents are heading to the rest of knowledge work. This is the jump when you go from having a chatbot to being able to actually have an agent go off and do work for minutes or even hours and come back with a complete work output that you then review. Here's an example of the new Box Agent filling out an RFP response from an existing knowledge base. This process would normally take hours to fill out, and requires the full attention of the user doing the work. Now, you provide the Box Agent with the RFP questions, and it will go off, make a plan, extract all the relevant questions, read through existing source material to come up with an answer, and then generate a new word document as the final output. All while you're doing something else. The key to this architecture is that the agent is able to use all of the same tools in the background that a user uses to get work done. The agent can search for documents, read entire files, run scripts and tools in the background, and even be able to write code on the fly to automate tasks it hasn't seen before. And best of all, the Box Agent will (soon) work from the Box MCP and CLI so you can invoke it in any agentic system as a step in a process. This kind of agent complexity would have been impossible even 6 months ago. Models consistently failed at tracking long running tasks or using the right tools at the right moment for the task. But this is all now possible because of models like GPT-5.4, Opus 4.6, and Gemini 3, and is only getting better by the month. Just as we moved from engineers writing code and using AI as an assistant to answer questions, in many areas of knowledge work -like legal, finance, consulting, sales, marketing, and more- when we have a problem we'll just kick off the AI agent to just go work on it for us in the background.
2:14

The same kinds of productivity gains we've seen in coding with AI agents are heading to the rest of knowledge work. This is the jump when you go from having a chatbot to being able to actually have an agent go off and do work for minutes or even hours and come back with a complete work output that you then review. Here's an example of the new Box Agent filling out an RFP response from an existing knowledge base. This process would normally take hours to fill out, and requires the full attention of the user doing the work. Now, you provide the Box Agent with the RFP questions, and it will go off, make a plan, extract all the relevant questions, read through existing source material to come up with an answer, and then generate a new word document as the final output. All while you're doing something else. The key to this architecture is that the agent is able to use all of the same tools in the background that a user uses to get work done. The agent can search for documents, read entire files, run scripts and tools in the background, and even be able to write code on the fly to automate tasks it hasn't seen before. And best of all, the Box Agent will (soon) work from the Box MCP and CLI so you can invoke it in any agentic system as a step in a process. This kind of agent complexity would have been impossible even 6 months ago. Models consistently failed at tracking long running tasks or using the right tools at the right moment for the task. But this is all now possible because of models like GPT-5.4, Opus 4.6, and Gemini 3, and is only getting better by the month. Just as we moved from engineers writing code and using AI as an assistant to answer questions, in many areas of knowledge work -like legal, finance, consulting, sales, marketing, and more- when we have a problem we'll just kick off the AI agent to just go work on it for us in the background.

Aaron Levie

24,618 Aufrufe • vor 2 Monaten

Today is the beginning of our moonshot to solve embodied AGI in the physical world. I’m so excited to announce Project GR00T, our new initiative to create a general-purpose foundation model for humanoid robot learning. The GR00T model will enable a robot to understand multimodal instructions, such as language, video, and demonstration, and perform a variety of useful tasks. We are collaborating with many leading humanoid companies around the world, so that GR00T may transfer across embodiments and help the ecosystem thrive. GR00T is born on NVIDIA’s deep technology stack. We simulate in Isaac Lab (new app on Omniverse Isaac Sim for humanoid learning), train on OSMO (new compute orchestration system to scale up models), and deploy to Jetson Thor (new edge GPU chip designed to power GR00T). Announced in Jensen's keynote, Project GR00T is a cornerstone for the “Foundation Agent” roadmap of the newly founded GEAR Lab. At GEAR, we are building generally capable agents that learn to act skillfully in many worlds, virtual and real. See if you can spot "GEAR" in the video ;) Join us on the journey to land on the moon.
2:41

Today is the beginning of our moonshot to solve embodied AGI in the physical world. I’m so excited to announce Project GR00T, our new initiative to create a general-purpose foundation model for humanoid robot learning. The GR00T model will enable a robot to understand multimodal instructions, such as language, video, and demonstration, and perform a variety of useful tasks. We are collaborating with many leading humanoid companies around the world, so that GR00T may transfer across embodiments and help the ecosystem thrive. GR00T is born on NVIDIA’s deep technology stack. We simulate in Isaac Lab (new app on Omniverse Isaac Sim for humanoid learning), train on OSMO (new compute orchestration system to scale up models), and deploy to Jetson Thor (new edge GPU chip designed to power GR00T). Announced in Jensen's keynote, Project GR00T is a cornerstone for the “Foundation Agent” roadmap of the newly founded GEAR Lab. At GEAR, we are building generally capable agents that learn to act skillfully in many worlds, virtual and real. See if you can spot "GEAR" in the video ;) Join us on the journey to land on the moon.

Jim Fan

1,076,706 Aufrufe • vor 2 Jahren

“For the first time in many of our lives, actually Britain looks like a little haven of peace and stability” " political commentator Andrew Marr July 5, 2024
0:43

“For the first time in many of our lives, actually Britain looks like a little haven of peace and stability” " political commentator Andrew Marr July 5, 2024

Sunchartist

12,805 Aufrufe • vor 12 Tagen

Introducing Toggle for OpenClaw🦞 For the first time ever your Agent can see everything you do on the web. This is real-time context on your work day. Toggle AI analyses all browser actions, clicks, work, meetings and documents -> into AI context of what Projects / Tasks / Tools you are working on. Check it out👇
0:26

Introducing Toggle for OpenClaw🦞 For the first time ever your Agent can see everything you do on the web. This is real-time context on your work day. Toggle AI analyses all browser actions, clicks, work, meetings and documents -> into AI context of what Projects / Tasks / Tools you are working on. Check it out👇

PeLpA

52,282 Aufrufe • vor 4 Monaten