Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Robotics: coding agents’ next frontier. So how good are they? We introduce CaP-X: an open-source framework and benchmark for coding agents, where they write code for robot perception and control, execute it on sim and real robots, observe the outcomes, and iteratively improve code reliability. From NVIDIA Berkeley AI... show more

Max Fu

1,584 subscribers

173,950 views • 3 months ago •via X (Twitter)

Education News & Politics Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

The new Factory software AI agents just combined OpenAI’s Codex, Devin, and Cursor into one product. They are fully autonomous agents called Droids that perform deep code research, technical docs, and do autonomous end-to-end coding. Here’s how it works (with real examples)👇:

The new Factory software AI agents just combined OpenAI’s Codex, Devin, and Cursor into one product. They are fully autonomous agents called Droids that perform deep code research, technical docs, and do autonomous end-to-end coding. Here’s how it works (with real examples)👇:

Alvaro Cintas

94,866 views • 1 year ago

My talk from the AI Engineer Code Summit is out! 🚨 "How Claude Code Works" and what we can learn about frontier agent architectures. Coding agents are suddenly really really good, and I'm trying to understand why. In short: better models, simple loop design, and bash tools

My talk from the AI Engineer Code Summit is out! 🚨 "How Claude Code Works" and what we can learn about frontier agent architectures. Coding agents are suddenly really really good, and I'm trying to understand why. In short: better models, simple loop design, and bash tools

Jared Zoneraich

13,936 views • 6 months ago

What happens when open-source robotics meets agentic AI? 🤖 On the NVIDIA AI Podcast, Seeed Studio’s Eric Pan and Elaine Wu discuss OpenClaw, NVIDIA Jetson-powered robot arms, and how makers are bringing physical AI into the real world. 🎧 Listen now:

What happens when open-source robotics meets agentic AI? 🤖 On the NVIDIA AI Podcast, Seeed Studio’s Eric Pan and Elaine Wu discuss OpenClaw, NVIDIA Jetson-powered robot arms, and how makers are bringing physical AI into the real world. 🎧 Listen now:

NVIDIA Robotics

39,682 views • 1 month ago

Hoping your coding agents could understand you and adapt to your preferences? Meet TOM-SWE, our new framework for coding agents that don’t just write code, but model the user's mind persistently (ranging from general preferences to small details) arxiv: ❓Motivation: Most coding agents today can plan, edit, run, and test code. But they still fail at a key part of real-world development, understanding the user! Underspecified, shifting, or context-dependent instructions can easily break them. You must have those moments when coding agents were running for 10 minutes and ended up producing things largely misaligned. (1/)

Hoping your coding agents could understand you and adapt to your preferences? Meet TOM-SWE, our new framework for coding agents that don’t just write code, but model the user's mind persistently (ranging from general preferences to small details) arxiv: ❓Motivation: Most coding agents today can plan, edit, run, and test code. But they still fail at a key part of real-world development, understanding the user! Underspecified, shifting, or context-dependent instructions can easily break them. You must have those moments when coding agents were running for 10 minutes and ended up producing things largely misaligned. (1/)

Xuhui Zhou

40,135 views • 8 months ago

The missing piece for the ChatGPT moment of robotics is finally here Today, we are releasing phosphobot, an open-source app to control robots intuitively and train the most powerful AI models for the cheapest robots possible -> phospho-app/phosphobot 🧵 What we are building:

The missing piece for the ChatGPT moment of robotics is finally here Today, we are releasing phosphobot, an open-source app to control robots intuitively and train the most powerful AI models for the cheapest robots possible -> phospho-app/phosphobot 🧵 What we are building:

Pierre-Louis Biojout (PLB)

35,844 views • 1 year ago

AI coding agents aren't just about autocorrect, but how do you get the best coding experience with an AI-powered coding agent? In our new short course, Build Apps with Windsurf’s AI Coding Agents, you'll learn how to build, debug, and deploy applications with agentic AI-powered integrated development environment (IDE). AI coding agents, like Codeium's @windsurf, don’t just suggest code, they analyze your codebase, track changes, retrieve relevant information, and apply updates across multiple files. They can help debug, refactor, and even modernize legacy frameworks. But to use them effectively, you need the right approach. This new course shows you how to: 🛠️ Use AI agents to build and refine applications, like a Wikipedia analysis app. 🐞 Debug and refactor JavaScript with AI-assisted automation. 🔍 Understand how search and retrieval power AI coding agents. 🤖 Guide an AI agent effectively—prompting, iterating, and correcting when needed. Taught by Anshul Ramachandran (Anshul Ramachandran), this course gives you hands-on coding experience, insights into how these AI systems work under the hood, and best practices to improve your development workflow. 🔗 Enroll for free:

AI coding agents aren't just about autocorrect, but how do you get the best coding experience with an AI-powered coding agent? In our new short course, Build Apps with Windsurf’s AI Coding Agents, you'll learn how to build, debug, and deploy applications with agentic AI-powered integrated development environment (IDE). AI coding agents, like Codeium's @windsurf, don’t just suggest code, they analyze your codebase, track changes, retrieve relevant information, and apply updates across multiple files. They can help debug, refactor, and even modernize legacy frameworks. But to use them effectively, you need the right approach. This new course shows you how to: 🛠️ Use AI agents to build and refine applications, like a Wikipedia analysis app. 🐞 Debug and refactor JavaScript with AI-assisted automation. 🔍 Understand how search and retrieval power AI coding agents. 🤖 Guide an AI agent effectively—prompting, iterating, and correcting when needed. Taught by Anshul Ramachandran (Anshul Ramachandran), this course gives you hands-on coding experience, insights into how these AI systems work under the hood, and best practices to improve your development workflow. 🔗 Enroll for free:

DeepLearning.AI

23,255 views • 1 year ago

4/ Crew AI Orchestration framework for building reliable autonomous AI agents This example shows an agent that automatically creates and schedules social media posts, but it can research, code, and even write apps João Moura あい

4/ Crew AI Orchestration framework for building reliable autonomous AI agents This example shows an agent that automatically creates and schedules social media posts, but it can research, code, and even write apps João Moura あい

Alex Reibman 🖇️

36,126 views • 2 years ago

🍐PearAI (YC F24) is an open source AI code editor with a curated inventory of the best AI tools, natively integrated for effortless AI-powered coding. They're building a flexible framework for the AI coding tech stack under a unified UX: Congrats on the launch, 🟢 nang 🟢 and @CodeFryingPan!

🍐PearAI (YC F24) is an open source AI code editor with a curated inventory of the best AI tools, natively integrated for effortless AI-powered coding. They're building a flexible framework for the AI coding tech stack under a unified UX: Congrats on the launch, 🟢 nang 🟢 and @CodeFryingPan!

Y Combinator

53,960 views • 1 year ago

🧲 Meet Magnet — the AI workspace for agentic coding. Build software with Claude Code, Cursor, Codex & co. → Write a ticket → Magnet assembles context → Fires to Claude Code, Deep Research, and other agent sessions in parallel Git worktree sandboxes → PRs appear → Use agents to help you spec, research, and decompose tasks Let your agents cook!

🧲 Meet Magnet — the AI workspace for agentic coding. Build software with Claude Code, Cursor, Codex & co. → Write a ticket → Magnet assembles context → Fires to Claude Code, Deep Research, and other agent sessions in parallel Git worktree sandboxes → PRs appear → Use agents to help you spec, research, and decompose tasks Let your agents cook!

Nicolae Rusan

16,608 views • 1 year ago

Superior Agents are the most powerful AI agents on the market. They make decisions without human input, learn from real-world experience, and evolve over time. Powered by the open-source Superior Agents framework. If you’re building intelligent agents, start here.

Superior Agents are the most powerful AI agents on the market. They make decisions without human input, learn from real-world experience, and evolve over time. Powered by the open-source Superior Agents framework. If you’re building intelligent agents, start here.

KIP Protocol

125,823 views • 1 year ago

Physics AI 🌊 Jensen just unveiled the NVIDIA Isaac GR00T Reference Humanoid Robot at GTC Taipei--the world’s first open-source humanoid robot reference design Built on Jetson Thor edge computing and the Isaac GR00T open platform, it features a Unitree H2 Plus body with Sharpa five-finger dexterous hands and 75 degrees of freedom. Even before Physical AI truly explodes, NVIDIA has built a complete end-to-end full-stack infrastructure: >chips (Jetson Thor + Blackwell), >synthetic data (GR00T-Dreams), >world models (Cosmos), >foundation models (GR00T N-series VLA), >high-fidelity simulation platforms (Isaac Sim + Isaac Lab + Omniverse). Dozens of humanoid robot companies ,including Agility Robotics, Aglie robotics,Boston Dynamics, Figure, 1X, NEURA Robotics, XPENG Robotics, and more are already running large-scale daily simulation training on this platform, rapidly iterating perception, reasoning, and actions in virtual environments, speeding up the jump from lab prototypes to real factory deployment. By providing an open reference design and full-stack tools, NVIDIA has dramatically lowered the barrier, letting every robotics team join the Physical AI wave with low cost and high efficiency.

Physics AI 🌊 Jensen just unveiled the NVIDIA Isaac GR00T Reference Humanoid Robot at GTC Taipei--the world’s first open-source humanoid robot reference design Built on Jetson Thor edge computing and the Isaac GR00T open platform, it features a Unitree H2 Plus body with Sharpa five-finger dexterous hands and 75 degrees of freedom. Even before Physical AI truly explodes, NVIDIA has built a complete end-to-end full-stack infrastructure: >chips (Jetson Thor + Blackwell), >synthetic data (GR00T-Dreams), >world models (Cosmos), >foundation models (GR00T N-series VLA), >high-fidelity simulation platforms (Isaac Sim + Isaac Lab + Omniverse). Dozens of humanoid robot companies ,including Agility Robotics, Aglie robotics,Boston Dynamics, Figure, 1X, NEURA Robotics, XPENG Robotics, and more are already running large-scale daily simulation training on this platform, rapidly iterating perception, reasoning, and actions in virtual environments, speeding up the jump from lab prototypes to real factory deployment. By providing an open reference design and full-stack tools, NVIDIA has dramatically lowered the barrier, letting every robotics team join the Physical AI wave with low cost and high efficiency.

CyberRobo

17,092 views • 1 month ago

Demis Hassabis says the next frontier is AI self-improvement — and coding is where it starts, because the outputs are verifiable and synthetic data is limitless That's a compounding flywheel, and every major lab is betting on it "but raw capability without reliability is a liability"

Demis Hassabis says the next frontier is AI self-improvement — and coding is where it starts, because the outputs are verifiable and synthetic data is limitless That's a compounding flywheel, and every major lab is betting on it "but raw capability without reliability is a liability"

Haider.

15,428 views • 1 month ago

New short course: Building Code Agents with Hugging Face smolagents! Learn how to build code agents in this course, created in collaboration with Hugging Face, and taught by Thomas Wolf, its co-founder and CSO, and m_ric, Hugging Face’s Project Lead on Agents. Tool-calling agents use LLMs to generate multiple function calls sequentially to complete a complex sequence of tasks. They generate one function call, execute it, observe, reason, and decide what to do next. Code agents take a different approach. They consolidate all these calls into a single block of code, letting the LLM lay out an entire action plan at once, which can be executed efficiently to provide more reliable results. You’ll learn how to code agents using smolagents, a lightweight agentic framework from Hugging Face. Along the way, you’ll learn how to run LLM-generated code safely and develop an evaluation system to optimize your code agent for production. In detail, you’ll learn: - How agentic systems have evolved, gaining greater levels of agency over time—and why code agents are a next step. - How code agents write their actions in code. - When code agents outperform function-calling agents. - How to run code agents safely in your system using a constrained Python interpreter and sandboxing using E2B. - To trace, debug, and assess the code agent to optimize its behaviours for complex requests. - How to build a research multi-agent system that can find information online and organize it into an interactive report. By the end of this course, you’ll know how to build and run code agents using smolagents, and deploy them safely with a structured evaluation system in your projects. Please sign up here!

New short course: Building Code Agents with Hugging Face smolagents! Learn how to build code agents in this course, created in collaboration with Hugging Face, and taught by Thomas Wolf, its co-founder and CSO, and m_ric, Hugging Face’s Project Lead on Agents. Tool-calling agents use LLMs to generate multiple function calls sequentially to complete a complex sequence of tasks. They generate one function call, execute it, observe, reason, and decide what to do next. Code agents take a different approach. They consolidate all these calls into a single block of code, letting the LLM lay out an entire action plan at once, which can be executed efficiently to provide more reliable results. You’ll learn how to code agents using smolagents, a lightweight agentic framework from Hugging Face. Along the way, you’ll learn how to run LLM-generated code safely and develop an evaluation system to optimize your code agent for production. In detail, you’ll learn: - How agentic systems have evolved, gaining greater levels of agency over time—and why code agents are a next step. - How code agents write their actions in code. - When code agents outperform function-calling agents. - How to run code agents safely in your system using a constrained Python interpreter and sandboxing using E2B. - To trace, debug, and assess the code agent to optimize its behaviours for complex requests. - How to build a research multi-agent system that can find information online and organize it into an interactive report. By the end of this course, you’ll know how to build and run code agents using smolagents, and deploy them safely with a structured evaluation system in your projects. Please sign up here!

Andrew Ng

124,382 views • 1 year ago

Robotics is the next frontier for AI, surpassing $150B in the next 2 years. OpenMind works alongside major players like Circle, NVIDIA, and Unitree to build important software that powers the AI brains in robots. Therefore, Fabric Foundation was established to build a path for open robotics across the world and to hasten the development of onchain payments, identity, and governance infrastructure. The decentralized robot economy begins today, powered by $ROBO.

Robotics is the next frontier for AI, surpassing $150B in the next 2 years. OpenMind works alongside major players like Circle, NVIDIA, and Unitree to build important software that powers the AI brains in robots. Therefore, Fabric Foundation was established to build a path for open robotics across the world and to hasten the development of onchain payments, identity, and governance infrastructure. The decentralized robot economy begins today, powered by $ROBO.

Fabric Foundation

104,335 views • 4 months ago

AI coding tools are everywhere. Yet they all fall short when scaling to 100s of developers and complex codebases. We’re solving this problem Augment Code. Introducing Augment Code, the first developer AI purpose-built for teams.🧵

AI coding tools are everywhere. Yet they all fall short when scaling to 100s of developers and complex codebases. We’re solving this problem Augment Code. Introducing Augment Code, the first developer AI purpose-built for teams.🧵

Scott Dietzen

91,368 views • 1 year ago

LeetCode is dead. Developers don't write code line-by-line anymore. They orchestrate AI agents working in parallel, review AI-generated code, and make architectural decisions. That's the job now. But most interview processes haven't caught up. They still test algorithm memorization instead of AI fluency, code review, and judgment. We're building assessments for next-gen hiring that mirror how developers actually work. Here's how we think about it:

LeetCode is dead. Developers don't write code line-by-line anymore. They orchestrate AI agents working in parallel, review AI-generated code, and make architectural decisions. That's the job now. But most interview processes haven't caught up. They still test algorithm memorization instead of AI fluency, code review, and judgment. We're building assessments for next-gen hiring that mirror how developers actually work. Here's how we think about it:

HackerRank

343,619 views • 3 months ago