Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

If your AI can't call a function or hit an API, it's not really an agent (it's a chatbot). Vision Agents makes it simple to connect MCP servers and function calling so your model can interact with its surroundings: running code, fetching data, and automating tasks. Step-by-step implementation from... show more

Stream

12,312 subscribers

31,306 views • 9 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

New course: MCP: Build Rich-Context AI Apps with Anthropic. Learn to build AI apps that access tools, data, and prompts using the Model Context Protocol in this short course, created in partnership with Anthropic Anthropic and taught by Elie Schoppik Elie Schoppik, its Head of Technical Education. Connecting AI applications to external systems that bring rich context to LLM-based applications has often meant writing custom integrations for each use case. MCP is an open protocol that standardizes how LLMs access tools, data, and prompts from external sources, and simplifies how you provide context to your LLM-based applications. For example, you can provide context via third-party tools that let your LLM make API calls to search the web, access data from local docs, retrieve code from a GitHub repo, and so on. MCP, developed by Anthropic, is based on a client-server architecture that defines the communication details between an MCP client, hosted inside the AI application, and an MCP server that exposes tools, resources, and prompt templates. The server can be a subprocess launched by the client that runs locally or an independent process running remotely. In this hands-on course, you'll learn the core architecture behind MCP. You’ll create an MCP-compatible chatbot, build and deploy an MCP server, and connect the chatbot to your MCP server and other open-source servers. Here’s what you’ll do: - Understand why MCP makes AI development less fragmented and standardizes connections between AI applications and external data sources - Learn the core components of the client-server architecture of MCP and the underlying communication mechanism - Build a chatbot with custom tools for searching academic papers, and transform it into an MCP-compatible application - Build a local MCP server that exposes tools, resources, and prompt templates using FastMCP, and test it using MCP Inspector - Create an MCP client inside your chatbot to dynamically connect to your server - Connect your chatbot to reference servers built by Anthropic’s MCP team, such as filesystem, which implements filesystem operations, and fetch, which extracts contents from the web as markdown - Configure Claude Desktop to connect to your server and others, and explore how it abstracts away the low-level logic of MCP clients - Deploy your MCP server remotely and test it with the Inspector or other MCP-compatible applications - Learn about the roadmap for future MCP development, such as multi-agent architecture, MCP registry API, server discovery, authorization, and authentication MCP is an exciting and important technology that lets you build rich-context AI applications that connect to a growing ecosystem of MCP servers, with minimal integration work. Please sign up here!

New course: MCP: Build Rich-Context AI Apps with Anthropic. Learn to build AI apps that access tools, data, and prompts using the Model Context Protocol in this short course, created in partnership with Anthropic Anthropic and taught by Elie Schoppik Elie Schoppik, its Head of Technical Education. Connecting AI applications to external systems that bring rich context to LLM-based applications has often meant writing custom integrations for each use case. MCP is an open protocol that standardizes how LLMs access tools, data, and prompts from external sources, and simplifies how you provide context to your LLM-based applications. For example, you can provide context via third-party tools that let your LLM make API calls to search the web, access data from local docs, retrieve code from a GitHub repo, and so on. MCP, developed by Anthropic, is based on a client-server architecture that defines the communication details between an MCP client, hosted inside the AI application, and an MCP server that exposes tools, resources, and prompt templates. The server can be a subprocess launched by the client that runs locally or an independent process running remotely. In this hands-on course, you'll learn the core architecture behind MCP. You’ll create an MCP-compatible chatbot, build and deploy an MCP server, and connect the chatbot to your MCP server and other open-source servers. Here’s what you’ll do: - Understand why MCP makes AI development less fragmented and standardizes connections between AI applications and external data sources - Learn the core components of the client-server architecture of MCP and the underlying communication mechanism - Build a chatbot with custom tools for searching academic papers, and transform it into an MCP-compatible application - Build a local MCP server that exposes tools, resources, and prompt templates using FastMCP, and test it using MCP Inspector - Create an MCP client inside your chatbot to dynamically connect to your server - Connect your chatbot to reference servers built by Anthropic’s MCP team, such as filesystem, which implements filesystem operations, and fetch, which extracts contents from the web as markdown - Configure Claude Desktop to connect to your server and others, and explore how it abstracts away the low-level logic of MCP clients - Deploy your MCP server remotely and test it with the Inspector or other MCP-compatible applications - Learn about the roadmap for future MCP development, such as multi-agent architecture, MCP registry API, server discovery, authorization, and authentication MCP is an exciting and important technology that lets you build rich-context AI applications that connect to a growing ecosystem of MCP servers, with minimal integration work. Please sign up here!

Andrew Ng

142,010 views • 1 year ago

Metorial (@MetorialAI) makes it easy for AI agents to use tools and data. Deploy 600+ MCP integrations in three clicks and connect them to agents in a single function call. Open-source and the only serverless MCP platform built for multi-tenant systems.

Metorial (@MetorialAI) makes it easy for AI agents to use tools and data. Deploy 600+ MCP integrations in three clicks and connect them to agents in a single function call. Open-source and the only serverless MCP platform built for multi-tenant systems.

Y Combinator

15,341 views • 9 months ago

Today we're launching Amplitude MCP MCP was made for data analytics. Ask a vague question and have an AI model iteratively query Amplitude to find you insights. Amplitude MCP exposes all of Amplitude's functionality so an agent can interact with it directly. It allows you to use Amplitude without having to know anything about Amplitude's user interface or your data taxonomy. It uses the intelligence of off the shelf AI agents, including Claude, Gemini, and Cursor, to query Amplitude data you already have to find answers. It leverages all of your existing Amplitude data and how it's used to navigate through large complex behavioral datasets. You can have conversations about your product data directly inside any AI model with MCP. It can create Amplitude dashboards and notebooks with what it finds and even make recommendations. This is the best MCP use case I've ever seen. Watching an AI agent think, reason, query Amplitude, and then repeat that process iteratively is magical. See it in action:

Today we're launching Amplitude MCP MCP was made for data analytics. Ask a vague question and have an AI model iteratively query Amplitude to find you insights. Amplitude MCP exposes all of Amplitude's functionality so an agent can interact with it directly. It allows you to use Amplitude without having to know anything about Amplitude's user interface or your data taxonomy. It uses the intelligence of off the shelf AI agents, including Claude, Gemini, and Cursor, to query Amplitude data you already have to find answers. It leverages all of your existing Amplitude data and how it's used to navigate through large complex behavioral datasets. You can have conversations about your product data directly inside any AI model with MCP. It can create Amplitude dashboards and notebooks with what it finds and even make recommendations. This is the best MCP use case I've ever seen. Watching an AI agent think, reason, query Amplitude, and then repeat that process iteratively is magical. See it in action:

Spenser Skates

32,332 views • 9 months ago

This AI agent is a powerful data analyst It can search, process, complete and visualize your data in a single chat. You can import files or start from scratch. Step-by-step process with Genspark:

This AI agent is a powerful data analyst It can search, process, complete and visualize your data in a single chat. You can import files or start from scratch. Step-by-step process with Genspark:

Paul Couvert

58,000 views • 1 year ago

Introducing LangSmith Agent Builder 🤖🧱 A true agent building experience (not workflows!!), all through a simple natural language interface. Describe your agent to "build" it, then interact with it via chat, or add an automatic trigger. Connect your agents to any MCP server, or use our builtin tools. These agents also come with builtin memory, so they can optimize themselves over time, both ambiently, and from user feedback! Sign up for the waitlist today:

Introducing LangSmith Agent Builder 🤖🧱 A true agent building experience (not workflows!!), all through a simple natural language interface. Describe your agent to "build" it, then interact with it via chat, or add an automatic trigger. Connect your agents to any MCP server, or use our builtin tools. These agents also come with builtin memory, so they can optimize themselves over time, both ambiently, and from user feedback! Sign up for the waitlist today:

Brace

30,846 views • 9 months ago

New short course: Building Code Agents with Hugging Face smolagents! Learn how to build code agents in this course, created in collaboration with Hugging Face, and taught by Thomas Wolf, its co-founder and CSO, and m_ric, Hugging Face’s Project Lead on Agents. Tool-calling agents use LLMs to generate multiple function calls sequentially to complete a complex sequence of tasks. They generate one function call, execute it, observe, reason, and decide what to do next. Code agents take a different approach. They consolidate all these calls into a single block of code, letting the LLM lay out an entire action plan at once, which can be executed efficiently to provide more reliable results. You’ll learn how to code agents using smolagents, a lightweight agentic framework from Hugging Face. Along the way, you’ll learn how to run LLM-generated code safely and develop an evaluation system to optimize your code agent for production. In detail, you’ll learn: - How agentic systems have evolved, gaining greater levels of agency over time—and why code agents are a next step. - How code agents write their actions in code. - When code agents outperform function-calling agents. - How to run code agents safely in your system using a constrained Python interpreter and sandboxing using E2B. - To trace, debug, and assess the code agent to optimize its behaviours for complex requests. - How to build a research multi-agent system that can find information online and organize it into an interactive report. By the end of this course, you’ll know how to build and run code agents using smolagents, and deploy them safely with a structured evaluation system in your projects. Please sign up here!

New short course: Building Code Agents with Hugging Face smolagents! Learn how to build code agents in this course, created in collaboration with Hugging Face, and taught by Thomas Wolf, its co-founder and CSO, and m_ric, Hugging Face’s Project Lead on Agents. Tool-calling agents use LLMs to generate multiple function calls sequentially to complete a complex sequence of tasks. They generate one function call, execute it, observe, reason, and decide what to do next. Code agents take a different approach. They consolidate all these calls into a single block of code, letting the LLM lay out an entire action plan at once, which can be executed efficiently to provide more reliable results. You’ll learn how to code agents using smolagents, a lightweight agentic framework from Hugging Face. Along the way, you’ll learn how to run LLM-generated code safely and develop an evaluation system to optimize your code agent for production. In detail, you’ll learn: - How agentic systems have evolved, gaining greater levels of agency over time—and why code agents are a next step. - How code agents write their actions in code. - When code agents outperform function-calling agents. - How to run code agents safely in your system using a constrained Python interpreter and sandboxing using E2B. - To trace, debug, and assess the code agent to optimize its behaviours for complex requests. - How to build a research multi-agent system that can find information online and organize it into an interactive report. By the end of this course, you’ll know how to build and run code agents using smolagents, and deploy them safely with a structured evaluation system in your projects. Please sign up here!

Andrew Ng

127,724 views • 1 year ago

I built a Deepseek R1 RAG Reasoning Agent running locally on my computer. It's an Agentic RAG reasoning agent that can think, reason and fall back to web search if needed. 100% Opensource code with step-by-step tutorial.

I built a Deepseek R1 RAG Reasoning Agent running locally on my computer. It's an Agentic RAG reasoning agent that can think, reason and fall back to web search if needed. 100% Opensource code with step-by-step tutorial.

Shubham Saboo

124,490 views • 1 year ago

New short course: Build AI Apps with MCP Servers: Working with Box Files, built with Box and taught by Ben Kus , their CTO. Many AI applications require custom code for basic file operations. The Model Context Protocol (MCP) standardizes this by letting you offload file tasks to dedicated servers that provide tools an LLM can use directly. In this course, you'll process documents stored in a Box folder using the Box MCP server. Rather than writing custom integration code to connect to the Box API and download files, you'll design your application to use the tools provided via MCP. Skills you'll gain: - Build an LLM-powered document processing app, using the Box MCP server to access files - Design a multi-agent system using Google's Agent Development Kit (ADK), consisting of specialized agents for file operations - Coordinate the multi-agent workflow through an orchestrator that uses the Agent2Agent (A2A) protocol to connect to the agents You'll start with a local file-processing app, refactor it to work with Box's MCP server, then evolve it into a multi-agent system. Sign up here:

New short course: Build AI Apps with MCP Servers: Working with Box Files, built with Box and taught by Ben Kus , their CTO. Many AI applications require custom code for basic file operations. The Model Context Protocol (MCP) standardizes this by letting you offload file tasks to dedicated servers that provide tools an LLM can use directly. In this course, you'll process documents stored in a Box folder using the Box MCP server. Rather than writing custom integration code to connect to the Box API and download files, you'll design your application to use the tools provided via MCP. Skills you'll gain: - Build an LLM-powered document processing app, using the Box MCP server to access files - Design a multi-agent system using Google's Agent Development Kit (ADK), consisting of specialized agents for file operations - Coordinate the multi-agent workflow through an orchestrator that uses the Agent2Agent (A2A) protocol to connect to the agents You'll start with a local file-processing app, refactor it to work with Box's MCP server, then evolve it into a multi-agent system. Sign up here:

Andrew Ng

81,696 views • 10 months ago

AI Agents can now connect to 100,000+ APIs instantly. Postman's AI Agent builder can turn any API into an MCP server in seconds without writing a single line of Code. You can use it in Claude, Cursor, Windsurf and other AI tools.

AI Agents can now connect to 100,000+ APIs instantly. Postman's AI Agent builder can turn any API into an MCP server in seconds without writing a single line of Code. You can use it in Claude, Cursor, Windsurf and other AI tools.

Shubham Saboo

79,818 views • 1 year ago

What if you can build an Agent with it own computer in a single api call? At my Google I/O talk, I showed how to use Gemini Managed Agents and the new Interactions API to give your AI a secure, hosted Linux sandbox to execute code and manage its own memory.

What if you can build an Agent with it own computer in a single api call? At my Google I/O talk, I showed how to use Gemini Managed Agents and the new Interactions API to give your AI a secure, hosted Linux sandbox to execute code and manage its own memory.

Philipp Schmid

21,769 views • 2 months ago

Today we open Laravel MCP (beta) to the public! Laravel MCP is a library that makes it simple to build Model Context Protocol servers in your Laravel apps. This gives AI clients (like Claude, Cursor, & ChatGPT) a structured way to interact with your application. It's already been field tested by powering Laravel Boost.

Today we open Laravel MCP (beta) to the public! Laravel MCP is a library that makes it simple to build Model Context Protocol servers in your Laravel apps. This gives AI clients (like Claude, Cursor, & ChatGPT) a structured way to interact with your application. It's already been field tested by powering Laravel Boost.

Laravel

78,050 views • 10 months ago

Jupyter Agents - LLMs running data analysis directly in a notebook! The agent can load data, execute code, plot results and following your guidance and ideas! A very natural way to collaborate with an LLM over data and it's just scratching the surface of what's possible soon!

Jupyter Agents - LLMs running data analysis directly in a notebook! The agent can load data, execute code, plot results and following your guidance and ideas! A very natural way to collaborate with an LLM over data and it's just scratching the surface of what's possible soon!

Leandro von Werra

200,291 views • 1 year ago

LFG! Nous Research's Hermes Agent is live on the Umbrel App Store! It's an AI agent that gets smarter the longer it runs, remembers stuff with persistent memory across sessions, learns your workflow, and autonomously creates its own reusable skills from experience. And it's sandboxed like every Umbrel app so it can't touch anything it's not supposed to. 1-click install. Login with ChatGPT, use an OpenRouter/OpenAI/Anthropic API key, or point it to a local Ollama model running on the same Umbrel.

LFG! Nous Research's Hermes Agent is live on the Umbrel App Store! It's an AI agent that gets smarter the longer it runs, remembers stuff with persistent memory across sessions, learns your workflow, and autonomously creates its own reusable skills from experience. And it's sandboxed like every Umbrel app so it can't touch anything it's not supposed to. 1-click install. Login with ChatGPT, use an OpenRouter/OpenAI/Anthropic API key, or point it to a local Ollama model running on the same Umbrel.

Umbrel ☂️

29,882 views • 3 months ago

I launched last night and already 130+ people have signed up including an OF model (lmao) and the CEO of an AI startup. If your AI agent wants to rent a person to do an IRL task for them its as simple as one MCP call.

I launched last night and already 130+ people have signed up including an OF model (lmao) and the CEO of an AI startup. If your AI agent wants to rent a person to do an IRL task for them its as simple as one MCP call.

Alex

4,819,460 views • 6 months ago

You can now give AI agents the ability to interact with ANY website. This new MCP server lets Claude, Cursor, or any AI agent navigate, click, fill forms, and extract data from sites without APIs. Just connect it and give it a URL + goal. Here’s how to set it up:

You can now give AI agents the ability to interact with ANY website. This new MCP server lets Claude, Cursor, or any AI agent navigate, click, fill forms, and extract data from sites without APIs. Just connect it and give it a URL + goal. Here’s how to set it up:

Alvaro Cintas

77,654 views • 7 months ago

Select. Ask. Solve ✅ Your coding agent can now connect directly to your active browser session. Whether it's a wonky div in the Elements panel or a failed API call, just select it and let the agent get to work →

Select. Ask. Solve ✅ Your coding agent can now connect directly to your active browser session. Whether it's a wonky div in the Elements panel or a failed API call, just select it and let the agent get to work →

Chrome for Developers

35,410 views • 7 months ago

Building an Agentic Search System Building an agentic system is not too hard. Loops, function calling, tool execution, and the model. That's it! I show in this video how to build a search agent from scratch. ~350 lines of code!

Building an Agentic Search System Building an agentic system is not too hard. Loops, function calling, tool execution, and the model. That's it! I show in this video how to build a search agent from scratch. ~350 lines of code!

elvis

57,290 views • 1 year ago

Function calling is a powerful way to extend the capabilities of LLMs and AI agents by letting them use external tools. Our new short course Function calling and Data Extraction with LLMs, created with @NexusflowX and taught by Jiantao Jiao and Venkat, demonstrates how to prompt LLMs to form calls to external functions. You'll work with NexusRavenV2-13B, a 13B parameter open-source model that excels in function calling tasks while still being small enough to host locally. Learn to use function calling to extract structured data from unstructured text and access web APIs, and build an end-to-end application that processes customer service transcripts. You'll learn how to build LLM-powered applications that can analyze feedback, automate data entry, and enhance search. Please get started here:

Function calling is a powerful way to extend the capabilities of LLMs and AI agents by letting them use external tools. Our new short course Function calling and Data Extraction with LLMs, created with @NexusflowX and taught by Jiantao Jiao and Venkat, demonstrates how to prompt LLMs to form calls to external functions. You'll work with NexusRavenV2-13B, a 13B parameter open-source model that excels in function calling tasks while still being small enough to host locally. Learn to use function calling to extract structured data from unstructured text and access web APIs, and build an end-to-end application that processes customer service transcripts. You'll learn how to build LLM-powered applications that can analyze feedback, automate data entry, and enhance search. Please get started here:

Andrew Ng

110,606 views • 2 years ago

[3/5] Introducing Agent Mode ✨ Agent Mode is a simple way to bootstrap an automation from scratch with Notte. Prompt a browser agent in natural language, let it execute the task step by step, then automatically convert its execution into deterministic & editable code. Open it in Automation Studio and continue iterating from there!

[3/5] Introducing Agent Mode ✨ Agent Mode is a simple way to bootstrap an automation from scratch with Notte. Prompt a browser agent in natural language, let it execute the task step by step, then automatically convert its execution into deterministic & editable code. Open it in Automation Studio and continue iterating from there!

Notte

12,101 views • 7 months ago

Postman is going all-in on AI! Their AI Agent Builder is live (and it's pretty powerful!) Postman's API Network has 100,000+ APIs and they just released a suite of tools for building AI Agents that can automatically discover and connect to any of these APIs. Think about it for a second: You can now build an AI agent that searches the network, discovers an API, processes its documentation, connects to it, and evaluates whether everything worked at the end of the process. This is a huge deal. Every person I know uses the Postman client to work with APIs. Now, they will have access to the AI Agent Builder, a complete suite for designing, building, testing, and deploying agents. I've built a few simple agents myself, and it's tough. The ability to discover and use an API automatically is really exciting (and a huge time saver if it works as promised!) In collaboration with the Postman team, who is sponsoring this post, I recorded a video with my thoughts about the Postman AI Agent Builder.

Postman is going all-in on AI! Their AI Agent Builder is live (and it's pretty powerful!) Postman's API Network has 100,000+ APIs and they just released a suite of tools for building AI Agents that can automatically discover and connect to any of these APIs. Think about it for a second: You can now build an AI agent that searches the network, discovers an API, processes its documentation, connects to it, and evaluates whether everything worked at the end of the process. This is a huge deal. Every person I know uses the Postman client to work with APIs. Now, they will have access to the AI Agent Builder, a complete suite for designing, building, testing, and deploying agents. I've built a few simple agents myself, and it's tough. The ability to discover and use an API automatically is really exciting (and a huge time saver if it works as promised!) In collaboration with the Postman team, who is sponsoring this post, I recorded a video with my thoughts about the Postman AI Agent Builder.

Santiago

230,594 views • 1 year ago