Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Evals now supports tool use. 🛠️ You can now use tools and Structured Outputs when completing eval runs, and evaluate tool calls based on the arguments passed and responses returned. This supports tools that are OpenAI-hosted, MCP, and non-hosted. Read more in our guides below.

OpenAIDevs's profile picture

OpenAI Developers

363,875 subscribers

65,080 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & TechnologieBildung
LIVE

Anya Rossi• Live Now

Private livecam show

11 Kommentare

Profilbild von OpenAI Developers
OpenAI Developersvor 1 Jahr

Web Search evaluation:

Profilbild von OpenAI Developers
OpenAI Developersvor 1 Jahr

Tools evaluation:

Profilbild von OpenAI Developers
OpenAI Developersvor 1 Jahr

Structured Outputs evaluation:

Profilbild von OpenAI Developers
OpenAI Developersvor 1 Jahr

MCP evaluation:

Profilbild von Matt Figdore
Matt Figdorevor 2 Jahren

This is the biggest productivity cheat code right now. Kiss reading documents goodbye. You can get an instant summary of any document with this tool.

Profilbild von Opulent Byte
Opulent Bytevor 1 Jahr

When o3 pro? 🥲🫠

Profilbild von Brij Singh
Brij Singhvor 1 Jahr

this is good!

Profilbild von Cliffinkent 🇬🇧
Cliffinkent 🇬🇧vor 1 Jahr

You keep building and shipping!

Profilbild von Prashant
Prashantvor 1 Jahr

This just makes running evals so much easier. Thank you

Profilbild von Vishal
Vishalvor 1 Jahr

Tool support in Evals makes testing AI tools easier and improves accuracy.

Profilbild von Henkjan de Krijger
Henkjan de Krijgervor 1 Jahr

Does relying on eval tools hinder critical thinking in AI systems?

Ähnliche Videos

Tool use is now available in beta to all customers in the Anthropic Messages API, enabling Claude to interact with external tools using structured outputs.
2:12

Tool use is now available in beta to all customers in the Anthropic Messages API, enabling Claude to interact with external tools using structured outputs.

Anthropic

560,725 Aufrufe • vor 2 Jahren

We’re excited to share the beta release of our tool use API! Now developers can easily equip any LLM with hosted open-source tools for web search, web crawling, and maps data (+ more coming soon). Under the hood, it's powered by MCP — but that's just an implementation detail ↓
3:19

We’re excited to share the beta release of our tool use API! Now developers can easily equip any LLM with hosted open-source tools for web search, web crawling, and maps data (+ more coming soon). Under the hood, it's powered by MCP — but that's just an implementation detail ↓

OpenTools

125,965 Aufrufe • vor 1 Jahr

We've added tool use support to the Workbench in the Anthropic Console so you can now test prompts that use tools.
0:26

We've added tool use support to the Workbench in the Anthropic Console so you can now test prompts that use tools.

Alex Albert

31,398 Aufrufe • vor 1 Jahr

Gemini 3.5 Flash now supports native computer use. This built-in tool lets developers build custom agents that can see and take action across browser, mobile, and desktop interfaces. Find out more →
1:21

Gemini 3.5 Flash now supports native computer use. This built-in tool lets developers build custom agents that can see and take action across browser, mobile, and desktop interfaces. Find out more →

Google DeepMind

111,914 Aufrufe • vor 17 Tagen

Here’s Nikunj Handa and Steven Heidel to show you how MCP, reasoning, and multiple Responses API tools can work together. Read more in our blog:
14:33

Here’s Nikunj Handa and Steven Heidel to show you how MCP, reasoning, and multiple Responses API tools can work together. Read more in our blog:

OpenAI Developers

77,199 Aufrufe • vor 1 Jahr

Using tools is often regarded as the hallmark of intelligence. How can robots creatively use tools beyond standard functionalities and make impossible tasks possible? 🤖🗝️ We introduce RoboTool built on LLMs, enabling multiple creative tool-use behaviors, including tool selection, sequential tool use, and tool manufacturing!🧵👇🏼
1:48

Using tools is often regarded as the hallmark of intelligence. How can robots creatively use tools beyond standard functionalities and make impossible tasks possible? 🤖🗝️ We introduce RoboTool built on LLMs, enabling multiple creative tool-use behaviors, including tool selection, sequential tool use, and tool manufacturing!🧵👇🏼

Mengdi Xu

48,218 Aufrufe • vor 2 Jahren

Uniform now supports precision surface tools for pixel art and low poly models. New tool modules implement a visible pixel grid and custom pixel queries for more advanced effects.
0:31

Uniform now supports precision surface tools for pixel art and low poly models. New tool modules implement a visible pixel grid and custom pixel queries for more advanced effects.

Sparseal

25,469 Aufrufe • vor 2 Jahren

Exa's MCP is now publicly hosted! Add web search to anything MCP-compatible, including OpenAI Responses API. Try now, docs below 👇
0:48

Exa's MCP is now publicly hosted! Add web search to anything MCP-compatible, including OpenAI Responses API. Try now, docs below 👇

Exa

32,733 Aufrufe • vor 1 Jahr

Supabase MCP server now supports creating and deploying Edge Functions! Refresh your MCP server and make sure you have the `deploy_edge_function` tool, and you are good to go! Just ask your AI tool to create an edge function or a backend, and it will create it for you!
0:24

Supabase MCP server now supports creating and deploying Edge Functions! Refresh your MCP server and make sure you have the `deploy_edge_function` tool, and you are good to go! Just ask your AI tool to create an edge function or a backend, and it will create it for you!

Tyler Shukert

28,997 Aufrufe • vor 1 Jahr

PSA: Groq Inc now supports remote MCP server integration (BETA). ⚡️ LLMs are only as good as the context you give them and MCP enables you to connect them directly to live APIs, databases, and tools. Now your models can pull fresh data, perform actions, AND respond in seconds.
7:30

PSA: Groq Inc now supports remote MCP server integration (BETA). ⚡️ LLMs are only as good as the context you give them and MCP enables you to connect them directly to live APIs, databases, and tools. Now your models can pull fresh data, perform actions, AND respond in seconds.

Hatice Ozen

13,829 Aufrufe • vor 9 Monaten

Replit now supports 450+ integrations. No matter what you're building, Replit Agent can wire it up to the tools you already use: payments, messaging, data, CRMs, design tools, analytics, and hundreds more. Just describe what you want. We'll handle the connection.
0:26

Replit now supports 450+ integrations. No matter what you're building, Replit Agent can wire it up to the tools you already use: payments, messaging, data, CRMs, design tools, analytics, and hundreds more. Just describe what you want. We'll handle the connection.

Replit ⠕

39,020 Aufrufe • vor 17 Tagen

Cline can now create and add tools to himself using MCP! Try asking him to “add a tool that pulls the latest npm docs” - Cline handles everything from creating the MCP server to installing it *into himself*, ready for future tasks. Servers are saved in ~/Documents/Cline/MCP so you can easily share tools with friends!
3:24

Cline can now create and add tools to himself using MCP! Try asking him to “add a tool that pulls the latest npm docs” - Cline handles everything from creating the MCP server to installing it *into himself*, ready for future tasks. Servers are saved in ~/Documents/Cline/MCP so you can easily share tools with friends!

Saoud Rizwan

61,730 Aufrufe • vor 1 Jahr

Streamlining the UX in Gemini CLI ✨ We got a lot of feedback on how our UI was way too cluttered with noise and text... so we made changes! 🛠️ Compact tool calls: Tool calls for reading files, folders, searching text, etc are now a single line (no more tool boxes around everything!) 💭 Topics: The agent outputs a one line overview of the rationale and direction it is going. A topic can span several tool calls and makes it easy to see what the agent is working on at a glance and why.
0:33

Streamlining the UX in Gemini CLI ✨ We got a lot of feedback on how our UI was way too cluttered with noise and text... so we made changes! 🛠️ Compact tool calls: Tool calls for reading files, folders, searching text, etc are now a single line (no more tool boxes around everything!) 💭 Topics: The agent outputs a one line overview of the rationale and direction it is going. A topic can span several tool calls and makes it easy to see what the agent is working on at a glance and why.

Jack Wotherspoon

15,960 Aufrufe • vor 2 Monaten

MCP connectors are now available in Basedash. Basedash already reads from your databases and SaaS tools. Now it can act on them too. Connect any MCP server (Linear, HubSpot, Slack, Resend, Notion, GitHub, your own internal one) and the Basedash agent gets new tools it can use right inside chat. Try it today.
0:29

MCP connectors are now available in Basedash. Basedash already reads from your databases and SaaS tools. Now it can act on them too. Connect any MCP server (Linear, HubSpot, Slack, Resend, Notion, GitHub, your own internal one) and the Basedash agent gets new tools it can use right inside chat. Try it today.

Basedash

11,138 Aufrufe • vor 1 Monat

v0 now supports tailwind configs and globals.css files — you can now use custom utility classes and CSS variables in your generations.
0:23

v0 now supports tailwind configs and globals.css files — you can now use custom utility classes and CSS variables in your generations.

v0

76,013 Aufrufe • vor 1 Jahr

ElevenLabs Conversational AI now supports MCP — letting AI agents connect to services like Salesforce, HubSpot, Gmail and more instantly. No more manual tool definitions. No more setup friction.
3:25

ElevenLabs Conversational AI now supports MCP — letting AI agents connect to services like Salesforce, HubSpot, Gmail and more instantly. No more manual tool definitions. No more setup friction.

ElevenLabs

75,999 Aufrufe • vor 1 Jahr

With Google Flow Tools, you can now use natural language to create bespoke tools and workflows. In this video, you'll see how you can: ➡️ Explore and try the various Tools within Google Flow ➡️ Remix a tool to make it even more relevant for your unique workflow ➡️Create your own tool from scratch with a natural language prompt ➡️ Share your tools with a friend for them to try out Whether you’re looking for an image editor, video resizer or custom shaders, you can now create them in Google Flow, no coding experience required.
2:30

With Google Flow Tools, you can now use natural language to create bespoke tools and workflows. In this video, you'll see how you can: ➡️ Explore and try the various Tools within Google Flow ➡️ Remix a tool to make it even more relevant for your unique workflow ➡️Create your own tool from scratch with a natural language prompt ➡️ Share your tools with a friend for them to try out Whether you’re looking for an image editor, video resizer or custom shaders, you can now create them in Google Flow, no coding experience required.

Google Flow

18,030 Aufrufe • vor 24 Tagen

130+ skills are now built into your Superagent. Some are ready to use, and some can be created based on what you need. Add a skill once, and your Superagent can use it as part of your workflows. Stack skills, connect tools, and build flows that run end-to-end.
0:32

130+ skills are now built into your Superagent. Some are ready to use, and some can be created based on what you need. Add a skill once, and your Superagent can use it as part of your workflows. Stack skills, connect tools, and build flows that run end-to-end.

Base44

1,857,797 Aufrufe • vor 3 Monaten