Загрузка видео...

Не удалось загрузить видео

На главную

Evals now supports tool use. 🛠️ You can now use tools and Structured Outputs when completing eval runs, and evaluate tool calls based on the arguments passed and responses returned. This supports tools that are OpenAI-hosted, MCP, and non-hosted. Read more in our guides below.

OpenAIDevs's profile picture

OpenAI Developers

330,799 subscribers

65,069 просмотров • 1 год назад •via X (Twitter)

Наука и технологииОбразование
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 11

Фото профиля OpenAI Developers
OpenAI Developers1 год назад

Web Search evaluation:

Фото профиля OpenAI Developers
OpenAI Developers1 год назад

Tools evaluation:

Фото профиля OpenAI Developers
OpenAI Developers1 год назад

Structured Outputs evaluation:

Фото профиля OpenAI Developers
OpenAI Developers1 год назад

MCP evaluation:

Фото профиля Matt Figdore
Matt Figdore2 лет назад

This is the biggest productivity cheat code right now. Kiss reading documents goodbye. You can get an instant summary of any document with this tool.

Фото профиля Opulent Byte
Opulent Byte1 год назад

When o3 pro? 🥲🫠

Фото профиля Brij Singh
Brij Singh1 год назад

this is good!

Фото профиля Cliffinkent 🇬🇧
Cliffinkent 🇬🇧1 год назад

You keep building and shipping!

Фото профиля Prashant
Prashant1 год назад

This just makes running evals so much easier. Thank you

Фото профиля Vishal
Vishal1 год назад

Tool support in Evals makes testing AI tools easier and improves accuracy.

Фото профиля Henkjan de Krijger
Henkjan de Krijger1 год назад

Does relying on eval tools hinder critical thinking in AI systems?

Похожие видео

Tool use is now available in beta to all customers in the Anthropic Messages API, enabling Claude to interact with external tools using structured outputs.
2:12

Tool use is now available in beta to all customers in the Anthropic Messages API, enabling Claude to interact with external tools using structured outputs.

Anthropic

560,725 просмотров • 2 лет назад

I'm exploring running LLMs locally on iPhones and Macs. I’ve got Llama 3.2 running locally using Apple’s MLX and with support for tool calling. This example runs two LLMs: one to identify tools to call based on the query and one to generate responses based on the tools’ outputs.
0:39

I'm exploring running LLMs locally on iPhones and Macs. I’ve got Llama 3.2 running locally using Apple’s MLX and with support for tool calling. This example runs two LLMs: one to identify tools to call based on the query and one to generate responses based on the tools’ outputs.

Simon B. Støvring

47,972 просмотров • 1 год назад

We’re excited to share the beta release of our tool use API! Now developers can easily equip any LLM with hosted open-source tools for web search, web crawling, and maps data (+ more coming soon). Under the hood, it's powered by MCP — but that's just an implementation detail ↓
3:19

We’re excited to share the beta release of our tool use API! Now developers can easily equip any LLM with hosted open-source tools for web search, web crawling, and maps data (+ more coming soon). Under the hood, it's powered by MCP — but that's just an implementation detail ↓

OpenTools

125,965 просмотров • 1 год назад

Here’s Nikunj Handa and Steven Heidel to show you how MCP, reasoning, and multiple Responses API tools can work together. Read more in our blog:
14:33

Here’s Nikunj Handa and Steven Heidel to show you how MCP, reasoning, and multiple Responses API tools can work together. Read more in our blog:

OpenAI Developers

77,197 просмотров • 1 год назад

Using tools is often regarded as the hallmark of intelligence. How can robots creatively use tools beyond standard functionalities and make impossible tasks possible? 🤖🗝️ We introduce RoboTool built on LLMs, enabling multiple creative tool-use behaviors, including tool selection, sequential tool use, and tool manufacturing!🧵👇🏼
1:48

Using tools is often regarded as the hallmark of intelligence. How can robots creatively use tools beyond standard functionalities and make impossible tasks possible? 🤖🗝️ We introduce RoboTool built on LLMs, enabling multiple creative tool-use behaviors, including tool selection, sequential tool use, and tool manufacturing!🧵👇🏼

Mengdi Xu

48,204 просмотров • 2 лет назад

Uniform now supports precision surface tools for pixel art and low poly models. New tool modules implement a visible pixel grid and custom pixel queries for more advanced effects.
0:31

Uniform now supports precision surface tools for pixel art and low poly models. New tool modules implement a visible pixel grid and custom pixel queries for more advanced effects.

Sparseal

25,461 просмотров • 2 лет назад

Exa's MCP is now publicly hosted! Add web search to anything MCP-compatible, including OpenAI Responses API. Try now, docs below 👇
0:48

Exa's MCP is now publicly hosted! Add web search to anything MCP-compatible, including OpenAI Responses API. Try now, docs below 👇

Exa

32,733 просмотров • 1 год назад

Supabase MCP server now supports creating and deploying Edge Functions! Refresh your MCP server and make sure you have the `deploy_edge_function` tool, and you are good to go! Just ask your AI tool to create an edge function or a backend, and it will create it for you!
0:24

Supabase MCP server now supports creating and deploying Edge Functions! Refresh your MCP server and make sure you have the `deploy_edge_function` tool, and you are good to go! Just ask your AI tool to create an edge function or a backend, and it will create it for you!

Tyler Shukert

28,997 просмотров • 1 год назад

PSA: Groq Inc now supports remote MCP server integration (BETA). ⚡️ LLMs are only as good as the context you give them and MCP enables you to connect them directly to live APIs, databases, and tools. Now your models can pull fresh data, perform actions, AND respond in seconds.
7:30

PSA: Groq Inc now supports remote MCP server integration (BETA). ⚡️ LLMs are only as good as the context you give them and MCP enables you to connect them directly to live APIs, databases, and tools. Now your models can pull fresh data, perform actions, AND respond in seconds.

Hatice Ozen

13,829 просмотров • 9 месяцев назад

Cline can now create and add tools to himself using MCP! Try asking him to “add a tool that pulls the latest npm docs” - Cline handles everything from creating the MCP server to installing it *into himself*, ready for future tasks. Servers are saved in ~/Documents/Cline/MCP so you can easily share tools with friends!
3:24

Cline can now create and add tools to himself using MCP! Try asking him to “add a tool that pulls the latest npm docs” - Cline handles everything from creating the MCP server to installing it *into himself*, ready for future tasks. Servers are saved in ~/Documents/Cline/MCP so you can easily share tools with friends!

Saoud Rizwan

61,730 просмотров • 1 год назад

Streamlining the UX in Gemini CLI ✨ We got a lot of feedback on how our UI was way too cluttered with noise and text... so we made changes! 🛠️ Compact tool calls: Tool calls for reading files, folders, searching text, etc are now a single line (no more tool boxes around everything!) 💭 Topics: The agent outputs a one line overview of the rationale and direction it is going. A topic can span several tool calls and makes it easy to see what the agent is working on at a glance and why.
0:33

Streamlining the UX in Gemini CLI ✨ We got a lot of feedback on how our UI was way too cluttered with noise and text... so we made changes! 🛠️ Compact tool calls: Tool calls for reading files, folders, searching text, etc are now a single line (no more tool boxes around everything!) 💭 Topics: The agent outputs a one line overview of the rationale and direction it is going. A topic can span several tool calls and makes it easy to see what the agent is working on at a glance and why.

Jack Wotherspoon

15,960 просмотров • 1 месяц назад

MCP connectors are now available in Basedash. Basedash already reads from your databases and SaaS tools. Now it can act on them too. Connect any MCP server (Linear, HubSpot, Slack, Resend, Notion, GitHub, your own internal one) and the Basedash agent gets new tools it can use right inside chat. Try it today.
0:29

MCP connectors are now available in Basedash. Basedash already reads from your databases and SaaS tools. Now it can act on them too. Connect any MCP server (Linear, HubSpot, Slack, Resend, Notion, GitHub, your own internal one) and the Basedash agent gets new tools it can use right inside chat. Try it today.

Basedash

11,138 просмотров • 1 месяц назад

v0 now supports tailwind configs and globals.css files — you can now use custom utility classes and CSS variables in your generations.
0:23

v0 now supports tailwind configs and globals.css files — you can now use custom utility classes and CSS variables in your generations.

v0

76,013 просмотров • 1 год назад

ElevenLabs Conversational AI now supports MCP — letting AI agents connect to services like Salesforce, HubSpot, Gmail and more instantly. No more manual tool definitions. No more setup friction.
3:25

ElevenLabs Conversational AI now supports MCP — letting AI agents connect to services like Salesforce, HubSpot, Gmail and more instantly. No more manual tool definitions. No more setup friction.

ElevenLabs

75,999 просмотров • 1 год назад

With Google Flow Tools, you can now use natural language to create bespoke tools and workflows. In this video, you'll see how you can: ➡️ Explore and try the various Tools within Google Flow ➡️ Remix a tool to make it even more relevant for your unique workflow ➡️Create your own tool from scratch with a natural language prompt ➡️ Share your tools with a friend for them to try out Whether you’re looking for an image editor, video resizer or custom shaders, you can now create them in Google Flow, no coding experience required.
2:30

With Google Flow Tools, you can now use natural language to create bespoke tools and workflows. In this video, you'll see how you can: ➡️ Explore and try the various Tools within Google Flow ➡️ Remix a tool to make it even more relevant for your unique workflow ➡️Create your own tool from scratch with a natural language prompt ➡️ Share your tools with a friend for them to try out Whether you’re looking for an image editor, video resizer or custom shaders, you can now create them in Google Flow, no coding experience required.

Google Flow

17,794 просмотров • 6 дней назад

🚀 LangSmith Agent Builder is now available in Public Beta Now anyone can create production ready agents without writing code, just chat. Agent Builder guides you from initial idea to deployed agent, creating detailed prompts, selecting required tools, and even creating subagents. Our Beta release also includes: 🧰 Bring your own tools via MCP server 🧩 Browse, copy, and customize agents across a shared workspace 🧠 Use your preferred model Try Agent Builder free: Read more on the launch:
0:56

🚀 LangSmith Agent Builder is now available in Public Beta Now anyone can create production ready agents without writing code, just chat. Agent Builder guides you from initial idea to deployed agent, creating detailed prompts, selecting required tools, and even creating subagents. Our Beta release also includes: 🧰 Bring your own tools via MCP server 🧩 Browse, copy, and customize agents across a shared workspace 🧠 Use your preferred model Try Agent Builder free: Read more on the launch:

LangChain

37,784 просмотров • 6 месяцев назад

130+ skills are now built into your Superagent. Some are ready to use, and some can be created based on what you need. Add a skill once, and your Superagent can use it as part of your workflows. Stack skills, connect tools, and build flows that run end-to-end.
0:32

130+ skills are now built into your Superagent. Some are ready to use, and some can be created based on what you need. Add a skill once, and your Superagent can use it as part of your workflows. Stack skills, connect tools, and build flows that run end-to-end.

Base44

1,856,620 просмотров • 2 месяцев назад

ChatGPT can now read responses to you. On iOS or Android, tap and hold the message and then tap “Read Aloud”. We’ve also started rolling on web - click the "Read Aloud" button below the message.
0:28

ChatGPT can now read responses to you. On iOS or Android, tap and hold the message and then tap “Read Aloud”. We’ve also started rolling on web - click the "Read Aloud" button below the message.

OpenAI

1,026,833 просмотров • 2 лет назад

Not just AI. A tool people actually use. The people in this video are real SMEs who already use MWX tools and see real benefits: faster content creation, steady ideas, lower costs, and more consistent results. AI that works for real businesses, not just demos.
1:05

Not just AI. A tool people actually use. The people in this video are real SMEs who already use MWX tools and see real benefits: faster content creation, steady ideas, lower costs, and more consistent results. AI that works for real businesses, not just demos.

MWX | Real-Time Alpha AI

40,405 просмотров • 6 месяцев назад