Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Most evaluations of world models ask, "Does this look right?" 🌎 We built WorldModelGym to ask a different question: if an agent actually uses this model to make decisions, does it still choose well? 🏋️🏃‍♂️🏁🦾 A simulation can look physically plausible and still lead an agent completely astray. 📉⚠️...

16,290 görüntüleme • 2 ay önce •via X (Twitter)

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Most people treat AI like Google: ask a question, get an answer. But what if AI could think *like/with you?* I reverse-engineer "Theory of Mind" to test if the model can form a "theory of my mind". Using AI as a mirror to understand myself by giving it personal context and seeing how well it can embody/reflect my expertise back to me helps me to evaluate the model's thinking. This is something like a single-user, multi-model human-AI synergy benchmark where the task is "strategic alignment with your own expertise." Here's my hypothesis: Does pre-loading context create emergent synergy and enhance collective intelligence? If the LLM has: - Your projects (what you've built) - Your career details (how you think about growth) - Your self-description (your values/philosophy) 1. Does this response sound like something I'd say? 2. Does it reveal blind spots I hadn't considered? 3. Does it reduce the "explanation tax" I pay in every conversation? Different models excel at different aspects of "me." Before you think I'm building a digital mirror to talk to myself: this isn't about AI companionship or AI psychosis. It's actually bout me understanding the model's reasoning so I can deploy the right model for the right task. I'm my own test subject because I have ground truth: I know what I actually think, what I'd actually decide, what I'd actually prioritize. Most benchmarks lack this. When a model says "Muratcan would choose X," I can immediately verify: "No, I'd choose Y because of Z." I think everyone should do this with their own domain expertise. - If you're a manager, load your case history and test which model best applies your reasoning. - If you're a creative, load your portfolio and test which model understands your aesthetic principles. - If you're a founder, load your strategy docs and test which model identifies blind spots in your go-to-market plan. AI should serve as an extension of your strategic thinking, a collaborative partner.

Muratcan Koylan

24,128 görüntüleme • 8 ay önce

New Course: ACP: Agent Communication Protocol Learn to build agents that communicate and collaborate across different frameworks using ACP in this short course built with IBM Research's BeeAI, and taught by Sandi Besen, AI Research Engineer & Ecosystem Lead at IBM, and Nicholas Renotte, Head of AI Developer Advocacy at IBM. Building a multi-agent system with agents built or used by different teams and organizations can become challenging. You may need to write custom integrations each time a team updates their agent design or changes their choice of agentic orchestration framework. The Agent Communication Protocol (ACP) is an open protocol that addresses this challenge by standardizing how agents communicate, using a unified RESTful interface that works across frameworks. In this protocol, you host an agent inside an ACP server, which handles requests from an ACP client and passes them to the appropriate agent. Using a standardized client-server interface allows multiple teams to reuse agents across projects. It also makes it easier to switch between frameworks, replace an agent with a new version, or update a multi-agent system without refactoring the entire system. In this course, you’ll learn to connect agents through ACP. You’ll understand the lifecycle of an ACP Agent and how it compares to other protocols, such as MCP (Model Context Protocol) and A2A (Agent-to-Agent). You’ll build ACP-compliant agents and implement both sequential and hierarchical workflows of multiple agents collaborating using ACP. Through hands-on exercises, you’ll build: - A RAG agent with CrewAI and wrap it inside an ACP server. - An ACP Client to make calls to the ACP server you created. - A sequential workflow that chains an ACP server, created with Smolagents, to the RAG agent. - A hierarchical workflow using a router agent that transforms user queries into tasks, delegated to agents available through ACP servers. - An agent that uses MCP to access tools and ACP to communicate with other agents. You’ll finish up by importing your ACP agents into the BeeAI platform, an open-source registry for discovering and sharing agents. ACP enables collaboration between agents across teams and organizations. By the end of this course, you’ll be able to build ACP agents and workflows that communicate and collaborate regardless of framework. Please sign up here:

Andrew Ng

105,343 görüntüleme • 1 yıl önce