Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Harbor integration is live with EvoSkill v.1.2.0 Harbor is a framework for evaluating AI agents against containerized benchmark tasks. It gives EvoSkill access to evolve agents against a registry of 190+ datasets — including benchmarks like SWE-bench Verified, Terminal-Bench 2.0, and Aider Polyglot. Here’s what it means for automated...

27,257 görüntüleme • 2 ay önce •via X (Twitter)

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

🌌 AI Agents Are Taking Over... And We’re Bringing Them to Berachain Foundation 🐻⛓ 🐻🔥 Hundreds of hours spent on research, tracking wallets, analyzing bribes, and managing portfolios... What if your AI Agent could do this for you—24/7? ⏲️ 🔧 Our Tech Is Next-Level On our testnet, you’ve been memeing it up with PumpFun™, creating dank memecoins enhanced by NFTs. But once Berachain’s mainnet is live, you’ll be able to create your own AI Agents. To test and perfect our tech, we shared it with projects like AI Agent Layer | AIFUN, allowing us to test it in all conditions and continuously improve its performance. 🛠️🔥 🐻 Why AI Agent are great for berachain? Berachain might seem simple at first glance: validators, bribes, POL, staking rewards… but the deeper you go, the more complex the game theory becomes. 🤯 Here’s where AI comes in. Imagine an agent helping you: 💡 Optimize bribes 📊 Analyze validator behavior 🧠 Make decisions faster and smarter and much more, as AI Agents won't be limited to the chain itself! Examples of AI Agent Projects Dominating the Space 🚀 $VIRTUAL - Launchpad for AI Agents ($3.5B mcap) 🧠 $AI16Z - Eliza OS Framework ($2B mcap) 🔍 $AIXBT - The AI Analyst revolutionizing CT ($430M mcap) 🎮 $GAME - Low-code toolkit for creating AI Agents ($230M mcap) 💡 There are already AI Agents managing portfolios, betting on sports, and automating tasks. And guess what? They're outperforming humans. 🌐 We've built Virtuals on Berachain Our protocol integrates directly with Berachain, providing real utility to our token: $AIBERA 💎. Say Ooga Booga if you want to see a thread about tokenomics and $AIBERA utility. The chain has beras on it, and beras deserve AI Agents. 🐻🤖 Ooga Booga. 🔥

HoneyFun AI

10,906 görüntüleme • 1 yıl önce

Microsoft presents Windows Agent Arena Evaluating Multi-Modal OS Agents at Scale discuss: Large language models (LLMs) show remarkable potential to act as computer agents, enhancing human productivity and software accessibility in multi-modal tasks that require planning and reasoning. However, measuring agent performance in realistic environments remains a challenge since: (i) most benchmarks are limited to specific modalities or domains (e.g. text-only, web navigation, Q&A, coding) and (ii) full benchmark evaluations are slow (on order of magnitude of days) given the multi-step sequential nature of tasks. To address these challenges, we introduce the Windows Agent Arena: a reproducible, general environment focusing exclusively on the Windows operating system (OS) where agents can operate freely within a real Windows OS and use the same wide range of applications, tools, and web browsers available to human users when solving tasks. We adapt the OSWorld framework (Xie et al., 2024) to create 150+ diverse Windows tasks across representative domains that require agent abilities in planning, screen understanding, and tool usage. Our benchmark is scalable and can be seamlessly parallelized in Azure for a full benchmark evaluation in as little as 20 minutes. To demonstrate Windows Agent Arena's capabilities, we also introduce a new multi-modal agent, Navi. Our agent achieves a success rate of 19.5% in the Windows domain, compared to 74.5% performance of an unassisted human. Navi also demonstrates strong performance on another popular web-based benchmark, Mind2Web. We offer extensive quantitative and qualitative analysis of Navi's performance, and provide insights into the opportunities for future research in agent development and data generation using Windows Agent Arena.

AK

19,684 görüntüleme • 1 yıl önce