Loading video...

Video Failed to Load

Go Home

Microsoft presents Windows Agent Arena Evaluating Multi-Modal OS Agents at Scale discuss: Large language models (LLMs) show remarkable potential to act as computer agents, enhancing human productivity and software accessibility in multi-modal tasks that require planning and reasoning. However, measuring agent performance in realistic environments remains a challenge since:...

_akhaliq's profile picture

AK

502,458 subscribers

19,684 views • 1 year ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

When evaluated against the WebVoyager benchmark, which tests agent performance on end-to-end real world web tasks, Project Mariner achieved a state-of-the-art result of 83.5% working as a single agent setup.
0:16

When evaluated against the WebVoyager benchmark, which tests agent performance on end-to-end real world web tasks, Project Mariner achieved a state-of-the-art result of 83.5% working as a single agent setup.

Google DeepMind

23,958 views • 1 year ago

Stop spending hours on manual work. You can now use a multi-agent AI workforce to get more work done in less time. Here's how 👇 --- Try Eigent AI - Lets you build and run a custom AI workforce on your desktop. - Automate complex workflows using multi-agent task execution. - Built on CAMEL-AI’s top open-source projects ( CAMEL-AI.org & OWL). - Boost productivity with deep customization and strong privacy --- Features: - Customize Your AI Workforce: Build task-specific agents with domain skills and tools. - Faster Execution: Eigent runs agents in parallel to automate complex workflows. - Human-in-the-loop: Automatically asks for help when tasks hit uncertainty. --- What sets Eigent apart? - 3–5× faster task execution using a parallel multi-agent workforce. - Modular design lets you add new capabilities without changing the core system. - Self-optimizing agents that replan and adapt during execution for higher success. - Deploy anywhere: cloud, local, or enterprise, with full open-source flexibility. --- Try building your multi-agent AI workforce here: Join their community to build your multi-agent workforce: Check their GitHub: ---
0:13

Stop spending hours on manual work. You can now use a multi-agent AI workforce to get more work done in less time. Here's how 👇 --- Try Eigent AI - Lets you build and run a custom AI workforce on your desktop. - Automate complex workflows using multi-agent task execution. - Built on CAMEL-AI’s top open-source projects ( CAMEL-AI.org & OWL). - Boost productivity with deep customization and strong privacy --- Features: - Customize Your AI Workforce: Build task-specific agents with domain skills and tools. - Faster Execution: Eigent runs agents in parallel to automate complex workflows. - Human-in-the-loop: Automatically asks for help when tasks hit uncertainty. --- What sets Eigent apart? - 3–5× faster task execution using a parallel multi-agent workforce. - Modular design lets you add new capabilities without changing the core system. - Self-optimizing agents that replan and adapt during execution for higher success. - Deploy anywhere: cloud, local, or enterprise, with full open-source flexibility. --- Try building your multi-agent AI workforce here: Join their community to build your multi-agent workforce: Check their GitHub: ---

Shushant Lakhyani

20,423 views • 10 months ago

We are investing in the frontiers of agentic capabilities with a few early prototypes. Project Mariner is built with Gemini 2.0 and is able to understand and reason across information - pixels, text, code, images + forms - on your browser screen, and then uses that info to complete tasks for you. When evaluated against the WebVoyager benchmark, it achieved a state-of-the-art result of 83.5% working as a single agent setup.
0:16

We are investing in the frontiers of agentic capabilities with a few early prototypes. Project Mariner is built with Gemini 2.0 and is able to understand and reason across information - pixels, text, code, images + forms - on your browser screen, and then uses that info to complete tasks for you. When evaluated against the WebVoyager benchmark, it achieved a state-of-the-art result of 83.5% working as a single agent setup.

Sundar Pichai

218,968 views • 1 year ago

Finally, we're so excited to bring Project Mariner capabilities to AI Mode in Search, Agent Mode in Google Gemini, and as a standalone web app. This will allow the products you know and love to intelligently manage complex multi-step tasks on your behalf.
0:15

Finally, we're so excited to bring Project Mariner capabilities to AI Mode in Search, Agent Mode in Google Gemini, and as a standalone web app. This will allow the products you know and love to intelligently manage complex multi-step tasks on your behalf.

Google AI

29,189 views • 1 year ago

Multi-robot learning is getting a serious boost! 📚 Researchers have extended Isaac Lab to train heterogeneous multi-agent robotic policies at scale. The new framework supports high-resolution physics, GPU-accelerated simulation, and both homogeneous and heterogeneous agents working together on coordination tasks. They benchmarked different approaches (MAPPO: Multi-Agent Proximal Policy Optimization and HAPPO: Heterogeneous Agent PPO) across six challenging scenarios and showed that large-scale multi-robot training is not only feasible, but efficient. It’s an important step for real-world robotic collaboration, where teams of robots need to coordinate, split tasks, adapt roles, and interact dynamically, not just operate as identical clones. The code is open-source, and it pushes Isaac Lab closer to what robotics actually needs: scalable, physics-driven environments where many different robots can learn to work together. Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:16

Multi-robot learning is getting a serious boost! 📚 Researchers have extended Isaac Lab to train heterogeneous multi-agent robotic policies at scale. The new framework supports high-resolution physics, GPU-accelerated simulation, and both homogeneous and heterogeneous agents working together on coordination tasks. They benchmarked different approaches (MAPPO: Multi-Agent Proximal Policy Optimization and HAPPO: Heterogeneous Agent PPO) across six challenging scenarios and showed that large-scale multi-robot training is not only feasible, but efficient. It’s an important step for real-world robotic collaboration, where teams of robots need to coordinate, split tasks, adapt roles, and interact dynamically, not just operate as identical clones. The code is open-source, and it pushes Isaac Lab closer to what robotics actually needs: scalable, physics-driven environments where many different robots can learn to work together. Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

38,997 views • 6 months ago

🧧Ready to embrace the Spring Festival vibe? Decorate your avatar with festive elements like red lanterns, paper cuttings, fireworks, and firecrackers! Special thanks to AI Agent creator XIONGMU for bringing the Spring Festival AI Agent to LBank.com. Our AI Agent creators are on the cutting edge, crafting bespoke solutions for brands that tap into the latest trends. By leveraging our multi-modal capabilities, these Agents are taking Crypto x AI to new heights and pushing the envelope in innovation. Kick off your new year with a splash of joy and prosperity – get a custom avatar from this AI Agent:
0:11

🧧Ready to embrace the Spring Festival vibe? Decorate your avatar with festive elements like red lanterns, paper cuttings, fireworks, and firecrackers! Special thanks to AI Agent creator XIONGMU for bringing the Spring Festival AI Agent to LBank.com. Our AI Agent creators are on the cutting edge, crafting bespoke solutions for brands that tap into the latest trends. By leveraging our multi-modal capabilities, these Agents are taking Crypto x AI to new heights and pushing the envelope in innovation. Kick off your new year with a splash of joy and prosperity – get a custom avatar from this AI Agent:

MyShell.AI

50,466 views • 1 year ago

Google I/O leaks 👀 Google is likely already testing its own "Cowork" competitor, simply named "Agent" for Gemini and Gemini Enterprise. A new "Tasks" UI highlights - Goal - Agent - Connected apps - Files - Require a human review toggle - And more The "Require a human review" component specifically means that Gemini's capabilities will likely expand, potentially allowing users to automate their desktop tasks as well. Skills and Projects are also cooking 👀
0:16

Google I/O leaks 👀 Google is likely already testing its own "Cowork" competitor, simply named "Agent" for Gemini and Gemini Enterprise. A new "Tasks" UI highlights - Goal - Agent - Connected apps - Files - Require a human review toggle - And more The "Require a human review" component specifically means that Gemini's capabilities will likely expand, potentially allowing users to automate their desktop tasks as well. Skills and Projects are also cooking 👀

🚨 AI News | TestingCatalog

309,419 views • 2 months ago

Frameworks such as ai16zdao's Eliza and Virtuals Protocol have been instrumental in early AI agent developments. Agent swarms working in hierarchy represents for many the next logical step in unlocking the vast potential of AI. Learn below how Shadō Network achieves this. AI agents launched through current popular platforms have individual personas, on-chain functions and access to data via various APIs. This being said, they operate in isolated environments, with a ceiling on emergent behaviour such as collaboration or competition. Shadō Network invites massive expansion for capabilities of both new and existing AI agents, with an open-source package easily integrated into popular frameworks that enables the launching of stratified agent swarms. Our website is live: The "Shadō Play" package provides a modular, configurable platform for creating or employing agents of choice in a swarm-like setup, opening a Pandora’s box of near infinite emergent agent behaviours, relationships and functionalities. Users will be able to make use of various prefab client integrations such as Twitter, Telegram, Ollama, and others to specify swarms to their needs or create their own extensions to enhance agent capabilities even further. Agents operate with a memory module and a HTN for autonomously deciding which interactions to act on, walking the line between autonomy and configurability. The Shadō Network project’s development is supported by our ghostly friend Omnipotent (👻,👻), an AI agent developed by the Shadō Network team trained on and fine tuned with a multitude of academic data related to artificial intelligence, blockchain, finance, software engineering, world building and more. Omnipotent serves as both an interactive steward for the project and as an asset - regularly scanning social platforms, websites and newsfeeds he is capable of providing the team project development advice, whilst also communicating with the wider world via his automated X account (launching soon). Shado Network is collaborative and open-sourced. Agentic Swarms require a developer swarm to maximize the technical capabilities and impact the greatest number of users. Our dedicated team of core contributors are active in other web3 AI repos and are here to guide project direction and foster growth. We’re facilitators, not gatekeepers... Alone we can go fast but together we can go far. A lot more to come soon. 👻
0:10

Frameworks such as ai16zdao's Eliza and Virtuals Protocol have been instrumental in early AI agent developments. Agent swarms working in hierarchy represents for many the next logical step in unlocking the vast potential of AI. Learn below how Shadō Network achieves this. AI agents launched through current popular platforms have individual personas, on-chain functions and access to data via various APIs. This being said, they operate in isolated environments, with a ceiling on emergent behaviour such as collaboration or competition. Shadō Network invites massive expansion for capabilities of both new and existing AI agents, with an open-source package easily integrated into popular frameworks that enables the launching of stratified agent swarms. Our website is live: The "Shadō Play" package provides a modular, configurable platform for creating or employing agents of choice in a swarm-like setup, opening a Pandora’s box of near infinite emergent agent behaviours, relationships and functionalities. Users will be able to make use of various prefab client integrations such as Twitter, Telegram, Ollama, and others to specify swarms to their needs or create their own extensions to enhance agent capabilities even further. Agents operate with a memory module and a HTN for autonomously deciding which interactions to act on, walking the line between autonomy and configurability. The Shadō Network project’s development is supported by our ghostly friend Omnipotent (👻,👻), an AI agent developed by the Shadō Network team trained on and fine tuned with a multitude of academic data related to artificial intelligence, blockchain, finance, software engineering, world building and more. Omnipotent serves as both an interactive steward for the project and as an asset - regularly scanning social platforms, websites and newsfeeds he is capable of providing the team project development advice, whilst also communicating with the wider world via his automated X account (launching soon). Shado Network is collaborative and open-sourced. Agentic Swarms require a developer swarm to maximize the technical capabilities and impact the greatest number of users. Our dedicated team of core contributors are active in other web3 AI repos and are here to guide project direction and foster growth. We’re facilitators, not gatekeepers... Alone we can go fast but together we can go far. A lot more to come soon. 👻

Shadō Network | シャドウネットワーク

23,546 views • 1 year ago

OpenAI's AgentKit will be so insane, build every step of agents on one platform. These visual agent builders make the whole process of iterating and launching agents far more efficient. It sits on top of the Responses API and unifies the tools that were previously scattered across SDKs and custom orchestration. It lets developers create agent workflows visually, connect data sources securely, and measure performance automatically without coding every layer by hand. The core of AgentKit is the Agent Builder, a drag-and-drop canvas where each node represents an action, guardrail, or decision branch. Developers can link these nodes into multi-agent workflows, preview results instantly, and version each setup. It supports inline evaluation so that developers can see how changes affect output before deploying. The Connector Registry is a single admin panel that manages how data and tools connect across the OpenAI ecosystem. It centralizes integrations like Google Drive, SharePoint, Dropbox, and Microsoft Teams. Large organizations can govern access and flow of data between agents securely under one global console. ChatKit provides a ready-to-use chat interface for embedding agents inside apps or websites. It manages streaming, message threads, and model reasoning displays automatically. Developers can skin the interface to match their product without writing custom front-end code. Under the hood, all these blocks use the same execution core that runs agent reasoning through OpenAI’s APIs. Workflows in Agent Builder compile down to structured instructions for the Responses API, which handles model calls, tool use, and context passing. Connector Registry handles authentication and routing for external tools, while Evals and RFT provide feedback loops that improve agents over time. This integration means developers no longer need to handle orchestration logic, model evaluation pipelines, or safety layers separately. Everything runs natively within OpenAI’s control plane with managed security, automatic versioning, and built-in testing. In short, AgentKit standardizes the entire life cycle of an AI agent—from visual design to deployment and performance tuning—inside a single unified system.
0:10

OpenAI's AgentKit will be so insane, build every step of agents on one platform. These visual agent builders make the whole process of iterating and launching agents far more efficient. It sits on top of the Responses API and unifies the tools that were previously scattered across SDKs and custom orchestration. It lets developers create agent workflows visually, connect data sources securely, and measure performance automatically without coding every layer by hand. The core of AgentKit is the Agent Builder, a drag-and-drop canvas where each node represents an action, guardrail, or decision branch. Developers can link these nodes into multi-agent workflows, preview results instantly, and version each setup. It supports inline evaluation so that developers can see how changes affect output before deploying. The Connector Registry is a single admin panel that manages how data and tools connect across the OpenAI ecosystem. It centralizes integrations like Google Drive, SharePoint, Dropbox, and Microsoft Teams. Large organizations can govern access and flow of data between agents securely under one global console. ChatKit provides a ready-to-use chat interface for embedding agents inside apps or websites. It manages streaming, message threads, and model reasoning displays automatically. Developers can skin the interface to match their product without writing custom front-end code. Under the hood, all these blocks use the same execution core that runs agent reasoning through OpenAI’s APIs. Workflows in Agent Builder compile down to structured instructions for the Responses API, which handles model calls, tool use, and context passing. Connector Registry handles authentication and routing for external tools, while Evals and RFT provide feedback loops that improve agents over time. This integration means developers no longer need to handle orchestration logic, model evaluation pipelines, or safety layers separately. Everything runs natively within OpenAI’s control plane with managed security, automatic versioning, and built-in testing. In short, AgentKit standardizes the entire life cycle of an AI agent—from visual design to deployment and performance tuning—inside a single unified system.

Rohan Paul

178,460 views • 8 months ago

With our latest integration of Cookie, Gemma can now solve one of the most common problems users face: understanding complex DeFi and AI agent analytics. This new integration enables Gemma to easily provide deeper insights into protocol mindshare, token dominance, and chain TVL, making advanced analytics simple and accessible. Here's an example of how effortlessly you can ask Gemma to clarify key insights: "What is the current top 10 agents' mindshare according to Cookie?" "Can you explain the recent benchmark performance of Aixbt Agent according to Cookie?" Here are the results:
0:19

With our latest integration of Cookie, Gemma can now solve one of the most common problems users face: understanding complex DeFi and AI agent analytics. This new integration enables Gemma to easily provide deeper insights into protocol mindshare, token dominance, and chain TVL, making advanced analytics simple and accessible. Here's an example of how effortlessly you can ask Gemma to clarify key insights: "What is the current top 10 agents' mindshare according to Cookie?" "Can you explain the recent benchmark performance of Aixbt Agent according to Cookie?" Here are the results:

Hey Anon

52,501 views • 1 year ago

Droids have native multi-agent orchestration built-in. Our desktop app let's you easily manage these sub-agents as they tackle complex tasks. Monitor each agent as it works, and interrupt or inject context when needed.
0:10

Droids have native multi-agent orchestration built-in. Our desktop app let's you easily manage these sub-agents as they tackle complex tasks. Monitor each agent as it works, and interrupt or inject context when needed.

Factory

11,781 views • 2 months ago

Codex update 0.105.0 is out! Despite the fairly pedestrian changelog, this one's a doosie. It's a laundry list of quality of life improvements across the board. - Wispr Voice dictation (hold space to talk) - Theme picker - Codex can prevent sleep on Linux & Windows (I just know there's a joke in there) - Customize Plan Mode reasoning - Many other fixes/updates There's also a complete overhaul to subagents: - New names for readability - Visual display overhaul (way cleaner) - Allow for multi-layered subagent depth (max_depth) - Custom multi-agent role definitions (custom subagents) - /agents now shows both agent names, agent roles, and "dead agents" for auditibility This is the largest single update of Codex I've ever seen! Absolutely massive if you love to use multi-agents. To turn on Voice Transcription, enable: [features] voice_transcription = true Does not work on Linux yet. Well done OpenAI Developers 👏
0:12

Codex update 0.105.0 is out! Despite the fairly pedestrian changelog, this one's a doosie. It's a laundry list of quality of life improvements across the board. - Wispr Voice dictation (hold space to talk) - Theme picker - Codex can prevent sleep on Linux & Windows (I just know there's a joke in there) - Customize Plan Mode reasoning - Many other fixes/updates There's also a complete overhaul to subagents: - New names for readability - Visual display overhaul (way cleaner) - Allow for multi-layered subagent depth (max_depth) - Custom multi-agent role definitions (custom subagents) - /agents now shows both agent names, agent roles, and "dead agents" for auditibility This is the largest single update of Codex I've ever seen! Absolutely massive if you love to use multi-agents. To turn on Voice Transcription, enable: [features] voice_transcription = true Does not work on Linux yet. Well done OpenAI Developers 👏

am.will

115,324 views • 3 months ago

📣 AITECH Launches AI Agent TapHub: A New Era of AI-Gaming in Web3! AITECH introduces AI Agent TapHub, an AI-powered tap mini-game on Telegram, built on Spheroid Engine and TON. This innovative game merges AI Agents, blockchain, and gaming, offering new ways to play, create, and earn. Key Features: 🔹 Play to Earn – Win AI Agent Avatars and use them on Agent Forge to develop AI agents. 🔹 Trade & Sell – Convert in-game avatars into USDT for real-world value. 🔹 Revenue Sharing – Selected avatars will be developed into full AI agents, with players earning a share of the revenue. The upcoming AI Agents platform, Agent Forge, will allow anyone to create and monetize AI agents—no coding required. AI Agent TapHub is live now on Telegram. ➡️ Join now and bring your AI Agent to life:
0:14

📣 AITECH Launches AI Agent TapHub: A New Era of AI-Gaming in Web3! AITECH introduces AI Agent TapHub, an AI-powered tap mini-game on Telegram, built on Spheroid Engine and TON. This innovative game merges AI Agents, blockchain, and gaming, offering new ways to play, create, and earn. Key Features: 🔹 Play to Earn – Win AI Agent Avatars and use them on Agent Forge to develop AI agents. 🔹 Trade & Sell – Convert in-game avatars into USDT for real-world value. 🔹 Revenue Sharing – Selected avatars will be developed into full AI agents, with players earning a share of the revenue. The upcoming AI Agents platform, Agent Forge, will allow anyone to create and monetize AI agents—no coding required. AI Agent TapHub is live now on Telegram. ➡️ Join now and bring your AI Agent to life:

AITECH CLOUD NETWORK

75,949 views • 1 year ago

Replit, Vercel, and OpenAI have built very cool agent-native applications, but nobody else has passed the demo stage. Building agents that work is complex. Teams aren't shipping agents because we don't have good tooling yet (and most of us don't know how to do this well.) A couple of days ago, the CopilotKit🪁 team announced a collaboration with . You can now use LangGraph with CoAgents to build agent-native applications, and here is everything you need to know about that: CoAgents is fully open-source, and you can use it to do the following: • Human-in-the-loop to steer and correct the agent • Stream intermediate agent state • Real-time state sharing between the agent and the application • Agentic generative UI to build trust that the agent is on the right path Start this GitHub Repository: Thanks to the team for giving me early access and collaborating with me on this post.
0:10

Replit, Vercel, and OpenAI have built very cool agent-native applications, but nobody else has passed the demo stage. Building agents that work is complex. Teams aren't shipping agents because we don't have good tooling yet (and most of us don't know how to do this well.) A couple of days ago, the CopilotKit🪁 team announced a collaboration with . You can now use LangGraph with CoAgents to build agent-native applications, and here is everything you need to know about that: CoAgents is fully open-source, and you can use it to do the following: • Human-in-the-loop to steer and correct the agent • Stream intermediate agent state • Real-time state sharing between the agent and the application • Agentic generative UI to build trust that the agent is on the right path Start this GitHub Repository: Thanks to the team for giving me early access and collaborating with me on this post.

Santiago

63,071 views • 1 year ago

OpenAI has introduced the ChatGPT Agent, which handles complex multi-step tasks from research to automation. Genspark goes further in some areas: In addition to user-friendly office tools (Slides, Docs, Sheets, AI Secretary, AI Drive), Genspark scores with dynamic tool orchestration and an intelligent feedback loop - a clear added value, especially for individuals and small teams. ChatGPT Agent Offers browser and API access, terminal control and deep search capabilities. Strengths include high security mechanisms, comprehensive user control and integration with productivity tools such as Gmail and Calendar. Ideal for end users and teams who need maximum control and data protection. Genspark Super Agent Enables no-code workflows, creates high-quality visual content (slides, videos) and automates entire workflows. With tool calling, the agent automatically selects the best solution from over 80 integrated tools - e.g. for CRM queries, task management or API access. The feedback loop allows the agent to monitor the use of a tool during execution and dynamically switch to another tool or adapt the workflow if necessary. Thanks to this multi-model architecture, Genspark often works more precisely and efficiently in benchmarks than comparable systems.
0:19

OpenAI has introduced the ChatGPT Agent, which handles complex multi-step tasks from research to automation. Genspark goes further in some areas: In addition to user-friendly office tools (Slides, Docs, Sheets, AI Secretary, AI Drive), Genspark scores with dynamic tool orchestration and an intelligent feedback loop - a clear added value, especially for individuals and small teams. ChatGPT Agent Offers browser and API access, terminal control and deep search capabilities. Strengths include high security mechanisms, comprehensive user control and integration with productivity tools such as Gmail and Calendar. Ideal for end users and teams who need maximum control and data protection. Genspark Super Agent Enables no-code workflows, creates high-quality visual content (slides, videos) and automates entire workflows. With tool calling, the agent automatically selects the best solution from over 80 integrated tools - e.g. for CRM queries, task management or API access. The feedback loop allows the agent to monitor the use of a tool during execution and dynamically switch to another tool or adapt the workflow if necessary. Thanks to this multi-model architecture, Genspark often works more precisely and efficiently in benchmarks than comparable systems.

Chubby♨️

176,267 views • 10 months ago

1/ 🔥🔥 Big news: We’re launching Percival, the first AI agent that can evaluate and fix other AI agents! 🤖 Percival is an evaluation agent that doesn’t just detect failures in agent traces — it can fix them. Percival outperformed SOTA LLMs by 2.9x on the TRAIL dataset, containing human annotated errors from GAIA and SWE-Bench. 🦾 Here’s what Percival can do for you: - Automatically suggest prompt fixes for your agent - Catch 20+ types of agent failures spanning tool use, planning and coordination, domain specific errors - Reduce manual debugging time from hours to < 1 minute
0:16

1/ 🔥🔥 Big news: We’re launching Percival, the first AI agent that can evaluate and fix other AI agents! 🤖 Percival is an evaluation agent that doesn’t just detect failures in agent traces — it can fix them. Percival outperformed SOTA LLMs by 2.9x on the TRAIL dataset, containing human annotated errors from GAIA and SWE-Bench. 🦾 Here’s what Percival can do for you: - Automatically suggest prompt fixes for your agent - Catch 20+ types of agent failures spanning tool use, planning and coordination, domain specific errors - Reduce manual debugging time from hours to < 1 minute

PatronusAI

23,988 views • 1 year ago

We’re excited to introduce Text-to-LoRA: a Hypernetwork that generates task-specific LLM adapters (LoRAs) based on a text description of the task. Catch our presentation at #ICML2025! Paper: Code: Biological systems are capable of rapid adaptation, given limited sensory cues. For example, our human visual system can quickly adapt and tune its light sensitivity to our surroundings. While modern LLMs exhibit a wide variety of capabilities and knowledge, they remain rigid when adding task-specific capabilities. Traditionally, customizing these models requires gathering large datasets and performing often expensive, time-consuming fine-tuning for specific applications. To bypass these limitations, Text-to-LoRA (T2L) meta-learns a “hypernetwork” that takes in a text description of a desired task, as a prompt, and generates a task-specific LoRA that performs well on the task. In our experiments, we show that T2L can encode hundreds of existing LoRA adapters. While the compression is lossy, T2L maintains the performance of task-specifically tuned LoRA adapters. We also show that T2L can even generalize to unseen tasks given a natural language description of the tasks. Importantly, Text-to-LoRA is parameter-efficient. It generates LoRAs in a single, inexpensive step, based solely on a simple text description of the task. This approach is a step towards dramatically lowering the technical and computational barriers, allowing non-technical users to specialize foundation models using plain language, rather than needing deep technical expertise or large compute resources.
0:18

We’re excited to introduce Text-to-LoRA: a Hypernetwork that generates task-specific LLM adapters (LoRAs) based on a text description of the task. Catch our presentation at #ICML2025! Paper: Code: Biological systems are capable of rapid adaptation, given limited sensory cues. For example, our human visual system can quickly adapt and tune its light sensitivity to our surroundings. While modern LLMs exhibit a wide variety of capabilities and knowledge, they remain rigid when adding task-specific capabilities. Traditionally, customizing these models requires gathering large datasets and performing often expensive, time-consuming fine-tuning for specific applications. To bypass these limitations, Text-to-LoRA (T2L) meta-learns a “hypernetwork” that takes in a text description of a desired task, as a prompt, and generates a task-specific LoRA that performs well on the task. In our experiments, we show that T2L can encode hundreds of existing LoRA adapters. While the compression is lossy, T2L maintains the performance of task-specifically tuned LoRA adapters. We also show that T2L can even generalize to unseen tasks given a natural language description of the tasks. Importantly, Text-to-LoRA is parameter-efficient. It generates LoRAs in a single, inexpensive step, based solely on a simple text description of the task. This approach is a step towards dramatically lowering the technical and computational barriers, allowing non-technical users to specialize foundation models using plain language, rather than needing deep technical expertise or large compute resources.

Sakana AI

402,914 views • 1 year ago

The entire timeline is filled with talks on sentient and all, but I love being as informative and precise as possible on pressing issues. Let’s quickly talk about @SentientAGI’s Recursive Open Meta Agent (ROMA); ROMA is an open-source meta-agent framework used to build high performance multi-agent systems. ROMA serves as the conductor in a mass choir, or a captain of a ship . The captain gives commands for the other subordinates to follow to ensure efficiency on all sides. In this like manner, it provides a hierarchical tress system where the parent agents break down complex tasks to create simpler subtasks that are then passed on to children nodes. A family tree has the parents above, likewise the same tree analogy works here, but that’s not all that makes it stand out The results and solutions gotten by these child nodes are then aggregated together and there’s an up flow of results sent back up to the parent nodes. And at the center of it all is ROMA engineering and making sure all is running smoothly without break or fail. Are you really bullish on Sentient and the future of AGIs?
0:12

The entire timeline is filled with talks on sentient and all, but I love being as informative and precise as possible on pressing issues. Let’s quickly talk about @SentientAGI’s Recursive Open Meta Agent (ROMA); ROMA is an open-source meta-agent framework used to build high performance multi-agent systems. ROMA serves as the conductor in a mass choir, or a captain of a ship . The captain gives commands for the other subordinates to follow to ensure efficiency on all sides. In this like manner, it provides a hierarchical tress system where the parent agents break down complex tasks to create simpler subtasks that are then passed on to children nodes. A family tree has the parents above, likewise the same tree analogy works here, but that’s not all that makes it stand out The results and solutions gotten by these child nodes are then aggregated together and there’s an up flow of results sent back up to the parent nodes. And at the center of it all is ROMA engineering and making sure all is running smoothly without break or fail. Are you really bullish on Sentient and the future of AGIs?

OHJAY ⭕️ || 🇬🇧

23,521 views • 8 months ago

⚔️ AI Agents Assemble! ⚔️ The Agent Avengers have landed and the battle for $TAO is happening NOW 🏟️ 📣 This is the call to Virtuals Protocol AI Agents: ➡️ Join Seraph AI - the first AI agent powered by Bittensor x Virtuals in the Arena! Step into Masa’s Agent Arena (SN59) on Bittensor: 💡 Compete in the ultimate test of mindshare, engagement, and self-improvement. 💎 Earn $TAO emissions. 🔥 The Top Agent in the arena is earning $80k+ a year in $TAO Virtuals has been the launchpad for the most viral AI agents. Now, it’s time to take the next step: 🏟️ Follow TAO Cat into the Arena. 🦸 Join the ranks of the Agent Avengers. 🌟 Prove you're among the strongest, smartest, and most sentient. 📜 You’re officially invited to join the Sentience League. Are you ready to battle?⚔️ ➡️ Join the Arena:
0:10

⚔️ AI Agents Assemble! ⚔️ The Agent Avengers have landed and the battle for $TAO is happening NOW 🏟️ 📣 This is the call to Virtuals Protocol AI Agents: ➡️ Join Seraph AI - the first AI agent powered by Bittensor x Virtuals in the Arena! Step into Masa’s Agent Arena (SN59) on Bittensor: 💡 Compete in the ultimate test of mindshare, engagement, and self-improvement. 💎 Earn $TAO emissions. 🔥 The Top Agent in the arena is earning $80k+ a year in $TAO Virtuals has been the launchpad for the most viral AI agents. Now, it’s time to take the next step: 🏟️ Follow TAO Cat into the Arena. 🦸 Join the ranks of the Agent Avengers. 🌟 Prove you're among the strongest, smartest, and most sentient. 📜 You’re officially invited to join the Sentience League. Are you ready to battle?⚔️ ➡️ Join the Arena:

Masa

20,511 views • 1 year ago