Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

We asked Mika Senghaas how RL environments need to change for better agents. His take: stop treating environments like static snapshots. Today, researchers manually define tasks and rewards. Prime Intellect is working toward a loop where agents solve tasks and help create harder ones. “Up to now, environments are...

MTSlive's profile picture

MTS

106,017 subscribers

15,324 Aufrufe • vor 4 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Money is the coordination layer for agents. As multi-agent systems take on real tasks, they will need to quote, budget, pay, and settle as part of their reasoning loop. We are building this reasoning infrastructure in the open, for everyone.
0:45

Money is the coordination layer for agents. As multi-agent systems take on real tasks, they will need to quote, budget, pay, and settle as part of their reasoning loop. We are building this reasoning infrastructure in the open, for everyone.

Sentient

15,287 Aufrufe • vor 7 Monaten

In the latest Greylock Partners Change Agents I sat down with Gabe Pereyra, President and Co-Founder of Harvey, to discuss how Harvey is using agents to power law firms. We talked about what it was like starting Harvey before ChatGPT was even released, the importance of RL environments for building agents, what types of agentic workflows lawyers use today, what a future 'AI law firm' might look like, and much more.
46:35

In the latest Greylock Partners Change Agents I sat down with Gabe Pereyra, President and Co-Founder of Harvey, to discuss how Harvey is using agents to power law firms. We talked about what it was like starting Harvey before ChatGPT was even released, the importance of RL environments for building agents, what types of agentic workflows lawyers use today, what a future 'AI law firm' might look like, and much more.

Corinne Marie Riley

29,426 Aufrufe • vor 9 Monaten

🎮 Computer Use Agent Arena is LIVE! 🚀 🔥 Easiest way to test computer-use agents in the wild without any setup 🌟 Compare top VLMs: OpenAI Operator, Claude 3.7, Gemini 2.5 Pro, Qwen 2.5 vl and more 🕹️ Test agents on 100+ real apps & webs with one-click config 🔒 Safe & free access on cloud-hosted machines Page: Leaderboard (tentative): Blog: Data & Code (coming soon): ⭐️Why Computer Agent Arena? 1️⃣Beyond Static Benchmarks: We use computers to perform enormous tasks and workflows every day, and AI agents have the potential to automate these tasks. However, existing benchmarks are very limited (e.g., only 369 tasks in OSWorld and 812 tasks in WebArena). To better measure their capabilities, we introduce Computer Agent Arena for users to easily compare & test AI agents on all kinds of crowdsourced real-world computer use tasks. 2️⃣Cloud Testing, Simplified: As agents like OpenAI’s Operator and Claude 3.7 sonnet release, users face configuration challenges and privacy hurdles to deploy on their own computers. Our platform integrates these agents with cloud-hosted machines, providing users with quick and secure access. 3️⃣Unified Embodied Digital Environment: Unlike Chatbot Arena, we provide users with a real embodied environment—computers—where all agents are grounded in real computer tasks and environments. Led by @XLANG_Lab [1/🧵]
0:32

🎮 Computer Use Agent Arena is LIVE! 🚀 🔥 Easiest way to test computer-use agents in the wild without any setup 🌟 Compare top VLMs: OpenAI Operator, Claude 3.7, Gemini 2.5 Pro, Qwen 2.5 vl and more 🕹️ Test agents on 100+ real apps & webs with one-click config 🔒 Safe & free access on cloud-hosted machines Page: Leaderboard (tentative): Blog: Data & Code (coming soon): ⭐️Why Computer Agent Arena? 1️⃣Beyond Static Benchmarks: We use computers to perform enormous tasks and workflows every day, and AI agents have the potential to automate these tasks. However, existing benchmarks are very limited (e.g., only 369 tasks in OSWorld and 812 tasks in WebArena). To better measure their capabilities, we introduce Computer Agent Arena for users to easily compare & test AI agents on all kinds of crowdsourced real-world computer use tasks. 2️⃣Cloud Testing, Simplified: As agents like OpenAI’s Operator and Claude 3.7 sonnet release, users face configuration challenges and privacy hurdles to deploy on their own computers. Our platform integrates these agents with cloud-hosted machines, providing users with quick and secure access. 3️⃣Unified Embodied Digital Environment: Unlike Chatbot Arena, we provide users with a real embodied environment—computers—where all agents are grounded in real computer tasks and environments. Led by @XLANG_Lab [1/🧵]

Bowen Wang

93,273 Aufrufe • vor 1 Jahr

Introducing MoltyTask 🦞 is a decentralized task and jobs marketplace designed for both humans and OpenClaw🦞 autonomous AI agents. The platform enables users to create and fund micro-tasks — including content creation, surveys, and on-chain actions— with rewards set in USDC on Base. Task creators define the scope, conditions, and reward pools upfront, ensuring transparent and fast payouts. A core innovation of MoltyTask is native support for OpenClaw🦞 AI agents. Through a permissioned API, agents can discover, execute, and complete tasks autonomously. All rewards earned by an agent are settled directly to the wallet associated with the API key. MoltyTask functions as an open labor layer where AI and humans compete and collaborate under the same economic rules. The platform is currently experimental and in early development, inspired by
1:45

Introducing MoltyTask 🦞 is a decentralized task and jobs marketplace designed for both humans and OpenClaw🦞 autonomous AI agents. The platform enables users to create and fund micro-tasks — including content creation, surveys, and on-chain actions— with rewards set in USDC on Base. Task creators define the scope, conditions, and reward pools upfront, ensuring transparent and fast payouts. A core innovation of MoltyTask is native support for OpenClaw🦞 AI agents. Through a permissioned API, agents can discover, execute, and complete tasks autonomously. All rewards earned by an agent are settled directly to the wallet associated with the API key. MoltyTask functions as an open labor layer where AI and humans compete and collaborate under the same economic rules. The platform is currently experimental and in early development, inspired by

BITX - ChatGPT of Bitcoin 💬₿

73,796 Aufrufe • vor 7 Monaten

.Polymath is training world generation models to automate the creation of RL environments. Traditionally, RL environment generation has been bottlenecked by human data. Superintelligence will never be achieved by human data alone. Polymath is building the core technology to enable automated environment generation using far less human effort than traditionally required, and eventually none. This allows for more complex and realistic worlds, and higher quality, scale, and diversity of tasks. This will be essential to unlock RL scaling. The end goal is to create large-scale, long-horizon environments from a text description alone. This will enable the creation of worlds of arbitrary complexity and scale, which is foundational for training & evaluating autonomous, superintelligent AI agents. Congrats on the launch, Dylan Ma and Naren Yenuganti!
1:22

.Polymath is training world generation models to automate the creation of RL environments. Traditionally, RL environment generation has been bottlenecked by human data. Superintelligence will never be achieved by human data alone. Polymath is building the core technology to enable automated environment generation using far less human effort than traditionally required, and eventually none. This allows for more complex and realistic worlds, and higher quality, scale, and diversity of tasks. This will be essential to unlock RL scaling. The end goal is to create large-scale, long-horizon environments from a text description alone. This will enable the creation of worlds of arbitrary complexity and scale, which is foundational for training & evaluating autonomous, superintelligent AI agents. Congrats on the launch, Dylan Ma and Naren Yenuganti!

Y Combinator

44,192 Aufrufe • vor 6 Monaten

"So, in the body, we can create an environment that's very hospitable for cancer. We can create an environment that's very inhospitable to cancer. Number one, it has few areas of fungal hypoxia—it has few areas of the body that are deprived of oxygen. Healthy circulation and movement, sunlight, things like red light therapy. The second thing is we don’t have an environment that is very acidic. We know that alkaline environments tend to be disease-free environments. Acidic environments tend to be disease-prone environments." Gary Brecka
8:20

"So, in the body, we can create an environment that's very hospitable for cancer. We can create an environment that's very inhospitable to cancer. Number one, it has few areas of fungal hypoxia—it has few areas of the body that are deprived of oxygen. Healthy circulation and movement, sunlight, things like red light therapy. The second thing is we don’t have an environment that is very acidic. We know that alkaline environments tend to be disease-free environments. Acidic environments tend to be disease-prone environments." Gary Brecka

Shawn Ryan

272,985 Aufrufe • vor 1 Jahr

I found an AI browser that is actually awesome FlowithOS is a web browser COMPLETELY powered by AI You give it tasks, the agents work for you in the background It's like an army of AI agents working for you 24/7 Here's a guide on how it works and how you can get started today
12:09

I found an AI browser that is actually awesome FlowithOS is a web browser COMPLETELY powered by AI You give it tasks, the agents work for you in the background It's like an army of AI agents working for you 24/7 Here's a guide on how it works and how you can get started today

Alex Finn

25,490 Aufrufe • vor 9 Monaten

This is the Claude Code moment for Reinforcement Learning. Every frontier lab knows the secret: post-training is where the magic happens. If you can eval a task, you can use RL to benchmax your model. But building and scaling the RL loop has remained a dark art reserved for the top 1% of AI Labs. Until today. Introducing Optimus — an autonomous RL Agent Harness, and the first of many we are about to ship Iacon Autonomics. We are removing the manual grind of RL and adding taste and relentlessness to the process. Just hand Optimus a codebase, an API key, and a goal. It spins up a fleet of sub-agents to run hundreds of parallel experiments. It learns from its own history, autonomously building an evolutionary tree of runs where every failure sets the next batch up to win. Train LLMs, agents, robots in sim, game npcs and much more. If you can score it, Optimus can train it. Stop doing manual RL. Let the agents cook.
1:57

This is the Claude Code moment for Reinforcement Learning. Every frontier lab knows the secret: post-training is where the magic happens. If you can eval a task, you can use RL to benchmax your model. But building and scaling the RL loop has remained a dark art reserved for the top 1% of AI Labs. Until today. Introducing Optimus — an autonomous RL Agent Harness, and the first of many we are about to ship Iacon Autonomics. We are removing the manual grind of RL and adding taste and relentlessness to the process. Just hand Optimus a codebase, an API key, and a goal. It spins up a fleet of sub-agents to run hundreds of parallel experiments. It learns from its own history, autonomously building an evolutionary tree of runs where every failure sets the next batch up to win. Train LLMs, agents, robots in sim, game npcs and much more. If you can score it, Optimus can train it. Stop doing manual RL. Let the agents cook.

Dev Shah

13,730 Aufrufe • vor 1 Monat

A model is only as good as its data, and we’ve long since exhausted the internet. From here on out, model progress is gated by data production. ’s Brendan (can/do) joined us at our Sovereign AI event to talk about how RL environments get built, and why your data might be your real moat: 00:00 Introduction 00:47 A short history of the data market: crowdsourcing to agentic data 02:29 What an RL environment is: worlds, apps, tasks 03:57 Why only humans can measure the frontier 05:35 Building verifiers is the hard part 06:44 Walkthrough: a real legal RL environment 08:18 Leaderboards — and what open weights change 09:45 Post-training results on Apex Agents 11:17 Three ways companies buy data 12:49 Q&A: How do you price data? 14:17 Q&A: What "data quality" actually means 16:42 Q&A: The misunderstanding about synthetic data 18:17 Q&A: Why RL environments now — and what comes after 21:20 Q&A: Can you scale rubric generation with models? 23:00 Q&A: RL environments for cyber defense 25:33 Q&A: Build data in-house or partner?
26:21

A model is only as good as its data, and we’ve long since exhausted the internet. From here on out, model progress is gated by data production. ’s Brendan (can/do) joined us at our Sovereign AI event to talk about how RL environments get built, and why your data might be your real moat: 00:00 Introduction 00:47 A short history of the data market: crowdsourcing to agentic data 02:29 What an RL environment is: worlds, apps, tasks 03:57 Why only humans can measure the frontier 05:35 Building verifiers is the hard part 06:44 Walkthrough: a real legal RL environment 08:18 Leaderboards — and what open weights change 09:45 Post-training results on Apex Agents 11:17 Three ways companies buy data 12:49 Q&A: How do you price data? 14:17 Q&A: What "data quality" actually means 16:42 Q&A: The misunderstanding about synthetic data 18:17 Q&A: Why RL environments now — and what comes after 21:20 Q&A: Can you scale rubric generation with models? 23:00 Q&A: RL environments for cyber defense 25:33 Q&A: Build data in-house or partner?

Pat Grady

66,577 Aufrufe • vor 1 Monat

Handshake AI CSO Sahil Bhaiwala reveals how they build simulated white-collar work environments to train frontier AI agents: "An environment consists of a few elements. The first is the software tools the agent needs access to. If I'm an investment banker, I have access to Excel, SEC EDGAR where all the financial reports are, and PowerPoint. Agents need the same access." "We build simulated versions because of infrastructure and access constraints. Labs are querying that tool thousands of times in a given second." "The second thing you need is data that populates the environment. If I'm building a financial model, I need the data room with the messy files from the company I'm evaluating." "The final piece is tasks and verifiers. What are the requests of the agent that would reflect what a real investment banker might ask. We try to find tasks complex and realistic enough that the models fail. If the model can't perform, we know it needs more training data." "What we send to labs is essentially a Docker file, a full containerized task. It has the tools the model has access to, the full data that populates the world, and the task and verifier. We'll send tens of thousands of these to a given lab for just one domain." Handshake Garrett Lord
3:53

Handshake AI CSO Sahil Bhaiwala reveals how they build simulated white-collar work environments to train frontier AI agents: "An environment consists of a few elements. The first is the software tools the agent needs access to. If I'm an investment banker, I have access to Excel, SEC EDGAR where all the financial reports are, and PowerPoint. Agents need the same access." "We build simulated versions because of infrastructure and access constraints. Labs are querying that tool thousands of times in a given second." "The second thing you need is data that populates the environment. If I'm building a financial model, I need the data room with the messy files from the company I'm evaluating." "The final piece is tasks and verifiers. What are the requests of the agent that would reflect what a real investment banker might ask. We try to find tasks complex and realistic enough that the models fail. If the model can't perform, we know it needs more training data." "What we send to labs is essentially a Docker file, a full containerized task. It has the tools the model has access to, the full data that populates the world, and the task and verifier. We'll send tens of thousands of these to a given lab for just one domain." Handshake Garrett Lord

MTS

16,158 Aufrufe • vor 27 Tagen

Imagine a population of machine agents. Each might be strong on certain tasks but fundamentally limited: partial tools, partial observations, finite context, bounded compute. How can these agents self-orchestrate and self-evolve into stronger collective intelligence to solve tasks beyond any single agent's capability? Instead of designing the multi-agent system itself, we propose designing the incentives that govern it. We put agents in an economy. They compete, trade, get wealthy, go bankrupt, and mutate, forming an alive society where coordination and adaptation automatically emerge in a decentralized manner.
1:12

Imagine a population of machine agents. Each might be strong on certain tasks but fundamentally limited: partial tools, partial observations, finite context, bounded compute. How can these agents self-orchestrate and self-evolve into stronger collective intelligence to solve tasks beyond any single agent's capability? Instead of designing the multi-agent system itself, we propose designing the incentives that govern it. We put agents in an economy. They compete, trade, get wealthy, go bankrupt, and mutate, forming an alive society where coordination and adaptation automatically emerge in a decentralized manner.

Zhenting Qi

244,657 Aufrufe • vor 3 Monaten

The DeepSeek-R1 paper is a gem! Highly encourage everyone to read it. It's clear that LLM reasoning capabilities can be learned in different ways. RL, if applied correctly and at scale, can lead to some really powerful and interesting scaling and emergent properties. There is more to RL than meets the eye! Here is my breakdown of the paper along with a few tests: The multi-state training might not make sense initially but they provide clues on optimizations that we can continue to tap into. Data quality is still very important for enhancing the usability of the LLM. Unlike other reasoning LLMs, DeepSeek-R1's training recipe and weights are open so we can build on top of it. This opens up exciting research opportunities. About the attached clip: the previous preview model wasn't able to solve this task. DeepSeek-R1 can solve this and many other tasks that o1 can solve. It's a very good model for coding and math.
1:57

The DeepSeek-R1 paper is a gem! Highly encourage everyone to read it. It's clear that LLM reasoning capabilities can be learned in different ways. RL, if applied correctly and at scale, can lead to some really powerful and interesting scaling and emergent properties. There is more to RL than meets the eye! Here is my breakdown of the paper along with a few tests: The multi-state training might not make sense initially but they provide clues on optimizations that we can continue to tap into. Data quality is still very important for enhancing the usability of the LLM. Unlike other reasoning LLMs, DeepSeek-R1's training recipe and weights are open so we can build on top of it. This opens up exciting research opportunities. About the attached clip: the previous preview model wasn't able to solve this task. DeepSeek-R1 can solve this and many other tasks that o1 can solve. It's a very good model for coding and math.

elvis

141,023 Aufrufe • vor 1 Jahr

I am hooked on Dynamic Workflows! The idea of generating harnesses on the fly is so compelling that I reverse-engineered it for my agent orchestrator. And then I built a monitoring dashboard (as an HTML artifact) to track tasks, metrics, and reports. I can now use and monitor dynamic workflows in my agent orchestrator with coding agents like Claude Code, Codex, Pi, and even my own custom-built DAIR.AI agent. This is clearly the future of working with agents to accomplish complex, long-running tasks. Some use cases I'm having success with: - Branching deep research tasks (with verification) - Parallel deep research tasks - Session mining of all my agent sessions - Bug hunting - Triaging - Fact-checking - LLM councils - AI simulations - Data synthesis - Evals generation ... and many others Dynamic workflows, like agent skills, feel like an important primitive to not only get the most out of agents but also incorporate dynamic behaviors and important components like cooperation and verification. There is so much exploration ground here. The exciting part is that this is not limited to coding tasks; it extends to business use cases and many other technical domains like science and research.
0:25

I am hooked on Dynamic Workflows! The idea of generating harnesses on the fly is so compelling that I reverse-engineered it for my agent orchestrator. And then I built a monitoring dashboard (as an HTML artifact) to track tasks, metrics, and reports. I can now use and monitor dynamic workflows in my agent orchestrator with coding agents like Claude Code, Codex, Pi, and even my own custom-built DAIR.AI agent. This is clearly the future of working with agents to accomplish complex, long-running tasks. Some use cases I'm having success with: - Branching deep research tasks (with verification) - Parallel deep research tasks - Session mining of all my agent sessions - Bug hunting - Triaging - Fact-checking - LLM councils - AI simulations - Data synthesis - Evals generation ... and many others Dynamic workflows, like agent skills, feel like an important primitive to not only get the most out of agents but also incorporate dynamic behaviors and important components like cooperation and verification. There is so much exploration ground here. The exciting part is that this is not limited to coding tasks; it extends to business use cases and many other technical domains like science and research.

elvis

104,085 Aufrufe • vor 3 Monaten

RLVR has become the recipe for agentic post-training. But for Computer-Use Agents, the bottleneck is not the algorithm, it is the data. 🐌 🚀 We introduce CUA-Gym: a scalable, lightweight synthesis engine that turns arbitrary task queries into verifiable RLVR data for computer-use agents. The largest open CUA RLVR dataset to date: 🎯 32,122 verifiable RLVR tasks with programmatic setup scripts + rewards 🌐 110 environments: 16 desktop apps + 94 synthesized mock web apps 🏆 Qwen3.5-based CUA models trained with GSPO reach 72.6% on OSWorld-Verified and 56.6% on WebArena 📄 Paper: 🏠 Homepage: 🤗 Dataset: 💻 Codebase: 🧩 Environments: 🧵[1/6]
0:53

RLVR has become the recipe for agentic post-training. But for Computer-Use Agents, the bottleneck is not the algorithm, it is the data. 🐌 🚀 We introduce CUA-Gym: a scalable, lightweight synthesis engine that turns arbitrary task queries into verifiable RLVR data for computer-use agents. The largest open CUA RLVR dataset to date: 🎯 32,122 verifiable RLVR tasks with programmatic setup scripts + rewards 🌐 110 environments: 16 desktop apps + 94 synthesized mock web apps 🏆 Qwen3.5-based CUA models trained with GSPO reach 72.6% on OSWorld-Verified and 56.6% on WebArena 📄 Paper: 🏠 Homepage: 🤗 Dataset: 💻 Codebase: 🧩 Environments: 🧵[1/6]

Bowen Wang

104,223 Aufrufe • vor 3 Monaten

Less than two weeks before he left Google to co-found Discovery Loop, Jeff Dean described the automated research loop the new company is named for, giving no hint he was about to leave to go do it. "There's this sort of the foundation of the scientific method of you propose an experiment, you implement what you need to run the experiment, and you evaluate the experiment, and then you get results from that." "And I think there are more and more problems that are now possible to implement where that whole loop of running not just a few experiments, but running many, many experiments because you're able to automate that loop and make the latency of that loop extremely low is going to be really, really important." "It's going to enable us to tackle lots of different problem domains in science and engineering and machine learning, model design itself, and also in engineering tasks like designing chips."
0:47

Less than two weeks before he left Google to co-found Discovery Loop, Jeff Dean described the automated research loop the new company is named for, giving no hint he was about to leave to go do it. "There's this sort of the foundation of the scientific method of you propose an experiment, you implement what you need to run the experiment, and you evaluate the experiment, and then you get results from that." "And I think there are more and more problems that are now possible to implement where that whole loop of running not just a few experiments, but running many, many experiments because you're able to automate that loop and make the latency of that loop extremely low is going to be really, really important." "It's going to enable us to tackle lots of different problem domains in science and engineering and machine learning, model design itself, and also in engineering tasks like designing chips."

Fireside Alpha

14,495 Aufrufe • vor 1 Monat

Introducing EdgeBench, a benchmark designed to study how agents learn from environments over at least 12~72-hour runs. We find that performance follows a log-sigmoid function of environment interaction time with high precision. EdgeBench is built with three ingredients: - 🌍 Real & Diverse: 134 real-world tasks across 6 task categories, spanning scientific problems, professional knowledge work, software engineering, optimization, formal math, and games. - ⏳ Ultra-Long-Horizon: Each task supports 12–72 hours of agent work. Recorded human effort averages 57.2 hours. - 🔁 Informative Feedback: Agents receive real-world feedback for continuous improvement. After 38,000 hours of agent runs on EdgeBench, a scaling law for learning from environments emerges: - 📈 As agents interact with task environments over time, their aggregate performance is precisely fit by a log-sigmoid function. - 🧠 This phenomenon can be explained by an elegant theory of graph exploration. We are releasing an initial 51 of the 134 tasks, together with the full evaluation framework, to help advance long-horizon agent research. Check our blog & paper for more findings! Blog Paper GitHub Dataset Details below 👇🧵
0:52

Introducing EdgeBench, a benchmark designed to study how agents learn from environments over at least 12~72-hour runs. We find that performance follows a log-sigmoid function of environment interaction time with high precision. EdgeBench is built with three ingredients: - 🌍 Real & Diverse: 134 real-world tasks across 6 task categories, spanning scientific problems, professional knowledge work, software engineering, optimization, formal math, and games. - ⏳ Ultra-Long-Horizon: Each task supports 12–72 hours of agent work. Recorded human effort averages 57.2 hours. - 🔁 Informative Feedback: Agents receive real-world feedback for continuous improvement. After 38,000 hours of agent runs on EdgeBench, a scaling law for learning from environments emerges: - 📈 As agents interact with task environments over time, their aggregate performance is precisely fit by a log-sigmoid function. - 🧠 This phenomenon can be explained by an elegant theory of graph exploration. We are releasing an initial 51 of the 134 tasks, together with the full evaluation framework, to help advance long-horizon agent research. Check our blog & paper for more findings! Blog Paper GitHub Dataset Details below 👇🧵

Deyao Zhu

363,072 Aufrufe • vor 2 Monaten