Loading video...
Video Failed to Load
๐ Introducing Magentic-UI โ an experimental human-centered web agent from Microsoft Research . It automates your web tasks while keeping you in control ๐ง ๐คโthrough co-planning, co-tasking, action guards, and plan learning. ๐ Fully open-source. We can't wait for you to try it. ๐
38,579 views โข 1 year ago โขvia X (Twitter)
8 Comments

Computer Use Agents (CUAs) aim to automate complex tasksโbut current systems are often brittle and risky. Magentic-UI introduces human-agent interaction paradigms to boost reliability, transparency, and control. Here are 4 core features powering that: ๐งโ๐คโ๐ง Co-Planning โ Collaboratively create and approve step-by-step plans ๐ค Co-Tasking โ Work together to execute tasks with real-time feedback ๐ก๏ธ Action Guards โ Protect sensitive actions with user approvals ๐ง Plan Learning โ Improve future automation by learning from past runs

๐ Initial evals are promising. With simulated users in the loop, Magentic-UI shows meaningful accuracy gains on the GAIA benchmarkโcompared to fully automated baselines. [Human + agent] > [Agent alone]

Built on Autogenโs Magentic-One, Magentic-UI adds an interactive layer for humanโagent collaboration. Hereโs the multi-agent set-up: ๐งญ Orchestrator โ co-plans with the user & delegates ๐ WebSurfer โ LLM agent with browser control ๐ป Coder โ writes & runs code in Docker ๐ FileSurfer โ handles file conversion with MarkItDown tools Magentic-UI is modular & extensible - plug in your own agents, and give it a try!

Weโre building Magentic-UI in the open to push the frontier of humanโagent collaboration. We invite the community to extend and reuse it for their own scientific explorations. We'd love your feedback, thoughts and ideas. Want to learn more? Read our blog post

@MSFTResearch Is it related to Magentic-One, is it a UI of it?

@MSFTResearch Make it production ready product, why keep it behind research preview.

@MSFTResearch Auto gen has lots of boiler, any work arounds?

@MSFTResearch What default model do you use?

