Loading video...

Video Failed to Load

Go Home

๐Ÿš€ Introducing Magentic-UI โ€” an experimental human-centered web agent from Microsoft Research . It automates your web tasks while keeping you in control ๐Ÿง ๐Ÿคโ€”through co-planning, co-tasking, action guards, and plan learning. ๐Ÿ”“ Fully open-source. We can't wait for you to try it. ๐Ÿ”—

38,579 views โ€ข 1 year ago โ€ขvia X (Twitter)

8 Comments

AutoGen's profile picture
AutoGen1 year ago

Computer Use Agents (CUAs) aim to automate complex tasksโ€”but current systems are often brittle and risky. Magentic-UI introduces human-agent interaction paradigms to boost reliability, transparency, and control. Here are 4 core features powering that: ๐Ÿง‘โ€๐Ÿคโ€๐Ÿง‘ Co-Planning โ€“ Collaboratively create and approve step-by-step plans ๐Ÿค Co-Tasking โ€“ Work together to execute tasks with real-time feedback ๐Ÿ›ก๏ธ Action Guards โ€“ Protect sensitive actions with user approvals ๐Ÿง  Plan Learning โ€“ Improve future automation by learning from past runs

AutoGen's profile picture
AutoGen1 year ago

๐Ÿ“Š Initial evals are promising. With simulated users in the loop, Magentic-UI shows meaningful accuracy gains on the GAIA benchmarkโ€”compared to fully automated baselines. [Human + agent] > [Agent alone]

AutoGen's profile picture
AutoGen1 year ago

Built on Autogenโ€™s Magentic-One, Magentic-UI adds an interactive layer for humanโ€“agent collaboration. Hereโ€™s the multi-agent set-up: ๐Ÿงญ Orchestrator โ€“ co-plans with the user & delegates ๐ŸŒ WebSurfer โ€“ LLM agent with browser control ๐Ÿ’ป Coder โ€“ writes & runs code in Docker ๐Ÿ“ FileSurfer โ€“ handles file conversion with MarkItDown tools Magentic-UI is modular & extensible - plug in your own agents, and give it a try!

AutoGen's profile picture
AutoGen1 year ago

Weโ€™re building Magentic-UI in the open to push the frontier of humanโ€“agent collaboration. We invite the community to extend and reuse it for their own scientific explorations. We'd love your feedback, thoughts and ideas. Want to learn more? Read our blog post

Attila-IBS's profile picture
Attila-IBS1 year ago

@MSFTResearch Is it related to Magentic-One, is it a UI of it?

Mahi๐Ÿ’›'s profile picture
Mahi๐Ÿ’›1 year ago

@MSFTResearch Make it production ready product, why keep it behind research preview.

yosep's profile picture
yosep1 year ago

@MSFTResearch Auto gen has lots of boiler, any work arounds?

ankur's profile picture
ankur1 year ago

@MSFTResearch What default model do you use?

Related Videos