Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

We just open-sourced Simulang, a JavaScript library that gives you and your coding agents the ability to fully control computers. Simulang is our scripting framework for desktop automation. It allows you to write deterministic computer use code that can be replayed dozens if not hundreds of times. Much faster...

14,515 görüntüleme • 5 ay önce •via X (Twitter)

13 Yorum

Aryan Rakib profil fotoğrafı
Aryan Rakib5 ay önce

This is insane

Simular profil fotoğrafı
Simular5 ay önce

In the good way or the bad way?

Lydiaaa profil fotoğrafı
Lydiaaa5 ay önce

There are so many use cases I can imagine with Simulang! 🔥

Simular profil fotoğrafı
Simular5 ay önce

What use case if you have to pick only one

nsxdavid profil fotoğrafı
nsxdavid5 ay önce

Deterministic replay is the right direction. The missing layer is that a lot of UI failure doesn’t live in the final state. It lives between states: cursor/ghost offsets, delayed indicators, animation timing, drag feedback, all the stuff a human catches as motion. Computer use needs replay, but it also needs temporal visual verification.

Simular profil fotoğrafı
Simular5 ay önce

You are absolutely right

samantha | computer-use ai agents profil fotoğrafı
samantha | computer-use ai agents5 ay önce

looking forward to Simulang recipes 👀

Simular profil fotoğrafı
Simular5 ay önce

Look forward to a recipe created by you

Matt profil fotoğrafı
Matt5 ay önce

deterministic replay is the easy half. UI drift breaks selectors and coordinates. accessibility trees (AX on mac, UIA on windows) survive theme and font shifts where DOM scripts dont. we built Terminator on exactly that AX/UIA tree approach so selectors hold through theme and font drift,

Ethan Walker profil fotoğrafı
Ethan Walker5 ay önce

The transition from “chatbots” to true computer-use agents is probably one of the most important shifts happening in AI right now. Agents that can actually operate software environments reliably will change how people work.

Simular profil fotoğrafı
Simular5 ay önce

Great insight!

Ang Li profil fotoğrafı
Ang Li5 ay önce

I guess we need a playwright for computer use

Simular profil fotoğrafı
Simular5 ay önce

This is gonna be a better playwright for computer use

Benzer Videolar

Introducing the Clips chrome extension - the easiest way to send bug reports to agents with video, transcript, and browser debug info captured automatically. 100% free and open source. If you are like me and get tired of manually typing instructions to agents, attaching screenshots, pasting debug logs, and all of that, this might be your new favorite tool. With the Clips chrome extension, you can just click the Clips icon, hit record, and start talking. Visually demonstrate your issue, go through the flow, point out what’s broken. Clips will capture everything on your screen, plus network requests, browser logs, client errors, and all the details around them. And it redacts sensitive information. Then it gives you a link you can send to humans so they can play it and take a look. Or, more importantly, just give it to your agents by just pasting the URL to them. The link has special metadata for agents so just from the URL, the agent can pull all information from the clip automatically. No plugin or MCP server required. That means it can "see and hear" what’s in the video - read the transcript, grab snapshots at any timestamp, and inspect the logs and network requests that were shared with it. So whether you want to quickly demo an issue and send all that context to an agent, or get better bug reports from teammates, recording and sending Clips makes that super easy. Unlike expensive apps like Loom, this is all 100% free and open source. The framework that powers this, plus a bunch of other free applications, is open source too. You can just sign up and use it, or fork it and customize it to your needs. This, in my opinion, is the future of software. Rather than bloated SaaS that charges you a ton of money and still doesn’t even have the things you need, we get free open source canonical apps that you can fork and customize in any way you want. I'll link to all this stuff in the replies. If you try it, let me know your feedback.

Steve (Builder.io)

61,217 görüntüleme • 4 ay önce