Loading video...
Video Failed to Load
this is what AUTOMATED UI testing looks like testing Twitch's with Maestro
366,878 views • 8 months ago •via X (Twitter)
47 Comments

@Twitch great.. can we connect this in claude/lovable

@Twitch Yes absolutely - you can connect Claude to Maestro MCP:

@Twitch qa engineers watching this like their job flashing before their eyes

@Twitch What are you testing? If it crashes?

@Twitch Verifying the app works functionally as expected. Running through common user journeys to provide assurance that the app still works Also testing accessibility aspects of the app too! And absolutely, if the app under tests crashes, the flow will fail

@Twitch when do you guys plan on releasing agent skills re maestro huge window of opportunity there

@NoahGreenSnow @Twitch You can use Maestro MCP with your preferred LLM:

@Twitch how about a skill to use with the mcp sirs, im not sure if you have been following but trust me after more than a 100 hours of using the maestro mcp (and creating my own skills for it) having something from the team that helps the agent use the mcp would be a huge help

@Twitch QA teams everywhere just saved hours

@Twitch @EuAmoPaoDeAlho olha essa porra

@Twitch This exists? wtf

@Twitch Una maravilla

@Twitch will it work with an app that i have no source code of?

@Twitch Yes, it will.

@Twitch Now this is UI testing that looks enjoyable (or at least not miserable). I like Playwright, but writing tests is so tedious. Test as YAML seems great. I just hope there are Zed/Neovim/VS Code extensions that define the YAML schema? I ain't memorizing all of those keywords.

@Twitch Thanks 🙌 Maestro Studio comes with autocomplete and suggestions, and if VS Code is more your thing then you can find a community contribution called Maestro Workbench

@chrysusdotdev @Twitch Any plans on less rigid trajectories? The step by step has an important role, but having an agent that figures out (broadly speaking) the steps from generic, human instructions (e.g. “go to sign up, create an account, login”) would go such a long way in setting up these tests

@maestro__dev @Twitch There's no reason you couldn't already have an LLM do that right?

@Twitch Wonderful app

@Twitch This is sick

@Twitch 👏🏼👏🏼

@Twitch Cool 😎

@Twitch @Frederic_Molas tu sers de test pas mal

@Twitch this is cool

@Twitch sorry this app is super buggy and unusable on linux. Nice idea but unusable.

@Twitch How is the YAML on the right generated? From predefined test cases, or by recording a manual run and extracting it?

@Twitch You can quickly generate yaml through using Maestro Studio with features such as autocomplete Alternatively you can connect Maestro MCP to help generate tests using an LLM:

@Twitch @emmanuel_haanks

@Twitch nice

@Twitch "Automated ui testing" 😏😏😏 you meant bot farm?? 😏😏😏😏

@Twitch seeing a complex flow just work is a beautiful thing. this is what every user interaction should feel like.

@Twitch Do you have web3 support?

@Twitch Will check this out

@Twitch @grok which tool does auto ui testing for softwares and for apps

@Twitch Great idea. Keep build

@Twitch maestro looks smooth, how flaky are those flows

@Twitch Finally!

@Twitch readable yaml is the right call. the thing that separates this from a screenshot bot is that tapOn: Browse still means something after a redesign, whereas tap 412,880 doesn't. names survive layout changes. pixels never do.

@Twitch wow, amazing

@Twitch What’s the advantage over appium ?

@Twitch check this out:

@Twitch Preciate it, really curious to see if it can do a better job than Appium when it comes to inspection

@Twitch Huge limitations with this software - good for high-level MVP validation, and that's it currently.

@Twitch What limitations are you referring to? We're always receptive to feedback on improving the product 🙌

@Twitch what are it's advantage over playwright ?

@Twitch This is horrendous dude yaml

@Twitch If QA looked like this, half the bug tickets wouldn’t exist
