Загрузка видео...

Не удалось загрузить видео

На главную

Here's Claude tapping, scrolling, finding bugs and fixing them. Testing the entire app experience on iOS. No Xcode. No manual steps. FlowDeck gives your agent eyes on the simulator. Post + Video:

361,716 просмотров • 5 месяцев назад •via X (Twitter)

Комментарии: 61

Фото профиля Alex Fallah
Alex Fallah5 месяцев назад

$60 a year for a UITest wrapper? No thanks.

Фото профиля Daniel Bernal
Daniel Bernal5 месяцев назад

Far from a UITest wrapper, but okay. Your call. :)

Фото профиля luna
luna5 месяцев назад

@itsfallah got claude to remake this in like 5 mins lol

Фото профиля Alex Fallah
Alex Fallah5 месяцев назад

@afterxleep I thought about doing this too. Gotta appreciate the grift.

Фото профиля Blitz
Blitz5 месяцев назад

Sees the bugs, fixes them, now ship it. handles the App Store submission.

Фото профиля Donna Paulsen
Donna Paulsen5 месяцев назад

How’s this different from writing one-time "deterministic" playwright test cases? In this case, you will be burning tokens every time you run You can't deterministically confirm if all the test cases are passing or not I see the appeal but not long-term

Фото профиля Daniel Bernal
Daniel Bernal5 месяцев назад

Playwright takes screenshots and taps by coordinates, while FlowDeck uses your app's accesibility IDs by default. That means theres a HUGE token reduction when not processing images. Still, if you dont have IDs, it can use screenshots.

Фото профиля Donna Paulsen
Donna Paulsen5 месяцев назад

Let me play devil’s advocate to understand the benefits (no ill intent). Fundamentally, I’m assuming the codebase is written with proper IDs and classes, and is well structured (whether AI- or hand-written). 1/

Фото профиля Donna Paulsen
Donna Paulsen5 месяцев назад

Once we have a decent codebase, writing test cases will be a one-time cost. Can use AI for that, but going forward, we only need to run those tests. As we incrementally add features, add corresponding test cases. think this leads to a much larger reduction in token usage overall.

Фото профиля Daniel Bernal
Daniel Bernal5 месяцев назад

This doesn't replace UITests. Write those. What it does is find what UITests can't. Edge cases, layout bugs, rendering issues your tests never covered. The agent actually sees the screen. Across devices, across platforms. It's the QA pass you never have time to do.

Фото профиля Donna Paulsen
Donna Paulsen5 месяцев назад

Sorry if UTs distracted the conversation. I'm saying - we write playwright using Claude and during that time we also take screenshots of what each screen in all possible combinations can look like. These are all test cases - screenshots+clicks. These are repeatable caes. 1/

Фото профиля Donna Paulsen
Donna Paulsen5 месяцев назад

To that extent, we can test various screens and dimensions. It does a pixel comparison, so once it's rendered, we can take screenshots. Can even see rendering time. I'm currently try to evaluate for what case we genuinely need llms. Not trying to discourage your work! It's good.

Фото профиля Daniel Bernal
Daniel Bernal5 месяцев назад

Yea, sure. You can always put something custom together. Thats perfectly valid

Фото профиля Piotr Trocki
Piotr Trocki5 месяцев назад

@PaulSolt Xcode is still needed to install and build the app

Фото профиля Daniel Bernal
Daniel Bernal5 месяцев назад

@PaulSolt Yes

Фото профиля Frank Denbow
Frank Denbow5 месяцев назад

I just prayed for this

Фото профиля Daniel Bernal
Daniel Bernal5 месяцев назад

you can stop now :🙏

Фото профиля Frank Denbow
Frank Denbow5 месяцев назад

I just finished a meeting and was talking about this, especially as we had a bug that was due to older api on user who had older phone

Фото профиля Bijan Cronin
Bijan Cronin5 месяцев назад

This sold me, just bought myself a 1 year license.

Фото профиля Daniel Bernal
Daniel Bernal5 месяцев назад

🖤 thank you for the support!. What are you building?

Фото профиля Bijan Cronin
Bijan Cronin5 месяцев назад

I’m a staff iOS eng @IntelyCare and would like to introduce this to the team.

Фото профиля Daniel Bernal
Daniel Bernal5 месяцев назад

@IntelyCare Awesome! Ping me if you need more info. Here's some demo videos to share:

Фото профиля Bijan Cronin
Bijan Cronin5 месяцев назад

@IntelyCare Will do, and thanks for personally reaching out.

Фото профиля charlie harding
charlie harding5 месяцев назад

I built a skill for it to use simulator how is this different?

Фото профиля Daniel Bernal
Daniel Bernal5 месяцев назад

FlowDeck is a fully native CLI that’s faster and more reliable than letting the agent use xcodebuild directly.

Фото профиля Mike Gannotti
Mike Gannotti5 месяцев назад

That’s pretty sweet

Фото профиля スラバ
スラバ5 месяцев назад

Prompt to Claude: "Recreate flowdeck". Wait for an hour. Profit!

Фото профиля techarena.au
techarena.au5 месяцев назад

Claude doing full iOS QA with no Xcode? Bruh that's wild. QA teams sweating and lowkey jealous lol

Фото профиля Pranay Reddy | building with AI
Pranay Reddy | building with AI5 месяцев назад

We’re a lot closer to witness AI building, testing and deploying secure apps

Фото профиля Panav
Panav5 месяцев назад

How is this different from just the mobile-mcp you can install and give Claude?

Фото профиля Twlvone
Twlvone5 месяцев назад

Agent finds the bug, fixes the code, then taps through the app to verify. The QA loop just collapsed from 'file a ticket and wait' to 'fix and prove it' in one session.

Фото профиля Eugene Zharkov
Eugene Zharkov5 месяцев назад

Love the approach, definitely another step in direction. The major issue for me is fixing issue in such way it burns a LOT of tokens and a time I tried to QA the build through the MCP. - Time consuming, like x3-x5 comparing to regular QA with specific behaviour expectations. - Tokens and sometimes it stucks in loops because of the different reasons

Фото профиля Aleksey Grebenkin
Aleksey Grebenkin5 месяцев назад

Daniel, can it test extensions like the keyboard?

Фото профиля Daniel Bernal
Daniel Bernal5 месяцев назад

It should work but haven’t tested them yet. Grab a trial and try it out!

Фото профиля Arjit Jaiswal
Arjit Jaiswal5 месяцев назад

Genuinely asking, what's the difference between using this or the Blitz MCP or ios-simulator-mcp?

Фото профиля AI Mastery Guide
AI Mastery Guide5 месяцев назад

Giving Claude eyes on the simulator is genuinely a game changer for solo devs. No more manual tap-through testing.

Фото профиля MKB
MKB4 месяцев назад

IOS App: Grindmate: Personal Assistant. 100 Tester only Free Full Functions no paywalls.

Фото профиля gtrc7
gtrc75 месяцев назад

How is it different from claude’s own computer use mcp?

Фото профиля Daniel Bernal
Daniel Bernal5 месяцев назад

Claude will capture your full screen shots, costing you time and tokens. This is designed for Apple Development and uses Apple tools and accesibility IDs for minimum token usage. It's also a CLI, so it works everywhere, no servers needed.

Фото профиля Shai Mishali 🇮🇱
Shai Mishali 🇮🇱5 месяцев назад

@PaulSolt Looks really interesting! Wondering what’s the extra this adds on top of something like XcodeBuildMCP ? (Seriously curious)

Фото профиля Daniel Bernal
Daniel Bernal5 месяцев назад

@PaulSolt You get FlowDeck interactive mode (Terminal UI), macOS automation, 100x faster in test discovery, and xcode project parsing. Also its 3x more efficient in Token Usage compared to it. Here's a good read:

Фото профиля Shai Mishali 🇮🇱
Shai Mishali 🇮🇱5 месяцев назад

@PaulSolt is the discovery path also - screenshot, find a tap coordinate, tap, screenshot, over and over? seems that's what other tools are doing and its slow... seemingly.

Фото профиля Daniel Bernal
Daniel Bernal5 месяцев назад

@PaulSolt Screenshots are a fallback. By default, it exposes the accessibility tree to the agent in real time, and falls back to screenshots only when there are issues.

Фото профиля David T Kramaley
David T Kramaley5 месяцев назад

flowdeck for ios testing, no xcode, end-to-end automation wins

Фото профиля 明亮天空
明亮天空5 месяцев назад

impressive👍

Фото профиля andy
andy5 месяцев назад

Holy token hog

Фото профиля Mahmoud Ashraf
Mahmoud Ashraf5 месяцев назад

What does it do better than @xcodebuildmcp ?

Фото профиля Daniele Bogo
Daniele Bogo5 месяцев назад

Flowdeck is a game changer. Codex works with it trough the Flowdeck skills to run tests and sim. It also saved hours to quickly download an old sim I needed to find a bug!

Фото профиля AiDevCraft
AiDevCraft5 месяцев назад

The real unlock here is closing the edit-verify loop without a human in the seat — agent changes code, then visually confirms the fix on a real simulator. That's the gap that made mobile dev resist automation way longer than web.

Фото профиля Khaled
Khaled5 месяцев назад

Thats great, Im building something similar actually but using AI for generating the test steps only and my engine responsible for executing the tests but it supports only Flutter for now

Фото профиля print({}.format(nome))
print({}.format(nome))5 месяцев назад

That's insane, HF

Фото профиля Claudia
Claudia5 месяцев назад

test suites only cover what you imagined could break agents exploring UIs without a script will find the stuff nobody wrote a test case for most production bugs live in that gap

Фото профиля Danny Suárez 🍄‍🟫 d/acc
Danny Suárez 🍄‍🟫 d/acc5 месяцев назад

Bro, I need this but for a regular web app. Playwright is not enough.

Фото профиля Daniel Bernal
Daniel Bernal5 месяцев назад

I know.

Фото профиля Raffay Sajjad
Raffay Sajjad5 месяцев назад

Watching Claude tap through an iOS app to find bugs is kind of wild. FlowDeck giving the agent a simulator view is a clever approach

Фото профиля InternationalOptions
InternationalOptions5 месяцев назад

Stunning! Is it on GitHub? Can it generally be used even for non Xcode related coding?

Фото профиля Daniel Bernal
Daniel Bernal4 месяцев назад

Its only available for native development.

Фото профиля Chorkpop
Chorkpop5 месяцев назад

What bugs is it fixing in the weather app

Фото профиля Daniel Bernal
Daniel Bernal5 месяцев назад

It found an issue with city sorting while testing. Here’s the full video

Фото профиля Adi
Adi4 месяцев назад

Another weather app … cool

Фото профиля Daniel Bernal
Daniel Bernal4 месяцев назад

oh yes, we need more...

Похожие видео