Now we're cooking. Got TypeSafe AI's Jev + AXe controlling the iOS simulator now ultra fast at a fraction of the cost of using an LLM. This is game changing!

Prompt "Show the OS version and build number".

Prompt: "Open the reminders app, add a new reminder with the text 'Dropoff parcel', after check off the food shopping reminder."

@typesafeai i need this!

@typesafeai How is it able to type arbitrary text from a fixed set of actions? Extracted from the prompt somehow? Super cool

@typesafeai Exactly. Jev just instructs that AXe should type text, AXe then extracts the text from the prompt.

@typesafeai Can you open source the system? How did you build?

@typesafeai It’s just a prototype for now. Many rough edges and bugs. But it’s very promising. Once I’ve made more progress on it I’ll release it as a feature on AXe which is already Open Source.

@typesafeai NEED

@typesafeai @swmansion when argent Jev support?

@typesafeai AXe listing the tree and Jev picking a node is the $0.006 path. if a control isn't in AX, do you screenshot-fallback or skip the step?

@typesafeai Didn’t even see the event get added 😂

@typesafeai It’s below the fold as it didn’t add it as an all day evening.

@typesafeai Oh no I meant the first time I didn’t even see the data entry as it was so fast 😂

@typesafeai I blinked and it had already inputted and closed

@typesafeai How?