Francesco's banner

Francesco

@francedot • 6,838 subscribers

the CUA wizard ʕ•ᴥ•ʔ @trycua

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

1/ Offline computer-use models are here. Today, one running on our Mac made it all the way to hotel checkout. We ran Qwen3.8-27B from Qwen through Cua Driver. It also turned a flyer into a Calendar event and reconciled receipts. Every model token stayed on the Mac 🧵

1/ Offline computer-use models are here. Today, one running on our Mac made it all the way to hotel checkout. We ran Qwen3.8-27B from Qwen through Cua Driver. It also turned a flyer into a Calendar event and reconciled receipts. Every model token stayed on the Mac 🧵

27,126 views • 5 days ago

1/ Today was the first time offline computer use felt real to us. We ran Muse Glimmer 30B from AI at Meta locally and watched it operate Notes and Reminders on macOS through Cua Driver We didn’t expect a 30B local model to get this far 🧵

1/ Today was the first time offline computer use felt real to us. We ran Muse Glimmer 30B from AI at Meta locally and watched it operate Notes and Reminders on macOS through Cua Driver We didn’t expect a 30B local model to get this far 🧵

30,081 views • 9 days ago

Imagine if language models could tap into the app ecosystem of your iPhone. Would the need for plugins and assistants become obsolete if we simply allowed a model to orchestrate our existing (and many years robust) user interfaces? This demonstrates the extent to which GPT-4V excels as a Generalist Mobile AI Agent – without any fine-tuning or grounding, and merely by integrating with a text model that has JSON mode enabled. I suggest watching this demo for a (maybe) wow factor and the results on iOS 17 using NavAIGuide, a mobile and web navigational agent framework for LLMs:

Imagine if language models could tap into the app ecosystem of your iPhone. Would the need for plugins and assistants become obsolete if we simply allowed a model to orchestrate our existing (and many years robust) user interfaces? This demonstrates the extent to which GPT-4V excels as a Generalist Mobile AI Agent – without any fine-tuning or grounding, and merely by integrating with a text model that has JSON mode enabled. I suggest watching this demo for a (maybe) wow factor and the results on iOS 17 using NavAIGuide, a mobile and web navigational agent framework for LLMs:

30,834 views • 2 years ago

No more content to load