4/ Here's a demo of a Window-powered ChatGPT clone *running Alpaca.cpp locally* Comparing its math abilities to GPT-4's:

1/ Excited to launch an experiment today - introducing Window, a way to use your own AI models on the web - including local ones! It's a bet on a new kind of AI app emerging, one that shifts model authentication and management to the user.

2/ For a while I've been looking for AI apps that are model-polymorphic: no ties to API keys, specific models, or even backends. Current approaches all involve some kind of vendor lock-in. Some ask for API keys directly, but will suffer user drop-off (and could expose your keys)

3/ Window works as a browser extension and JavaScript API: • You configure your keys and models just once • Apps can request permission to send prompts to your chosen model via the injected " lib. • You maintain visibility on what's being asked!

(4.5/ Side note: that demo is thanks to @ggerganov for showing what's possible on the edge with alpaca.cpp, and to this team for making the first Window app!)

5/ Get started at demo by @colinfortuner. While we await extension store approval, follow the site's guidance to download and install beta builds via our Discord group, where you can explore creations by others.

6/ You'll find a few developers there building games (two so far!), Window app discovery, and interoperable extensions. I'm particularly curious about enabling more LLM games, since there are very few today - it's just too hard. I hear sentiments like this a lot:

7/ Another great use case is privacy! Now you can fine-tune your own local model on private data and use it on the web, with full visibility on the prompts). It becomes portable. Stay tuned for exciting excryption work using hosted models as well :)

8/ Models supported by Window today, with more to come: • @OpenAI's GPT-3.5 & GPT-4 • Local models like LlaMa/Alpaca • @togethercompute's GPT NeoXT 20B • @CohereAI's Xlarge

@OpenAI @togethercompute @CohereAI 8/ One other hope here is that the JavaScript API becomes an evolving standard for various AI apps, even multimodal. It's inspired by the way crypto wallets work. So please provide feedback, here or Discord. I'll also showcase apps here as they emerge!

@OpenAI @togethercompute @CohereAI 9/ For those asking, the site is actually

Thought this was a nice succinct way of describing it:

Things we may need for this to work: 1) A variety of JavaScript apps built on top of the ` standard. 2) Private, niche models to plug into it from the other side. Could be a two-sided challenge!

We now have an aggregator of Window apps, Includes 3 games, a ChatGPT clone, a Toolformer implementation, and one template for making your own using Next.js

Some AI games ask you to create your own setting / story context with high variation, but I haven't seen one as simple as "enter a year":

First pre-existing app to check for ` instead of relying on API key input: by @minosvasilias !

"Keyless" AI content generation - like Jasper, but OSS and a customizable model!

We're now open-source!

The ChatGPT UI from this tweet is also open-sourced and from @mckaywrigley! Window AI fork is available here:

People seem excited, so announcing a mini weekend hackathon!

And we're finally live on the store! Get the extension for Chrome here. More browsers coming soon.

Added @AnthropicAI models, plus a way of using OpenAI/Anthropic without API keys:

Added Google PaLM here 🦬