Chrome's new `window​.ai` feature is going to change the web forever! 🤯 It allows you to run Gemini Nano, a powerful 3.25B parameter LLM, 100% locally in your browser! We've also added experimental support to 🤗 Transformers.js, making it super easy to use! 😍 Check it out! 👇

Since the API is experimental, you will need to install Chrome Dev/Canary version 127 or higher, and enable a few flags to get it working (see demo for more detailed instructions) 👇 🔗 Link to demo:

Update: We released a blog post showing how you can get this running locally, as well as how to use the Prompt API with 🤗 Transformers.js! Check it out! 👇

"This is going to change everything", changes nothing.

just a heads up, ONNX now supports webgpu in service workers, ie chrome extensions. would be cool to adjust transformerjs to handle this

Genuine question. Why would I use this ?

(⁠╯⁠°⁠□⁠°⁠）⁠╯⁠︵⁠ ⁠┻⁠━⁠┻ @brave already does this

just when i thought a chrome tab couldn’t possibly use more memory

What they used for? I'm new to all this, forgive me

show some usecase outside of chatbot, we got those, they work fine as unembedded, i can feel there are use cases way better top of my head, configuration agent, but i mean it, something that can setup cron stuff and run some scripts