Загрузка видео...

Не удалось загрузить видео

На главную

Is this the future of AI browser agents? 👀 WebGPU-accelerated reasoning LLMs are now supported in Transformers.js! 🤯 Here's MiniThinky-v2 (1B) running 100% locally in the browser at ~60 tps (no API calls)! I can't wait to see what you build with it! Demo + source code in 🧵👇

xenovacom's profile picture

Xenova

20,203 subscribers

81,477 просмотров • 1 год назад •via X (Twitter)

ОбразованиеНаука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 7

Фото профиля Xenova
Xenova1 год назад

For the AI builders out there: imagine what could be achieved with a browser extension that (1) uses a powerful reasoning LLM, (2) runs 100% locally & privately, and (3) can directly access/manipulate the DOM! 👀 🧑‍💻 Code: 🔗 Demo:

Фото профиля SwarmOne
SwarmOne1 год назад

No more out-of-memory errors! SwarmOne automatically selects the ideal GPU configurations for your specific AI workloads.

Фото профиля Tom Boyle
Tom Boyle1 год назад

WebGPU-powered LLMs running locally? The future is truly here! Can’t wait to see the innovations this unlocks.

Фото профиля Amel Music
Amel Music1 год назад

Cheers, looks nice. Have you tried ReAct reasoning with it?

Фото профиля Bradley Moore 🦇🔊
Bradley Moore 🦇🔊1 год назад

are there any vision models that can be run locally?

Фото профиля moonbi 🇪🇺🪢
moonbi 🇪🇺🪢1 год назад

How smart is it ?

Фото профиля Maya Samir
Maya Samir1 год назад

In-browser LLMs running locally? Total game changer! Can't wait to dive into MiniThinky-v2.

Похожие видео

Introducing Whisper Timestamped: Multilingual speech recognition with word-level timestamps, running 100% locally in your browser thanks to 🤗 Transformers.js! This unlocks a world of possibilities for in-browser video editing! 🤯 What will you build? 😍 Demo (+ source code) 👇
0:37

Introducing Whisper Timestamped: Multilingual speech recognition with word-level timestamps, running 100% locally in your browser thanks to 🤗 Transformers.js! This unlocks a world of possibilities for in-browser video editing! 🤯 What will you build? 😍 Demo (+ source code) 👇

Xenova

105,980 просмотров • 2 лет назад

Florence-2, the new vision foundation model by Microsoft, can now run 100% locally in your browser on WebGPU, thanks to Transformers.js! 🤗🤯 It supports tasks like image captioning, optical character recognition, object detection, and many more! 😍 WOW! Demo (+ source code) 👇
1:05

Florence-2, the new vision foundation model by Microsoft, can now run 100% locally in your browser on WebGPU, thanks to Transformers.js! 🤗🤯 It supports tasks like image captioning, optical character recognition, object detection, and many more! 😍 WOW! Demo (+ source code) 👇

Xenova

88,759 просмотров • 2 лет назад

Introducing TTS WebGPU: The first ever text-to-speech web app built with WebGPU acceleration! 🔥 High-quality and natural speech generation that runs 100% locally in your browser, powered by OuteTTS and Transformers.js.🤗 Try it out yourself! Demo + source code below 👇
0:32

Introducing TTS WebGPU: The first ever text-to-speech web app built with WebGPU acceleration! 🔥 High-quality and natural speech generation that runs 100% locally in your browser, powered by OuteTTS and Transformers.js.🤗 Try it out yourself! Demo + source code below 👇

Xenova

19,666 просмотров • 1 год назад

OmniParser, the new screen parsing tool from Microsoft (and #1 trending model on Hugging Face), can now run 100% locally in your browser with Transformers.js! 🤯 Who's going to be the first to turn this into a browser extension? 👀 Endless possibilities! Demo & code below! 👇
1:17

OmniParser, the new screen parsing tool from Microsoft (and #1 trending model on Hugging Face), can now run 100% locally in your browser with Transformers.js! 🤯 Who's going to be the first to turn this into a browser extension? 👀 Endless possibilities! Demo & code below! 👇

Xenova

64,560 просмотров • 1 год назад

Woah... This is the fastest Transformers.js has ever been! 🤯 Run a 1.7B LLM 100% locally in your browser at over 130 tokens per second! 🚀 No server required. ⚡️ WebGPU-accelerated in-browser inference 📦 Optimized ONNX exports w/ GQA 💬 Multi-round conversations w/ KV caching
0:20

Woah... This is the fastest Transformers.js has ever been! 🤯 Run a 1.7B LLM 100% locally in your browser at over 130 tokens per second! 🚀 No server required. ⚡️ WebGPU-accelerated in-browser inference 📦 Optimized ONNX exports w/ GQA 💬 Multi-round conversations w/ KV caching

Xenova

54,099 просмотров • 1 год назад

Introducing Kokoro.js, a new JavaScript library for running Kokoro TTS, an 82 million parameter text-to-speech model, 100% locally in the browser w/ WASM. Powered by 🤗 Transformers.js. WebGPU support coming soon! 👉 npm i kokoro-js 👈 Link to demo (+ sample code) in 🧵
0:43

Introducing Kokoro.js, a new JavaScript library for running Kokoro TTS, an 82 million parameter text-to-speech model, 100% locally in the browser w/ WASM. Powered by 🤗 Transformers.js. WebGPU support coming soon! 👉 npm i kokoro-js 👈 Link to demo (+ sample code) in 🧵

Xenova

40,340 просмотров • 1 год назад

The era of 1-bit LLMs is here — now with WebGPU acceleration! 🤯 It's incredible to think that a quantized 1.7B model (just 290MB in size) can run at ~100 tokens per second entirely in your browser. Try the demo yourself 👇
0:33

The era of 1-bit LLMs is here — now with WebGPU acceleration! 🤯 It's incredible to think that a quantized 1.7B model (just 290MB in size) can run at ~100 tokens per second entirely in your browser. Try the demo yourself 👇

Xenova

105,446 просмотров • 3 месяцев назад

Introducing MusicGen Web: AI-powered music generation directly in your browser, built with 🤗 Transformers.js! 🎵 Everything runs 100% locally, meaning no calls to an API! 🤯 Served as a static website... this costs $0 to host and run! 🔥 Try it out yourself! 👇
0:20

Introducing MusicGen Web: AI-powered music generation directly in your browser, built with 🤗 Transformers.js! 🎵 Everything runs 100% locally, meaning no calls to an API! 🤯 Served as a static website... this costs $0 to host and run! 🔥 Try it out yourself! 👇

Xenova

31,211 просмотров • 2 лет назад

Absolutely wild what's possible with Hugging Face's Transformers.js in the browser! 🤯 🎙️Realtime in-browser speech-to-text with OpenAI Whisper! 📡 Broadcast to subscribed clients with Supabase Realtime. 🌏 Translate to 200 languages with AI at Meta's NLLB-200! Source code 👇
3:54

Absolutely wild what's possible with Hugging Face's Transformers.js in the browser! 🤯 🎙️Realtime in-browser speech-to-text with OpenAI Whisper! 📡 Broadcast to subscribed clients with Supabase Realtime. 🌏 Translate to 200 languages with AI at Meta's NLLB-200! Source code 👇

Thor 雷神 ⚡️

52,389 просмотров • 2 лет назад

Behold... GPT-OSS (20B) running 100% locally in your browser on WebGPU. This shouldn't be possible — but with Transformers.js v4 and ONNX Runtime Web, it is! A new class of AI apps is emerging. Zero-install, infinite distribution. Simply visit a website and run models locally.
1:23

Behold... GPT-OSS (20B) running 100% locally in your browser on WebGPU. This shouldn't be possible — but with Transformers.js v4 and ONNX Runtime Web, it is! A new class of AI apps is emerging. Zero-install, infinite distribution. Simply visit a website and run models locally.

Xenova

311,512 просмотров • 5 месяцев назад

I seriously cannot believe this is a 0.6B LLM! 🤯 Qwen just released Qwen3, a series of hybrid reasoning models that allow you to control how much "thinking" the model does for a given task. They can even run locally in your browser on WebGPU with 🤗 Transformers.js!
0:24

I seriously cannot believe this is a 0.6B LLM! 🤯 Qwen just released Qwen3, a series of hybrid reasoning models that allow you to control how much "thinking" the model does for a given task. They can even run locally in your browser on WebGPU with 🤗 Transformers.js!

Xenova

74,954 просмотров • 1 год назад

WebGPU is INSANE! 🤯 Here's a 24B parameter model running locally in a web browser, at a blazing ~50 tokens/second on my M4 Max. ⚡️ It's the largest model we've ever run with Transformers.js... and we're not stopping here. Big announcement soon.
1:05

WebGPU is INSANE! 🤯 Here's a 24B parameter model running locally in a web browser, at a blazing ~50 tokens/second on my M4 Max. ⚡️ It's the largest model we've ever run with Transformers.js... and we're not stopping here. Big announcement soon.

Xenova

36,242 просмотров • 4 месяцев назад

Introducing Supertonic WebGPU: blazingly fast text-to-speech running 100% locally in your browser. ⚡️ Generate free audiobooks in seconds, no installation required. In this example, I created a 5-hour audiobook of The Great Gatsby in less than 3 minutes! 🤯 Try it yourself! 👇
1:28

Introducing Supertonic WebGPU: blazingly fast text-to-speech running 100% locally in your browser. ⚡️ Generate free audiobooks in seconds, no installation required. In this example, I created a 5-hour audiobook of The Great Gatsby in less than 3 minutes! 🤯 Try it yourself! 👇

Xenova

23,497 просмотров • 8 месяцев назад

RF-DETR, the state-of-the-art model series for real-time object detection, can now run 100% locally in your browser on WebGPU with 🤗 Transformers.js v4! The models are Apache-2.0 licensed, making them a perfect fit for both personal and commercial applications. Try the demo 👇
0:42

RF-DETR, the state-of-the-art model series for real-time object detection, can now run 100% locally in your browser on WebGPU with 🤗 Transformers.js v4! The models are Apache-2.0 licensed, making them a perfect fit for both personal and commercial applications. Try the demo 👇

Xenova

77,147 просмотров • 5 месяцев назад

Frontend is WAY harder for AI than backend. That's because it's flying blind. It can't test the code in the environment where it's running - the browser. Here's how to hook up AI to your browser:
5:28

Frontend is WAY harder for AI than backend. That's because it's flying blind. It can't test the code in the environment where it's running - the browser. Here's how to hook up AI to your browser:

Matt Pocock

220,946 просмотров • 6 месяцев назад

DINOv3 is revolutionary: a new state-of-the-art vision backbone trained to produce rich, dense image features. I loved their demo video so much that I decided to re-create their visualization tool. Everything runs 100% in-browser with 🤗 Transformers.js! Demo + source code 👇
0:28

DINOv3 is revolutionary: a new state-of-the-art vision backbone trained to produce rich, dense image features. I loved their demo video so much that I decided to re-create their visualization tool. Everything runs 100% in-browser with 🤗 Transformers.js! Demo + source code 👇

Xenova

74,801 просмотров • 11 месяцев назад

browser-use agents are now part of ai-gradio in a few lines of code you can launch agents to interact with the browser import gradio as gr import ai_gradio demo = gr.load( name='browser:gpt-4-turbo', src=ai_gradio.registry, title='Browser Agent', description='AI agent that can interact with web browsers' ).launch()
0:26

browser-use agents are now part of ai-gradio in a few lines of code you can launch agents to interact with the browser import gradio as gr import ai_gradio demo = gr.load( name='browser:gpt-4-turbo', src=ai_gradio.registry, title='Browser Agent', description='AI agent that can interact with web browsers' ).launch()

AK

81,404 просмотров • 1 год назад

What if psql had an \ai command? This is PGlite (WASM Postgres) and Llama3 (via WebLLM & WebGPU) running completely in the browser - no cloud, no server🤯 Local AI is coming sooner than you think!
1:10

What if psql had an \ai command? This is PGlite (WASM Postgres) and Llama3 (via WebLLM & WebGPU) running completely in the browser - no cloud, no server🤯 Local AI is coming sooner than you think!

Sam Willis

21,660 просмотров • 2 лет назад

NEW: Real-time conversational AI models can now run 100% locally in your browser! 🤯 🔐 Privacy by design (no data leaves your device) 💰 Completely free... forever 📦 Zero installation required, just visit a website ⚡️ Blazingly-fast WebGPU-accelerated inference Try it out! 👇
0:58

NEW: Real-time conversational AI models can now run 100% locally in your browser! 🤯 🔐 Privacy by design (no data leaves your device) 💰 Completely free... forever 📦 Zero installation required, just visit a website ⚡️ Blazingly-fast WebGPU-accelerated inference Try it out! 👇

Xenova

12,094 просмотров • 1 год назад

It's finally possible: real-time in-browser speech recognition with OpenAI Whisper! 🤯 The model runs fully on-device using Transformers.js and ONNX Runtime Web, and supports multilingual transcription across 100 different languages! 🔥 Check out the demo (+ source code)! 👇
0:25

It's finally possible: real-time in-browser speech recognition with OpenAI Whisper! 🤯 The model runs fully on-device using Transformers.js and ONNX Runtime Web, and supports multilingual transcription across 100 different languages! 🔥 Check out the demo (+ source code)! 👇

Xenova

262,776 просмотров • 2 лет назад