正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Is this the future of AI browser agents? 👀 WebGPU-accelerated reasoning LLMs are now supported in Transformers.js! 🤯 Here's MiniThinky-v2 (1B) running 100% locally in the browser at ~60 tps (no API calls)! I can't wait to see what you build with it! Demo + source code in 🧵👇

Xenova

20,203 subscribers

81,477 次观看 • 1 年前 •via X (Twitter)

教育科学技术

Anya Rossi• Live Now

Private livecam show

7 条评论

Xenova 的头像

Xenova1 年前

For the AI builders out there: imagine what could be achieved with a browser extension that (1) uses a powerful reasoning LLM, (2) runs 100% locally & privately, and (3) can directly access/manipulate the DOM! 👀 🧑‍💻 Code: 🔗 Demo:

SwarmOne 的头像

SwarmOne1 年前

No more out-of-memory errors! SwarmOne automatically selects the ideal GPU configurations for your specific AI workloads.

Tom Boyle 的头像

Tom Boyle1 年前

WebGPU-powered LLMs running locally? The future is truly here! Can’t wait to see the innovations this unlocks.

Amel Music 的头像

Amel Music1 年前

Cheers, looks nice. Have you tried ReAct reasoning with it?

Bradley Moore 🦇🔊 的头像

Bradley Moore 🦇🔊1 年前

are there any vision models that can be run locally?

moonbi 🇪🇺🪢 的头像

moonbi 🇪🇺🪢1 年前

How smart is it ?

Maya Samir 的头像

Maya Samir1 年前

In-browser LLMs running locally? Total game changer! Can't wait to dive into MiniThinky-v2.

相关视频

Introducing Whisper Timestamped: Multilingual speech recognition with word-level timestamps, running 100% locally in your browser thanks to 🤗 Transformers.js! This unlocks a world of possibilities for in-browser video editing! 🤯 What will you build? 😍 Demo (+ source code) 👇

Introducing Whisper Timestamped: Multilingual speech recognition with word-level timestamps, running 100% locally in your browser thanks to 🤗 Transformers.js! This unlocks a world of possibilities for in-browser video editing! 🤯 What will you build? 😍 Demo (+ source code) 👇

Xenova

105,985 次观看 • 2 年前

Florence-2, the new vision foundation model by Microsoft, can now run 100% locally in your browser on WebGPU, thanks to Transformers.js! 🤗🤯 It supports tasks like image captioning, optical character recognition, object detection, and many more! 😍 WOW! Demo (+ source code) 👇

Florence-2, the new vision foundation model by Microsoft, can now run 100% locally in your browser on WebGPU, thanks to Transformers.js! 🤗🤯 It supports tasks like image captioning, optical character recognition, object detection, and many more! 😍 WOW! Demo (+ source code) 👇

Xenova

88,762 次观看 • 2 年前

Introducing TTS WebGPU: The first ever text-to-speech web app built with WebGPU acceleration! 🔥 High-quality and natural speech generation that runs 100% locally in your browser, powered by OuteTTS and Transformers.js.🤗 Try it out yourself! Demo + source code below 👇

Introducing TTS WebGPU: The first ever text-to-speech web app built with WebGPU acceleration! 🔥 High-quality and natural speech generation that runs 100% locally in your browser, powered by OuteTTS and Transformers.js.🤗 Try it out yourself! Demo + source code below 👇

Xenova

19,666 次观看 • 1 年前

OmniParser, the new screen parsing tool from Microsoft (and #1 trending model on Hugging Face), can now run 100% locally in your browser with Transformers.js! 🤯 Who's going to be the first to turn this into a browser extension? 👀 Endless possibilities! Demo & code below! 👇

OmniParser, the new screen parsing tool from Microsoft (and #1 trending model on Hugging Face), can now run 100% locally in your browser with Transformers.js! 🤯 Who's going to be the first to turn this into a browser extension? 👀 Endless possibilities! Demo & code below! 👇

Xenova

64,560 次观看 • 1 年前

Woah... This is the fastest Transformers.js has ever been! 🤯 Run a 1.7B LLM 100% locally in your browser at over 130 tokens per second! 🚀 No server required. ⚡️ WebGPU-accelerated in-browser inference 📦 Optimized ONNX exports w/ GQA 💬 Multi-round conversations w/ KV caching

Woah... This is the fastest Transformers.js has ever been! 🤯 Run a 1.7B LLM 100% locally in your browser at over 130 tokens per second! 🚀 No server required. ⚡️ WebGPU-accelerated in-browser inference 📦 Optimized ONNX exports w/ GQA 💬 Multi-round conversations w/ KV caching

Xenova

54,099 次观看 • 1 年前

Introducing Kokoro.js, a new JavaScript library for running Kokoro TTS, an 82 million parameter text-to-speech model, 100% locally in the browser w/ WASM. Powered by 🤗 Transformers.js. WebGPU support coming soon! 👉 npm i kokoro-js 👈 Link to demo (+ sample code) in 🧵

Introducing Kokoro.js, a new JavaScript library for running Kokoro TTS, an 82 million parameter text-to-speech model, 100% locally in the browser w/ WASM. Powered by 🤗 Transformers.js. WebGPU support coming soon! 👉 npm i kokoro-js 👈 Link to demo (+ sample code) in 🧵

Xenova

40,340 次观看 • 1 年前

The era of 1-bit LLMs is here — now with WebGPU acceleration! 🤯 It's incredible to think that a quantized 1.7B model (just 290MB in size) can run at ~100 tokens per second entirely in your browser. Try the demo yourself 👇

The era of 1-bit LLMs is here — now with WebGPU acceleration! 🤯 It's incredible to think that a quantized 1.7B model (just 290MB in size) can run at ~100 tokens per second entirely in your browser. Try the demo yourself 👇

Xenova

105,446 次观看 • 3 个月前

Introducing MusicGen Web: AI-powered music generation directly in your browser, built with 🤗 Transformers.js! 🎵 Everything runs 100% locally, meaning no calls to an API! 🤯 Served as a static website... this costs $0 to host and run! 🔥 Try it out yourself! 👇

Introducing MusicGen Web: AI-powered music generation directly in your browser, built with 🤗 Transformers.js! 🎵 Everything runs 100% locally, meaning no calls to an API! 🤯 Served as a static website... this costs $0 to host and run! 🔥 Try it out yourself! 👇

Xenova

31,211 次观看 • 2 年前

Absolutely wild what's possible with Hugging Face's Transformers.js in the browser! 🤯 🎙️Realtime in-browser speech-to-text with OpenAI Whisper! 📡 Broadcast to subscribed clients with Supabase Realtime. 🌏 Translate to 200 languages with AI at Meta's NLLB-200! Source code 👇

Absolutely wild what's possible with Hugging Face's Transformers.js in the browser! 🤯 🎙️Realtime in-browser speech-to-text with OpenAI Whisper! 📡 Broadcast to subscribed clients with Supabase Realtime. 🌏 Translate to 200 languages with AI at Meta's NLLB-200! Source code 👇

Thor 雷神 ⚡️

52,389 次观看 • 2 年前

Behold... GPT-OSS (20B) running 100% locally in your browser on WebGPU. This shouldn't be possible — but with Transformers.js v4 and ONNX Runtime Web, it is! A new class of AI apps is emerging. Zero-install, infinite distribution. Simply visit a website and run models locally.

Behold... GPT-OSS (20B) running 100% locally in your browser on WebGPU. This shouldn't be possible — but with Transformers.js v4 and ONNX Runtime Web, it is! A new class of AI apps is emerging. Zero-install, infinite distribution. Simply visit a website and run models locally.

Xenova

311,512 次观看 • 5 个月前

I seriously cannot believe this is a 0.6B LLM! 🤯 Qwen just released Qwen3, a series of hybrid reasoning models that allow you to control how much "thinking" the model does for a given task. They can even run locally in your browser on WebGPU with 🤗 Transformers.js!

I seriously cannot believe this is a 0.6B LLM! 🤯 Qwen just released Qwen3, a series of hybrid reasoning models that allow you to control how much "thinking" the model does for a given task. They can even run locally in your browser on WebGPU with 🤗 Transformers.js!

Xenova

74,954 次观看 • 1 年前

WebGPU is INSANE! 🤯 Here's a 24B parameter model running locally in a web browser, at a blazing ~50 tokens/second on my M4 Max. ⚡️ It's the largest model we've ever run with Transformers.js... and we're not stopping here. Big announcement soon.

WebGPU is INSANE! 🤯 Here's a 24B parameter model running locally in a web browser, at a blazing ~50 tokens/second on my M4 Max. ⚡️ It's the largest model we've ever run with Transformers.js... and we're not stopping here. Big announcement soon.

Xenova

36,251 次观看 • 4 个月前

Introducing Supertonic WebGPU: blazingly fast text-to-speech running 100% locally in your browser. ⚡️ Generate free audiobooks in seconds, no installation required. In this example, I created a 5-hour audiobook of The Great Gatsby in less than 3 minutes! 🤯 Try it yourself! 👇

Introducing Supertonic WebGPU: blazingly fast text-to-speech running 100% locally in your browser. ⚡️ Generate free audiobooks in seconds, no installation required. In this example, I created a 5-hour audiobook of The Great Gatsby in less than 3 minutes! 🤯 Try it yourself! 👇

Xenova

23,497 次观看 • 8 个月前

RF-DETR, the state-of-the-art model series for real-time object detection, can now run 100% locally in your browser on WebGPU with 🤗 Transformers.js v4! The models are Apache-2.0 licensed, making them a perfect fit for both personal and commercial applications. Try the demo 👇

RF-DETR, the state-of-the-art model series for real-time object detection, can now run 100% locally in your browser on WebGPU with 🤗 Transformers.js v4! The models are Apache-2.0 licensed, making them a perfect fit for both personal and commercial applications. Try the demo 👇

Xenova

77,179 次观看 • 5 个月前

Frontend is WAY harder for AI than backend. That's because it's flying blind. It can't test the code in the environment where it's running - the browser. Here's how to hook up AI to your browser:

Frontend is WAY harder for AI than backend. That's because it's flying blind. It can't test the code in the environment where it's running - the browser. Here's how to hook up AI to your browser:

Matt Pocock

220,946 次观看 • 7 个月前

DINOv3 is revolutionary: a new state-of-the-art vision backbone trained to produce rich, dense image features. I loved their demo video so much that I decided to re-create their visualization tool. Everything runs 100% in-browser with 🤗 Transformers.js! Demo + source code 👇

DINOv3 is revolutionary: a new state-of-the-art vision backbone trained to produce rich, dense image features. I loved their demo video so much that I decided to re-create their visualization tool. Everything runs 100% in-browser with 🤗 Transformers.js! Demo + source code 👇

Xenova

74,801 次观看 • 11 个月前

browser-use agents are now part of ai-gradio in a few lines of code you can launch agents to interact with the browser import gradio as gr import ai_gradio demo = gr.load( name='browser:gpt-4-turbo', src=ai_gradio.registry, title='Browser Agent', description='AI agent that can interact with web browsers' ).launch()

browser-use agents are now part of ai-gradio in a few lines of code you can launch agents to interact with the browser import gradio as gr import ai_gradio demo = gr.load( name='browser:gpt-4-turbo', src=ai_gradio.registry, title='Browser Agent', description='AI agent that can interact with web browsers' ).launch()

AK

81,404 次观看 • 1 年前

$What if psql had an \ai command? This is PGlite (WASM Postgres) and Llama3 (via WebLLM & WebGPU) running completely in the browser - no cloud, no server🤯 Local AI is coming sooner than you think!$

What if psql had an \ai command? This is PGlite (WASM Postgres) and Llama3 (via WebLLM & WebGPU) running completely in the browser - no cloud, no server🤯 Local AI is coming sooner than you think!

Sam Willis

21,660 次观看 • 2 年前

NEW: Real-time conversational AI models can now run 100% locally in your browser! 🤯 🔐 Privacy by design (no data leaves your device) 💰 Completely free... forever 📦 Zero installation required, just visit a website ⚡️ Blazingly-fast WebGPU-accelerated inference Try it out! 👇

NEW: Real-time conversational AI models can now run 100% locally in your browser! 🤯 🔐 Privacy by design (no data leaves your device) 💰 Completely free... forever 📦 Zero installation required, just visit a website ⚡️ Blazingly-fast WebGPU-accelerated inference Try it out! 👇

Xenova

12,094 次观看 • 1 年前

It's finally possible: real-time in-browser speech recognition with OpenAI Whisper! 🤯 The model runs fully on-device using Transformers.js and ONNX Runtime Web, and supports multilingual transcription across 100 different languages! 🔥 Check out the demo (+ source code)! 👇

It's finally possible: real-time in-browser speech recognition with OpenAI Whisper! 🤯 The model runs fully on-device using Transformers.js and ONNX Runtime Web, and supports multilingual transcription across 100 different languages! 🔥 Check out the demo (+ source code)! 👇

Xenova

262,819 次观看 • 2 年前