Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Gemma 2 2B running in a browser, powered by WebLLM & WebGPU! 🔥 100% local & on-device In less than 24 hours, we've already got the model to the edge! ⚡ Try it out on an HF space below:

Vaibhav (VB) Srivastav

58,541 subscribers

54,022 Aufrufe • vor 2 Jahren •via X (Twitter)

Bildung Wissenschaft & Technologie Kunst

Anya Rossi• Live Now

Private livecam show

10 Kommentare

Profilbild von Vaibhav (VB) Srivastav

Vaibhav (VB) Srivastavvor 2 Jahren

Play with it here:

Profilbild von Vaibhav (VB) Srivastav

Vaibhav (VB) Srivastavvor 2 Jahren

It also runs on iOS:

Profilbild von Vaibhav (VB) Srivastav

Vaibhav (VB) Srivastavvor 2 Jahren

And.. Android too:

Profilbild von Yuchen Jin

Yuchen Jinvor 2 Jahren

greta to see MLC and TVM on HF space!

Profilbild von Vaibhav (VB) Srivastav

Vaibhav (VB) Srivastavvor 2 Jahren

Yesss! I love the speed at which they ship! Quite bullish on them 🤗

Profilbild von Xenek Stoehr

Xenek Stoehrvor 2 Jahren

Hello, I have this working on Chrome (Win 11) & Ryzen 7, 3750h. It didn't see my Nvidia GTX-1650 but webGPU did see my AMD Radeon RX Vega 10 Graphics (2Gb Shared DDR4-2600 Vram through PCIe 3.0 x16). prompt 21, completion 101, prefill 14.89 tokens/sec, decode 3.2 t/s

Profilbild von liuyo

liuyovor 2 Jahren

Wow this is crazy, good job

Profilbild von Glenn Cameron Jr

Glenn Cameron Jrvor 2 Jahren

@jason_mayes

Profilbild von Prashant

Prashantvor 2 Jahren

This is 🔥 nice work

Profilbild von J͓T͓

J͓T͓vor 2 Jahren

Daaannnnggg this is super cool! Great work!

Ähnliche Videos

Qwen-2.5 on WebGPU 🏎️ • 42 tok/sec for Qwen2.5-Coder-1.5B on Mac ⚡ • Powered by MLC WebLLM and WebGPU 🔥 Watch Qwen2.5-Coder-1.5B build a website entirely in the browser!

Qwen-2.5 on WebGPU 🏎️ • 42 tok/sec for Qwen2.5-Coder-1.5B on Mac ⚡ • Powered by MLC WebLLM and WebGPU 🔥 Watch Qwen2.5-Coder-1.5B build a website entirely in the browser!

Caleb

41,579 Aufrufe • vor 2 Jahren

Introducing SmolVLM 256M (& 500M): The world’s smallest multimodal model. Designed for efficiency and perfect for on-device applications! 🔥 It’s so small, it can even run 100% locally in your browser on WebGPU! 🤏 Powered by Transformers.js! ⚡️ Try it out yourself! 👇

Introducing SmolVLM 256M (& 500M): The world’s smallest multimodal model. Designed for efficiency and perfect for on-device applications! 🔥 It’s so small, it can even run 100% locally in your browser on WebGPU! 🤏 Powered by Transformers.js! ⚡️ Try it out yourself! 👇

Xenova

25,302 Aufrufe • vor 1 Jahr

$What if psql had an \ai command? This is PGlite (WASM Postgres) and Llama3 (via WebLLM & WebGPU) running completely in the browser - no cloud, no server🤯 Local AI is coming sooner than you think!$

What if psql had an \ai command? This is PGlite (WASM Postgres) and Llama3 (via WebLLM & WebGPU) running completely in the browser - no cloud, no server🤯 Local AI is coming sooner than you think!

Sam Willis

21,688 Aufrufe • vor 2 Jahren

Introducing Phi-3 WebGPU, a private and powerful AI chatbot that runs locally in your browser, powered by 🤗 Transformers.js and onnxruntime-web! 🔒 On-device inference: no data sent to a server ⚡️ WebGPU-accelerated (> 20 t/s) 📥 Model downloaded once and cached Try it out! 👇

Introducing Phi-3 WebGPU, a private and powerful AI chatbot that runs locally in your browser, powered by 🤗 Transformers.js and onnxruntime-web! 🔒 On-device inference: no data sent to a server ⚡️ WebGPU-accelerated (> 20 t/s) 📥 Model downloaded once and cached Try it out! 👇

Xenova

117,724 Aufrufe • vor 2 Jahren

Introducing TTS WebGPU: The first ever text-to-speech web app built with WebGPU acceleration! 🔥 High-quality and natural speech generation that runs 100% locally in your browser, powered by OuteTTS and Transformers.js.🤗 Try it out yourself! Demo + source code below 👇

Introducing TTS WebGPU: The first ever text-to-speech web app built with WebGPU acceleration! 🔥 High-quality and natural speech generation that runs 100% locally in your browser, powered by OuteTTS and Transformers.js.🤗 Try it out yourself! Demo + source code below 👇

Xenova

20,541 Aufrufe • vor 1 Jahr

Explore a new community-built playground allowing you to try Gemma models right in your browser, no installation needed! You no longer need to jump between repositories. Explore an interactive timeline of our models, then switch over to the playground to test them securely on-device! Powered by WebGPU & Transformers.js, test 10+ models and explore the interactive "Gemma Journey" timeline.

Explore a new community-built playground allowing you to try Gemma models right in your browser, no installation needed! You no longer need to jump between repositories. Explore an interactive timeline of our models, then switch over to the playground to test them securely on-device! Powered by WebGPU & Transformers.js, test 10+ models and explore the interactive "Gemma Journey" timeline.

Google Gemma

36,730 Aufrufe • vor 1 Monat

NEW: Alibaba just released Qwen 3.5 Small — a family of powerful multimodal models available in a range of sizes (0.8B, 2B, 4B, and 9B parameters). Perfect for on-device applications! They can even run 100% locally in your browser on WebGPU, powered by Transformers.js! 🤯

NEW: Alibaba just released Qwen 3.5 Small — a family of powerful multimodal models available in a range of sizes (0.8B, 2B, 4B, and 9B parameters). Perfect for on-device applications! They can even run 100% locally in your browser on WebGPU, powered by Transformers.js! 🤯

Xenova

102,592 Aufrufe • vor 6 Monaten

You imagine it. We create it. 🎨 Introducing #PixelStudio, a first-of-its-kind image generator on #Pixel9 powered by an on-device diffusion model¹ running on Tensor G4 and our Imagen 3 text-to-image model in the cloud.

You imagine it. We create it. 🎨 Introducing #PixelStudio, a first-of-its-kind image generator on #Pixel9 powered by an on-device diffusion model¹ running on Tensor G4 and our Imagen 3 text-to-image model in the cloud.

Made by Google

28,283 Aufrufe • vor 2 Jahren

GGUF My Repo by Hugging Face Create quantum GGUF models fully online - quickly and secure. Thanks to Vaibhav (VB) Srivastav, Pedro Cuenca and team for creating this HF space! In the video below I give it a try to create a quantum 8-bit model of Gemma 2B - it took about 60 seconds. The resulting model becomes automatically available in your HF profile and is ready to be used with llama.cpp

Georgi Gerganov

64,515 Aufrufe • vor 2 Jahren

Introducing Supertonic WebGPU: blazingly fast text-to-speech running 100% locally in your browser. ⚡️ Generate free audiobooks in seconds, no installation required. In this example, I created a 5-hour audiobook of The Great Gatsby in less than 3 minutes! 🤯 Try it yourself! 👇

Introducing Supertonic WebGPU: blazingly fast text-to-speech running 100% locally in your browser. ⚡️ Generate free audiobooks in seconds, no installation required. In this example, I created a 5-hour audiobook of The Great Gatsby in less than 3 minutes! 🤯 Try it yourself! 👇

Xenova

23,497 Aufrufe • vor 9 Monaten

Studying offline 3D vibe-coding with Three.js: - Gemma 4 E4B runs on-device via llama.cpp (or in-browser via transformers.js, ~13x slower). - Scene renders through WebGPU→Dawn→Metal. - A grammar + verifier outside the weights makes the model reliable at Three.js.

Studying offline 3D vibe-coding with Three.js: - Gemma 4 E4B runs on-device via llama.cpp (or in-browser via transformers.js, ~13x slower). - Scene renders through WebGPU→Dawn→Metal. - A grammar + verifier outside the weights makes the model reliable at Three.js.

Renaud

13,101 Aufrufe • vor 3 Monaten

Deploying AI at the edge makes local public service tools practical and accessible. PreVillage connects citizens in Nepal to government services over WhatsApp. Powered by Gemma via llama.cpp on a Raspberry Pi, it cleans raw speech transcripts, reasons through user intent, and retrieves verified public sources directly on-device. Congrats on the llama.cpp prize winner for the Gemma 4 Good Hackathon!

Deploying AI at the edge makes local public service tools practical and accessible. PreVillage connects citizens in Nepal to government services over WhatsApp. Powered by Gemma via llama.cpp on a Raspberry Pi, it cleans raw speech transcripts, reasons through user intent, and retrieves verified public sources directly on-device. Congrats on the llama.cpp prize winner for the Gemma 4 Good Hackathon!

Google Gemma

11,553 Aufrufe • vor 11 Tagen

made an interactive video model trained on tap-conditioned data.. tap the screen and it generates the next frames in realtime (small enough to run in the browser with webgpu, even on iphone)

made an interactive video model trained on tap-conditioned data.. tap the screen and it generates the next frames in realtime (small enough to run in the browser with webgpu, even on iphone)

sahir

25,027 Aufrufe • vor 5 Monaten

Before Fable 5 was shut down, it pushed Gemma 4 to 255 tok/s on WebGPU. Some didn't believe it was real. Today we're releasing the demo and kernels it wrote for you to see yourself. Run it locally in your browser. Agentic kernel optimization is the future of on-device inference

Before Fable 5 was shut down, it pushed Gemma 4 to 255 tok/s on WebGPU. Some didn't believe it was real. Today we're releasing the demo and kernels it wrote for you to see yourself. Run it locally in your browser. Agentic kernel optimization is the future of on-device inference

Xenova

485,535 Aufrufe • vor 3 Monaten

WebGPU is INSANE! 🤯 Here's a 24B parameter model running locally in a web browser, at a blazing ~50 tokens/second on my M4 Max. ⚡️ It's the largest model we've ever run with Transformers.js... and we're not stopping here. Big announcement soon.

WebGPU is INSANE! 🤯 Here's a 24B parameter model running locally in a web browser, at a blazing ~50 tokens/second on my M4 Max. ⚡️ It's the largest model we've ever run with Transformers.js... and we're not stopping here. Big announcement soon.

Xenova

36,251 Aufrufe • vor 5 Monaten

Apple released FastVLM so I tried vibe coding a video captioning AI app with it took 5 prompts to get a working app in anycoder and deployed it on Hugging Face 85x faster and 3.4x smaller than comparable sized VLMs the deployed app works 100% locally in your browser powered by transformers.js and WebGPU

Apple released FastVLM so I tried vibe coding a video captioning AI app with it took 5 prompts to get a working app in anycoder and deployed it on Hugging Face 85x faster and 3.4x smaller than comparable sized VLMs the deployed app works 100% locally in your browser powered by transformers.js and WebGPU

AK

42,694 Aufrufe • vor 1 Jahr

✨ Introducing Gemma 3n, available in early preview today. The model uses a cutting-edge architecture optimized for mobile on-device usage. It brings multimodality, super fast inference, and more.

✨ Introducing Gemma 3n, available in early preview today. The model uses a cutting-edge architecture optimized for mobile on-device usage. It brings multimodality, super fast inference, and more.

Google AI Developers

125,331 Aufrufe • vor 1 Jahr