Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

Fuck yeah! Llama 3.2 3B running on your browser! 100% local, powered by WebGPU & MLC 🦙

Vaibhav (VB) Srivastav

56,453 subscribers

282,074 görüntüleme • 2 yıl önce •via X (Twitter)

Oyun Bilim & Teknoloji Eğitim

Anya Rossi• Live Now

Private livecam show

10 Yorum

Vaibhav (VB) Srivastav profil fotoğrafı

Vaibhav (VB) Srivastav2 yıl önce

Try it out here:

Varun profil fotoğrafı

Varun2 yıl önce

sweet - i think even better on someone else’s browser :)

Petri Kuittinen profil fotoğrafı

Petri Kuittinen2 yıl önce

Nice, but it seems to take forever to load, as I selected Llama-3.2-3B-instruct-q4f321-MLC. Only 20% 272 seconds. I have 500/500 Mbits/s fiber and normally it should take only 40 seconds to load the entire q4 model!

Vaibhav (VB) Srivastav profil fotoğrafı

Vaibhav (VB) Srivastav2 yıl önce

Not sure! But could be a browser/ transient error in loading weights.

🐧 lalo adrian morales 𝕏 profil fotoğrafı

🐧 lalo adrian morales 𝕏2 yıl önce

it's so good!!! l love being able to download such powerful things and run them without wifi and then make software that calls to these local llms... it's the new arcade game

Anthonix profil fotoğrafı

Anthonix2 yıl önce

What about Safari? Sorta sucks to have to use Chrome.

Beat Sieber profil fotoğrafı

Beat Sieber2 yıl önce

Runs on my 4 year old Laptop with 16 GB of RAM in Chrome. Cool!

Mike D profil fotoğrafı

Mike D2 yıl önce

@_philschmid Light em up 🔥🔥🔥

George Siosi Samuels profil fotoğrafı

George Siosi Samuels2 yıl önce

@BrianRoemmele

liuyo profil fotoğrafı

liuyo2 yıl önce

It has finally come

Benzer Videolar

Gemma 2 2B running in a browser, powered by WebLLM & WebGPU! 🔥 100% local & on-device In less than 24 hours, we've already got the model to the edge! ⚡ Try it out on an HF space below:

Gemma 2 2B running in a browser, powered by WebLLM & WebGPU! 🔥 100% local & on-device In less than 24 hours, we've already got the model to the edge! ⚡ Try it out on an HF space below:

Vaibhav (VB) Srivastav

54,022 görüntüleme • 2 yıl önce

Qwen-2.5 on WebGPU 🏎️ • 42 tok/sec for Qwen2.5-Coder-1.5B on Mac ⚡ • Powered by MLC WebLLM and WebGPU 🔥 Watch Qwen2.5-Coder-1.5B build a website entirely in the browser!

Qwen-2.5 on WebGPU 🏎️ • 42 tok/sec for Qwen2.5-Coder-1.5B on Mac ⚡ • Powered by MLC WebLLM and WebGPU 🔥 Watch Qwen2.5-Coder-1.5B build a website entirely in the browser!

Caleb

41,579 görüntüleme • 2 yıl önce

Introducing Moonshine Web: real-time speech recognition running 100% locally in your browser! 🚀 Faster and more accurate than Whisper 🔒 Privacy-focused (no data leaves your device) ⚡️ WebGPU accelerated (w/ WASM fallback) 🔥 Powered by ONNX Runtime Web and Transformers.js

Introducing Moonshine Web: real-time speech recognition running 100% locally in your browser! 🚀 Faster and more accurate than Whisper 🔒 Privacy-focused (no data leaves your device) ⚡️ WebGPU accelerated (w/ WASM fallback) 🔥 Powered by ONNX Runtime Web and Transformers.js

Xenova

27,940 görüntüleme • 1 yıl önce

Introducing: a coding agent (Pi) running entirely in your browser using a 2B model on WebGPU 🤯 MiniCPM5-2B + Pi, powered by Transformers.js + WebGPU + 4-bit ONNX weights. All previous attempt to create this failed but MiniCPM5 seems to make it usable. Available now on Hugging Face 👇

Introducing: a coding agent (Pi) running entirely in your browser using a 2B model on WebGPU 🤯 MiniCPM5-2B + Pi, powered by Transformers.js + WebGPU + 4-bit ONNX weights. All previous attempt to create this failed but MiniCPM5 seems to make it usable. Available now on Hugging Face 👇

Victor M

89,644 görüntüleme • 16 gün önce

Run any LLM like Llama 3.2 directly from Hugging Face using Ollama on your local computer (100% free and without internet).

Run any LLM like Llama 3.2 directly from Hugging Face using Ollama on your local computer (100% free and without internet).

Shubham Saboo

33,551 görüntüleme • 1 yıl önce

Announcing An open source wireframe to app tool powered by Llama 3.2 vision. Upload a screenshot of a simple site/design & get code. 100% free and open source.

Announcing An open source wireframe to app tool powered by Llama 3.2 vision. Upload a screenshot of a simple site/design & get code. 100% free and open source.

Hassan

186,057 görüntüleme • 2 yıl önce

Introducing TTS WebGPU: The first ever text-to-speech web app built with WebGPU acceleration! 🔥 High-quality and natural speech generation that runs 100% locally in your browser, powered by OuteTTS and Transformers.js.🤗 Try it out yourself! Demo + source code below 👇

Introducing TTS WebGPU: The first ever text-to-speech web app built with WebGPU acceleration! 🔥 High-quality and natural speech generation that runs 100% locally in your browser, powered by OuteTTS and Transformers.js.🤗 Try it out yourself! Demo + source code below 👇

Xenova

20,541 görüntüleme • 1 yıl önce

Yeah, bloom node in #threejs r167! Let's make some particles! Linked this time, inspired by Keijiro Takahashi , but in your browser, on your GPU :) Link to play below ⬇️ #tsl #webgpu #compute

Yeah, bloom node in #threejs r167! Let's make some particles! Linked this time, inspired by Keijiro Takahashi , but in your browser, on your GPU :) Link to play below ⬇️ #tsl #webgpu #compute

Christophe Choffel

45,796 görüntüleme • 2 yıl önce

Hermes agent running in private browser on free local models Private by design. Local. Open-source

Hermes agent running in private browser on free local models Private by design. Local. Open-source

Sigma Browser

61,835 görüntüleme • 4 ay önce

Okay this is insane... WebGPU-accelerated semantic video tracking, powered by DINOv3 and Transformers.js! 🤯 This will revolutionize AI-powered video editors... which can now run 100% locally in your browser, no server inference required (costs $0)! 😍 Who's building this?

Okay this is insane... WebGPU-accelerated semantic video tracking, powered by DINOv3 and Transformers.js! 🤯 This will revolutionize AI-powered video editors... which can now run 100% locally in your browser, no server inference required (costs $0)! 😍 Who's building this?

Xenova

42,934 görüntüleme • 1 yıl önce

Introducing SmolVLM 256M (& 500M): The world’s smallest multimodal model. Designed for efficiency and perfect for on-device applications! 🔥 It’s so small, it can even run 100% locally in your browser on WebGPU! 🤏 Powered by Transformers.js! ⚡️ Try it out yourself! 👇

Introducing SmolVLM 256M (& 500M): The world’s smallest multimodal model. Designed for efficiency and perfect for on-device applications! 🔥 It’s so small, it can even run 100% locally in your browser on WebGPU! 🤏 Powered by Transformers.js! ⚡️ Try it out yourself! 👇

Xenova

25,302 görüntüleme • 1 yıl önce

NEW: Mistral AI releases Mistral 3, a family of multimodal models, including three start-of-the-art dense models (3B, 8B, and 14B) and Mistral Large 3 (675B, 41B active). All Apache 2.0! 🤗 Surprisingly, the 3B is small enough to run 100% locally in your browser on WebGPU! 🤯

NEW: Mistral AI releases Mistral 3, a family of multimodal models, including three start-of-the-art dense models (3B, 8B, and 14B) and Mistral Large 3 (675B, 41B active). All Apache 2.0! 🤗 Surprisingly, the 3B is small enough to run 100% locally in your browser on WebGPU! 🤯

Xenova

225,295 görüntüleme • 10 ay önce

NEW: Alibaba just released Qwen 3.5 Small — a family of powerful multimodal models available in a range of sizes (0.8B, 2B, 4B, and 9B parameters). Perfect for on-device applications! They can even run 100% locally in your browser on WebGPU, powered by Transformers.js! 🤯

NEW: Alibaba just released Qwen 3.5 Small — a family of powerful multimodal models available in a range of sizes (0.8B, 2B, 4B, and 9B parameters). Perfect for on-device applications! They can even run 100% locally in your browser on WebGPU, powered by Transformers.js! 🤯

Xenova

102,592 görüntüleme • 7 ay önce

IBM just released Granite 4.0, their latest series of small language models! These models excel at agentic workflows (tool calling), document analysis, RAG, and more. 🚀 The "Micro" (3.4B) model can even run 100% locally in your browser on WebGPU, powered by 🤗 Transformers.js!

IBM just released Granite 4.0, their latest series of small language models! These models excel at agentic workflows (tool calling), document analysis, RAG, and more. 🚀 The "Micro" (3.4B) model can even run 100% locally in your browser on WebGPU, powered by 🤗 Transformers.js!

Xenova

82,974 görüntüleme • 1 yıl önce