Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Gemma 2 2B running in a browser, powered by WebLLM & WebGPU! 🔥 100% local & on-device In less than 24 hours, we've already got the model to the edge! ⚡ Try it out on an HF space below:

53,790 Aufrufe • vor 1 Jahr •via X (Twitter)

10 Kommentare

Profilbild von Vaibhav (VB) Srivastav
Vaibhav (VB) Srivastavvor 1 Jahr

Play with it here:

Profilbild von Vaibhav (VB) Srivastav
Vaibhav (VB) Srivastavvor 1 Jahr

It also runs on iOS:

Profilbild von Vaibhav (VB) Srivastav
Vaibhav (VB) Srivastavvor 1 Jahr

And.. Android too:

Profilbild von Yuchen Jin
Yuchen Jinvor 1 Jahr

greta to see MLC and TVM on HF space!

Profilbild von Vaibhav (VB) Srivastav
Vaibhav (VB) Srivastavvor 1 Jahr

Yesss! I love the speed at which they ship! Quite bullish on them 🤗

Profilbild von Xenek Stoehr
Xenek Stoehrvor 1 Jahr

Hello, I have this working on Chrome (Win 11) & Ryzen 7, 3750h. It didn't see my Nvidia GTX-1650 but webGPU did see my AMD Radeon RX Vega 10 Graphics (2Gb Shared DDR4-2600 Vram through PCIe 3.0 x16). prompt 21, completion 101, prefill 14.89 tokens/sec, decode 3.2 t/s

Profilbild von liuyo
liuyovor 1 Jahr

Wow this is crazy, good job

Profilbild von Glenn Cameron Jr
Glenn Cameron Jrvor 1 Jahr

@jason_mayes

Profilbild von Prashant
Prashantvor 1 Jahr

This is 🔥 nice work

Profilbild von J͓T͓
J͓T͓vor 1 Jahr

Daaannnnggg this is super cool! Great work!

Ähnliche Videos