Eric's banner
Eric's profile picture

Eric

@Ex0byt • 11,672 subscribers

Strategic Technologist. Doing my little part to democratize foundational, truly open AI for all. Knowledge is a passion. Lead by example. (Opinions are my own.)

Videos

LIVE
1.2k

Anya Rossi

sweetdream.ai

SweetDream.aiSponsored•Livecam
Streaming Now

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

HD live stream
Exclusive private shows
1.2k viewers online

Free preview available • Premium content

Numbers in! Target: 150 tok/s browser-native Qwen 3.5 inference Achieved: 180 tok/s — Qwen 3.5 INT4, WebGPU, browser-only. No cloud, APIs, servers, just Pure WebGPU + WGSL optimizations, HF SafeTensors, single browser tab. Open AI, for real.
0:57
Ex0byt's profile picture

Numbers in! Target: 150 tok/s browser-native Qwen 3.5 inference Achieved: 180 tok/s — Qwen 3.5 INT4, WebGPU, browser-only. No cloud, APIs, servers, just Pure WebGPU + WGSL optimizations, HF SafeTensors, single browser tab. Open AI, for real.

Eric

256,656 Aufrufe • vor 6 Monaten

the different flavors of specdec, and why I'm trying produce a Qwen-3.6-27b EAGLE-3 drafter for ya'll
0:39
Ex0byt's profile picture

the different flavors of specdec, and why I'm trying produce a Qwen-3.6-27b EAGLE-3 drafter for ya'll

Eric

18,198 Aufrufe • vor 3 Monaten

Keine weiteren Inhalte verfügbar