正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Okay, this is actually insane... You can now run LFM2.5-1.2B-Thinking (a 1.2B parameter LLM from @LiquidAI) at over 200 tokens per second directly in your browser on WebGPU! 🤯 Zero install. Fully private. Blazingly fast. Powered by Transformers.js and ONNX Runtime Web

Xenova

20,586 subscribers

104,476 次观看 • 7 个月前 •via X (Twitter)

新闻政治科学技术

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Woah... This is the fastest Transformers.js has ever been! 🤯 Run a 1.7B LLM 100% locally in your browser at over 130 tokens per second! 🚀 No server required. ⚡️ WebGPU-accelerated in-browser inference 📦 Optimized ONNX exports w/ GQA 💬 Multi-round conversations w/ KV caching

Woah... This is the fastest Transformers.js has ever been! 🤯 Run a 1.7B LLM 100% locally in your browser at over 130 tokens per second! 🚀 No server required. ⚡️ WebGPU-accelerated in-browser inference 📦 Optimized ONNX exports w/ GQA 💬 Multi-round conversations w/ KV caching

Xenova

54,099 次观看 • 1 年前

Behold... GPT-OSS (20B) running 100% locally in your browser on WebGPU. This shouldn't be possible — but with Transformers.js v4 and ONNX Runtime Web, it is! A new class of AI apps is emerging. Zero-install, infinite distribution. Simply visit a website and run models locally.

Behold... GPT-OSS (20B) running 100% locally in your browser on WebGPU. This shouldn't be possible — but with Transformers.js v4 and ONNX Runtime Web, it is! A new class of AI apps is emerging. Zero-install, infinite distribution. Simply visit a website and run models locally.

Xenova

311,512 次观看 • 7 个月前

WebGPU is INSANE! 🤯 Here's a 24B parameter model running locally in a web browser, at a blazing ~50 tokens/second on my M4 Max. ⚡️ It's the largest model we've ever run with Transformers.js... and we're not stopping here. Big announcement soon.

WebGPU is INSANE! 🤯 Here's a 24B parameter model running locally in a web browser, at a blazing ~50 tokens/second on my M4 Max. ⚡️ It's the largest model we've ever run with Transformers.js... and we're not stopping here. Big announcement soon.

Xenova

36,251 次观看 • 6 个月前

Okay this is insane... WebGPU-accelerated semantic video tracking, powered by DINOv3 and Transformers.js! 🤯 This will revolutionize AI-powered video editors... which can now run 100% locally in your browser, no server inference required (costs $0)! 😍 Who's building this?

Okay this is insane... WebGPU-accelerated semantic video tracking, powered by DINOv3 and Transformers.js! 🤯 This will revolutionize AI-powered video editors... which can now run 100% locally in your browser, no server inference required (costs $0)! 😍 Who's building this?

Xenova

42,934 次观看 • 1 年前

Introducing: a coding agent (Pi) running entirely in your browser using a 2B model on WebGPU 🤯 MiniCPM5-2B + Pi, powered by Transformers.js + WebGPU + 4-bit ONNX weights. All previous attempt to create this failed but MiniCPM5 seems to make it usable. Available now on Hugging Face 👇

Introducing: a coding agent (Pi) running entirely in your browser using a 2B model on WebGPU 🤯 MiniCPM5-2B + Pi, powered by Transformers.js + WebGPU + 4-bit ONNX weights. All previous attempt to create this failed but MiniCPM5 seems to make it usable. Available now on Hugging Face 👇

Victor M

89,575 次观看 • 15 天前

NEW: LiquidAI just released LFM2.5-350M, a tiny model that brings agentic AI and tool-calling capabilities to resource-constrained environments. 🤯 It can even run locally in your browser via WebGPU, serving as a powerful companion while you browse the web. Try the demo! 👇

NEW: LiquidAI just released LFM2.5-350M, a tiny model that brings agentic AI and tool-calling capabilities to resource-constrained environments. 🤯 It can even run locally in your browser via WebGPU, serving as a powerful companion while you browse the web. Try the demo! 👇

Xenova

26,267 次观看 • 6 个月前

I seriously cannot believe this is a 0.6B LLM! 🤯 Qwen just released Qwen3, a series of hybrid reasoning models that allow you to control how much "thinking" the model does for a given task. They can even run locally in your browser on WebGPU with 🤗 Transformers.js!

I seriously cannot believe this is a 0.6B LLM! 🤯 Qwen just released Qwen3, a series of hybrid reasoning models that allow you to control how much "thinking" the model does for a given task. They can even run locally in your browser on WebGPU with 🤗 Transformers.js!

Xenova

74,954 次观看 • 1 年前

The era of 1-bit LLMs is here — now with WebGPU acceleration! 🤯 It's incredible to think that a quantized 1.7B model (just 290MB in size) can run at ~100 tokens per second entirely in your browser. Try the demo yourself 👇

The era of 1-bit LLMs is here — now with WebGPU acceleration! 🤯 It's incredible to think that a quantized 1.7B model (just 290MB in size) can run at ~100 tokens per second entirely in your browser. Try the demo yourself 👇

Xenova

105,543 次观看 • 5 个月前

Jev isn't multimodal... but do you know what is? CLIP. A zero-shot multimodal classifier released nearly *6* years ago. Search 25,000 images in <50ms (no image labeling required). It can even run locally in your browser on WebGPU, powered by Transformers.js! Try it yourself 👇

Jev isn't multimodal... but do you know what is? CLIP. A zero-shot multimodal classifier released nearly 6 years ago. Search 25,000 images in <50ms (no image labeling required). It can even run locally in your browser on WebGPU, powered by Transformers.js! Try it yourself 👇

Xenova

32,958 次观看 • 8 天前

NEW: Alibaba just released Qwen 3.5 Small — a family of powerful multimodal models available in a range of sizes (0.8B, 2B, 4B, and 9B parameters). Perfect for on-device applications! They can even run 100% locally in your browser on WebGPU, powered by Transformers.js! 🤯

NEW: Alibaba just released Qwen 3.5 Small — a family of powerful multimodal models available in a range of sizes (0.8B, 2B, 4B, and 9B parameters). Perfect for on-device applications! They can even run 100% locally in your browser on WebGPU, powered by Transformers.js! 🤯

Xenova

102,592 次观看 • 7 个月前

Introducing Voxtral WebGPU: Real-time speech transcription entirely in your browser. This demo runs Voxtral-Mini-4B, a powerful streaming ASR model from Mistral AI, locally on WebGPU. The model supports 13 languages and is capable of <500 ms latency. Fully private. Zero cost.

Introducing Voxtral WebGPU: Real-time speech transcription entirely in your browser. This demo runs Voxtral-Mini-4B, a powerful streaming ASR model from Mistral AI, locally on WebGPU. The model supports 13 languages and is capable of <500 ms latency. Fully private. Zero cost.

Xenova

94,623 次观看 • 6 个月前

OmniParser, the new screen parsing tool from Microsoft (and #1 trending model on Hugging Face), can now run 100% locally in your browser with Transformers.js! 🤯 Who's going to be the first to turn this into a browser extension? 👀 Endless possibilities! Demo & code below! 👇

OmniParser, the new screen parsing tool from Microsoft (and #1 trending model on Hugging Face), can now run 100% locally in your browser with Transformers.js! 🤯 Who's going to be the first to turn this into a browser extension? 👀 Endless possibilities! Demo & code below! 👇

Xenova

64,560 次观看 • 1 年前

Not enough people are talking about NVIDIA's new Nemotron-3-Nano (4B) model! 🤯 Hybrid Mamba + Attention architecture, designed as a unified model for reasoning and non-reasoning tasks. So small and efficient, it can run 100% locally in your web browser at 75 tokens per second.

Not enough people are talking about NVIDIA's new Nemotron-3-Nano (4B) model! 🤯 Hybrid Mamba + Attention architecture, designed as a unified model for reasoning and non-reasoning tasks. So small and efficient, it can run 100% locally in your web browser at 75 tokens per second.

Xenova

50,063 次观看 • 6 个月前

Operating System powered by Qwen 3.8 27B at 1950 tokens/sec! here is what 1,950 tokens/second Qwen's 3.8 27b actually looks like on Cerebras: i wrote a minimal python web server that turns cerebras inference into a live operating system. zero apps on disk. when you double click an icon: 1) python proxies a raw SSE stream from qwen 27b at 1,950 tok/s 2) calculator compiles & mounts in 11s 3) full canvas paint studio with brush engine compiles in 10s. at 2,000 tokens/second, software is just an on demand hallucination that runs instantly. the model weights ARE the operating system runtime. what else would you build at 1,950 tokens/second?

Operating System powered by Qwen 3.8 27B at 1950 tokens/sec! here is what 1,950 tokens/second Qwen's 3.8 27b actually looks like on Cerebras: i wrote a minimal python web server that turns cerebras inference into a live operating system. zero apps on disk. when you double click an icon: 1) python proxies a raw SSE stream from qwen 27b at 1,950 tok/s 2) calculator compiles & mounts in 11s 3) full canvas paint studio with brush engine compiles in 10s. at 2,000 tokens/second, software is just an on demand hallucination that runs instantly. the model weights ARE the operating system runtime. what else would you build at 1,950 tokens/second?

Alok

450,354 次观看 • 17 天前

Last week I spent $20,000 on Mac Studios so I could run OpenClaw locally Fully powered by local AI models running 24/7 Now my agent: • Is doing tasks 24/7/365 • Doesn't cost any tokens • Is fully private In this video I cover how it works and how you can do the same thing:

Last week I spent $20,000 on Mac Studios so I could run OpenClaw locally Fully powered by local AI models running 24/7 Now my agent: • Is doing tasks 24/7/365 • Doesn't cost any tokens • Is fully private In this video I cover how it works and how you can do the same thing:

Alex Finn

574,062 次观看 • 7 个月前

RealBriefly has officially released! Decentralized media is now live on the XRP Ledger! A new era in digital media on the XRP Ledger focused on global content, covering markets, events, news, and real-time information from around the world. Write, publish, get paid (in $REAL tokens). You can now earn directly on the XRP Ledger through decentralized media. Publish articles and discussions and receive payments in REAL tokens per post. This movement is powered by the RealFi payment solution and the Real Token. Sign up at and start getting paid today!

RealBriefly has officially released! Decentralized media is now live on the XRP Ledger! A new era in digital media on the XRP Ledger focused on global content, covering markets, events, news, and real-time information from around the world. Write, publish, get paid (in $REAL tokens). You can now earn directly on the XRP Ledger through decentralized media. Publish articles and discussions and receive payments in REAL tokens per post. This movement is powered by the RealFi payment solution and the Real Token. Sign up at and start getting paid today!

Real Briefly

97,894 次观看 • 5 个月前

turned this into a web app you can use with your own obsidian vault! no install, just one html file: point it at your notes folder, it embeds everything with gemini, clusters by meaning, and renders the 3d network in your browser. available now for x/twitter subscribers <3

turned this into a web app you can use with your own obsidian vault! no install, just one html file: point it at your notes folder, it embeds everything with gemini, clusters by meaning, and renders the 3d network in your browser. available now for x/twitter subscribers <3

Kat ⊷ the Poet Engineer

106,855 次观看 • 7 个月前

You can now use OpenAIReview directly in your browser 📷. This is a part of our mission to make quality AI-assisted reviewing open and accessible to everyone. Reviews on the web version are free of charge, and you can get up to 3 reviews a day. Try it here!

You can now use OpenAIReview directly in your browser 📷. This is a part of our mission to make quality AI-assisted reviewing open and accessible to everyone. Reviews on the web version are free of charge, and you can get up to 3 reviews a day. Try it here!

Chenhao Tan

46,166 次观看 • 6 个月前