正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

What if psql had an \ai command? This is PGlite (WASM Postgres) and Llama3 (via WebLLM & WebGPU) running completely in the browser - no cloud, no server🤯 Local AI is coming sooner than you think!

Sam Willis

3,693 subscribers

21,660 次观看 • 2 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Gemma 2 2B running in a browser, powered by WebLLM & WebGPU! 🔥 100% local & on-device In less than 24 hours, we've already got the model to the edge! ⚡ Try it out on an HF space below:

Gemma 2 2B running in a browser, powered by WebLLM & WebGPU! 🔥 100% local & on-device In less than 24 hours, we've already got the model to the edge! ⚡ Try it out on an HF space below:

Vaibhav (VB) Srivastav

53,790 次观看 • 1 年前

⚡Technical Showcase: Peer-to-peer GPU sharing, entirely in the browser. AI Grid lets you run LLMs locally with WebGPU and either donate your spare compute to the network or borrow from someone else's machine. No installs, no cloud. Decentralized inference with nothing but a URL. 🔗 #WebGPU #WebLLM #WebAI #DistributedCompute #ArtificialInteligence

⚡Technical Showcase: Peer-to-peer GPU sharing, entirely in the browser. AI Grid lets you run LLMs locally with WebGPU and either donate your spare compute to the network or borrow from someone else's machine. No installs, no cloud. Decentralized inference with nothing but a URL. 🔗 #WebGPU #WebLLM #WebAI #DistributedCompute #ArtificialInteligence

WebGL / WebGPU

17,157 次观看 • 5 个月前

Is this the future of AI browser agents? 👀 WebGPU-accelerated reasoning LLMs are now supported in Transformers.js! 🤯 Here's MiniThinky-v2 (1B) running 100% locally in the browser at ~60 tps (no API calls)! I can't wait to see what you build with it! Demo + source code in 🧵👇

Is this the future of AI browser agents? 👀 WebGPU-accelerated reasoning LLMs are now supported in Transformers.js! 🤯 Here's MiniThinky-v2 (1B) running 100% locally in the browser at ~60 tps (no API calls)! I can't wait to see what you build with it! Demo + source code in 🧵👇

Xenova

81,477 次观看 • 1 年前

Okay this is insane... WebGPU-accelerated semantic video tracking, powered by DINOv3 and Transformers.js! 🤯 This will revolutionize AI-powered video editors... which can now run 100% locally in your browser, no server inference required (costs $0)! 😍 Who's building this?

Okay this is insane... WebGPU-accelerated semantic video tracking, powered by DINOv3 and Transformers.js! 🤯 This will revolutionize AI-powered video editors... which can now run 100% locally in your browser, no server inference required (costs $0)! 😍 Who's building this?

Xenova

42,882 次观看 • 11 个月前

I don't think people realize how versatile WebGPU is! 🤯 In this demo, *both* the semantic search model and Earth shaders are running on WebGPU (via Transformers.js and Three.js, respectively). Pretty insane.

I don't think people realize how versatile WebGPU is! 🤯 In this demo, both the semantic search model and Earth shaders are running on WebGPU (via Transformers.js and Three.js, respectively). Pretty insane.

Xenova

18,317 次观看 • 3 个月前

Real-time video captioning in your browser with @LiquidAI's LFM2-VL model on WebGPU. Sending every frame to a server was never going to be the answer. Imagine the bandwidth, latency and cost. Local inference. No server costs. Infinitely scalable. This is the way.

Real-time video captioning in your browser with @LiquidAI's LFM2-VL model on WebGPU. Sending every frame to a server was never going to be the answer. Imagine the bandwidth, latency and cost. Local inference. No server costs. Infinitely scalable. This is the way.

Xenova

48,751 次观看 • 4 个月前

Most AI agents force you into a new browser. Meet Composite, it isn't just a hosted browser session in the cloud, or a completely separate browser. Composite actually does the clicking, typing, and navigation inside your real tabs, in your existing browser. - Uses your existing browser, so there’s no migration, you keep your bookmarks, extensions, workflows - No lock-in. It works with any site, any AI model, you’re in control. - Composite does the clicks, types, and navigation for you. In your tabs. No migration. No lock-in. No learning curve. Download and start now:

Most AI agents force you into a new browser. Meet Composite, it isn't just a hosted browser session in the cloud, or a completely separate browser. Composite actually does the clicking, typing, and navigation inside your real tabs, in your existing browser. - Uses your existing browser, so there’s no migration, you keep your bookmarks, extensions, workflows - No lock-in. It works with any site, any AI model, you’re in control. - Composite does the clicks, types, and navigation for you. In your tabs. No migration. No lock-in. No learning curve. Download and start now:

The AI Colony

48,585 次观看 • 1 年前

OSINT + AI 🧠 Vyntral's God’s Eye integrates local AI via Ollama for vuln analysis and reporting. No cloud. No APIs. Fully private. Free. AI is becoming a default layer in open source tooling, not a premium feature. Try it here:

OSINT + AI 🧠 Vyntral's God’s Eye integrates local AI via Ollama for vuln analysis and reporting. No cloud. No APIs. Fully private. Free. AI is becoming a default layer in open source tooling, not a premium feature. Try it here:

The OSINT Newsletter

53,194 次观看 • 6 个月前

Introducing Voxtral WebGPU: State-of-the-art audio transcription directly in your browser! 🤯 🗣️ Transcribe videos, meeting notes, songs and more 🔐 Runs on-device, meaning no data is sent to a server 🌎 Multilingual (8 languages) 🤗 Completely free (forever) & open source

Introducing Voxtral WebGPU: State-of-the-art audio transcription directly in your browser! 🤯 🗣️ Transcribe videos, meeting notes, songs and more 🔐 Runs on-device, meaning no data is sent to a server 🌎 Multilingual (8 languages) 🤗 Completely free (forever) & open source

Xenova

19,969 次观看 • 1 年前

i didn't think this was actually possible. just built an iOS app fully in Replit ⠕ 🤯 the idea is anti-ai instagram only can post via camera no uploads. no filter. no video. just raw photos.

i didn't think this was actually possible. just built an iOS app fully in Replit ⠕ 🤯 the idea is anti-ai instagram only can post via camera no uploads. no filter. no video. just raw photos.

MakerThrive

15,387 次观看 • 1 个月前

🚨 Claude Code just got REPLACED overnight… for $0 An open-source project is now running a 122B model locally on your MacBook 🤯 No API fees. No cloud. No limits. Just raw power on your own machine. 1 command install. Double-click to launch. If this works at scale… it’s game over for paid AI tools. GitHub ↓

🚨 Claude Code just got REPLACED overnight… for $0 An open-source project is now running a 122B model locally on your MacBook 🤯 No API fees. No cloud. No limits. Just raw power on your own machine. 1 command install. Double-click to launch. If this works at scale… it’s game over for paid AI tools. GitHub ↓

Shruti Codes

40,704 次观看 • 3 个月前

There is no competition. Only evolution. We're coming sooner than you think. Sign up now for early access and be the first in the game. 🔗

There is no competition. Only evolution. We're coming sooner than you think. Sign up now for early access and be the first in the game. 🔗

Basketball.fun

55,858 次观看 • 9 个月前

Qwen 3.6 35B running at over 100 tokens per second on my $5,399 MacBook Pro M5 Max. This is the best local AI model I have ever run. 128GB of unified memory. No cloud. No API costs. No rate limits. Just raw local inference at speeds I didn't think were possible on a laptop. This model is more intelligent than GPT 5 on benchmarks. Running locally. On a MacBook. For free after the hardware cost. I said local AI would never compete with frontier. I'm starting to rethink that. The gap is closing faster than anyone expected.

Qwen 3.6 35B running at over 100 tokens per second on my $5,399 MacBook Pro M5 Max. This is the best local AI model I have ever run. 128GB of unified memory. No cloud. No API costs. No rate limits. Just raw local inference at speeds I didn't think were possible on a laptop. This model is more intelligent than GPT 5 on benchmarks. Running locally. On a MacBook. For free after the hardware cost. I said local AI would never compete with frontier. I'm starting to rethink that. The gap is closing faster than anyone expected.

BridgeMind

62,800 次观看 • 1 个月前

Fully local Code Assistant running on NVIDIA GPU! In this tutorial, I'll show you how to run Llama3 using TensorRT and Nvidia's Triton Inference Server to use it as a Code Assistant in VSCode In this thread 🧵, I'll walk you through the integration process, explaining each step simply and clearly 👇 NVIDIA AI NVIDIA AIDev AI at Meta

Fully local Code Assistant running on NVIDIA GPU! In this tutorial, I'll show you how to run Llama3 using TensorRT and Nvidia's Triton Inference Server to use it as a Code Assistant in VSCode In this thread 🧵, I'll walk you through the integration process, explaining each step simply and clearly 👇 NVIDIA AI NVIDIA AIDev AI at Meta

Daniel San

42,154 次观看 • 2 年前

i spent the afternoon experimenting with Gemma 4's vision capabilities made an app that uses roboflow RF-DETR for a first pass of object detections and Gemma to summarize the scene in one sentence for fun i asked Gemma to "describe what you see as if you were a medieval bard" all made with free local AI models (running via webgpu in the browser thanks to transformers js) lots more possibilities to explore with this

i spent the afternoon experimenting with Gemma 4's vision capabilities made an app that uses roboflow RF-DETR for a first pass of object detections and Gemma to summarize the scene in one sentence for fun i asked Gemma to "describe what you see as if you were a medieval bard" all made with free local AI models (running via webgpu in the browser thanks to transformers js) lots more possibilities to explore with this

AA

700,459 次观看 • 3 个月前

focused on helping people implement AIware on the Internet Computer or an ICP cloud engine (coming soon), where you spend more time in AI chat than you do in the traditional UX. This is the future.

focused on helping people implement AIware on the Internet Computer or an ICP cloud engine (coming soon), where you spend more time in AI chat than you do in the traditional UX. This is the future.

dom | icp

33,528 次观看 • 6 天前

Woah... This is the fastest Transformers.js has ever been! 🤯 Run a 1.7B LLM 100% locally in your browser at over 130 tokens per second! 🚀 No server required. ⚡️ WebGPU-accelerated in-browser inference 📦 Optimized ONNX exports w/ GQA 💬 Multi-round conversations w/ KV caching

Woah... This is the fastest Transformers.js has ever been! 🤯 Run a 1.7B LLM 100% locally in your browser at over 130 tokens per second! 🚀 No server required. ⚡️ WebGPU-accelerated in-browser inference 📦 Optimized ONNX exports w/ GQA 💬 Multi-round conversations w/ KV caching

Xenova

54,099 次观看 • 1 年前

people think running AI locally requires: → $3,000 MacBook Pro → RTX 4090 → $20/month cloud subscription nvidia just dropped a $249 computer. 67 TOPS. runs llama 3.1-8B locally. no internet. no API. no monthly fee. ever. smaller than your router. costs the same as AirPods. runs the same models you pay $240/year to access via ChatGPT. the local AI era just got a price tag. $249.

people think running AI locally requires: → $3,000 MacBook Pro → RTX 4090 → $20/month cloud subscription nvidia just dropped a $249 computer. 67 TOPS. runs llama 3.1-8B locally. no internet. no API. no monthly fee. ever. smaller than your router. costs the same as AirPods. runs the same models you pay $240/year to access via ChatGPT. the local AI era just got a price tag. $249.

self.dll

321,125 次观看 • 2 个月前

YOUR OLD ANDROID PHONE IS A FREE AI VISION SERVER AND YOU DON’T KNOW IT one dev built an app that turns any android into a local openai-compatible LLM server with vision support, analyzes camera feeds entirely on-device, no cloud, no subscriptions, nothing leaves your network you already own the hardware, it’s just sitting in a drawer full breakdown below ↓

YOUR OLD ANDROID PHONE IS A FREE AI VISION SERVER AND YOU DON’T KNOW IT one dev built an app that turns any android into a local openai-compatible LLM server with vision support, analyzes camera feeds entirely on-device, no cloud, no subscriptions, nothing leaves your network you already own the hardware, it’s just sitting in a drawer full breakdown below ↓

leopardracer

21,844 次观看 • 1 个月前

libghostty-vt compiles and runs as a standalone Wasm module (no emscripten)! Here is a demo video showing terminal key encoding in the browser. This is literally the same logic that powers Ghostty itself. It's happening! Devlog video with more details incoming. You can run this demo yourself, it's a single HTML file in the repo and the README contains a guide to set it up (one Zig command and then a web server command).

libghostty-vt compiles and runs as a standalone Wasm module (no emscripten)! Here is a demo video showing terminal key encoding in the browser. This is literally the same logic that powers Ghostty itself. It's happening! Devlog video with more details incoming. You can run this demo yourself, it's a single HTML file in the repo and the README contains a guide to set it up (one Zig command and then a web server command).

Mitchell Hashimoto

30,543 次观看 • 8 个月前