Загрузка видео...

Не удалось загрузить видео

На главную

What if psql had an \ai command? This is PGlite (WASM Postgres) and Llama3 (via WebLLM & WebGPU) running completely in the browser - no cloud, no server🤯 Local AI is coming sooner than you think!

samwillis's profile picture

Sam Willis

3,693 subscribers

21,660 просмотров • 2 лет назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

With PGlite + Electric sync you can build an issue tracker handling 100k issues + 500k comments, synced from Postgres to PGlite in the browser! Super fast UI updates with all writes going though the local database, and Postgres FTS in PGlite for search 🔥
1:13

With PGlite + Electric sync you can build an issue tracker handling 100k issues + 500k comments, synced from Postgres to PGlite in the browser! Super fast UI updates with all writes going though the local database, and Postgres FTS in PGlite for search 🔥

Sam Willis

55,412 просмотров • 1 год назад

Gemma 2 2B running in a browser, powered by WebLLM & WebGPU! 🔥 100% local & on-device In less than 24 hours, we've already got the model to the edge! ⚡ Try it out on an HF space below:
1:31

Gemma 2 2B running in a browser, powered by WebLLM & WebGPU! 🔥 100% local & on-device In less than 24 hours, we've already got the model to the edge! ⚡ Try it out on an HF space below:

Vaibhav (VB) Srivastav

53,790 просмотров • 1 год назад

⚡Technical Showcase: Peer-to-peer GPU sharing, entirely in the browser. AI Grid lets you run LLMs locally with WebGPU and either donate your spare compute to the network or borrow from someone else's machine. No installs, no cloud. Decentralized inference with nothing but a URL. 🔗 #WebGPU #WebLLM #WebAI #DistributedCompute #ArtificialInteligence
1:00

⚡Technical Showcase: Peer-to-peer GPU sharing, entirely in the browser. AI Grid lets you run LLMs locally with WebGPU and either donate your spare compute to the network or borrow from someone else's machine. No installs, no cloud. Decentralized inference with nothing but a URL. 🔗 #WebGPU #WebLLM #WebAI #DistributedCompute #ArtificialInteligence

WebGL / WebGPU

17,157 просмотров • 5 месяцев назад

Is this the future of AI browser agents? 👀 WebGPU-accelerated reasoning LLMs are now supported in Transformers.js! 🤯 Here's MiniThinky-v2 (1B) running 100% locally in the browser at ~60 tps (no API calls)! I can't wait to see what you build with it! Demo + source code in 🧵👇
0:22

Is this the future of AI browser agents? 👀 WebGPU-accelerated reasoning LLMs are now supported in Transformers.js! 🤯 Here's MiniThinky-v2 (1B) running 100% locally in the browser at ~60 tps (no API calls)! I can't wait to see what you build with it! Demo + source code in 🧵👇

Xenova

81,346 просмотров • 1 год назад

Okay this is insane... WebGPU-accelerated semantic video tracking, powered by DINOv3 and Transformers.js! 🤯 This will revolutionize AI-powered video editors... which can now run 100% locally in your browser, no server inference required (costs $0)! 😍 Who's building this?
0:22

Okay this is insane... WebGPU-accelerated semantic video tracking, powered by DINOv3 and Transformers.js! 🤯 This will revolutionize AI-powered video editors... which can now run 100% locally in your browser, no server inference required (costs $0)! 😍 Who's building this?

Xenova

42,882 просмотров • 10 месяцев назад

I don't think people realize how versatile WebGPU is! 🤯 In this demo, *both* the semantic search model and Earth shaders are running on WebGPU (via Transformers.js and Three.js, respectively). Pretty insane.
0:30

I don't think people realize how versatile WebGPU is! 🤯 In this demo, *both* the semantic search model and Earth shaders are running on WebGPU (via Transformers.js and Three.js, respectively). Pretty insane.

Xenova

18,317 просмотров • 3 месяцев назад

Numbers in! Target: 150 tok/s browser-native Qwen 3.5 inference Achieved: 180 tok/s — Qwen 3.5 INT4, WebGPU, browser-only. No cloud, APIs, servers, just Pure WebGPU + WGSL optimizations, HF SafeTensors, single browser tab. Open AI, for real.
0:57

Numbers in! Target: 150 tok/s browser-native Qwen 3.5 inference Achieved: 180 tok/s — Qwen 3.5 INT4, WebGPU, browser-only. No cloud, APIs, servers, just Pure WebGPU + WGSL optimizations, HF SafeTensors, single browser tab. Open AI, for real.

Eric

256,656 просмотров • 4 месяцев назад

Real-time video captioning in your browser with @LiquidAI's LFM2-VL model on WebGPU. Sending every frame to a server was never going to be the answer. Imagine the bandwidth, latency and cost. Local inference. No server costs. Infinitely scalable. This is the way.
0:45

Real-time video captioning in your browser with @LiquidAI's LFM2-VL model on WebGPU. Sending every frame to a server was never going to be the answer. Imagine the bandwidth, latency and cost. Local inference. No server costs. Infinitely scalable. This is the way.

Xenova

48,751 просмотров • 4 месяцев назад

Postgres running natively in Bolt 🔥 Great work by ElectricSQL team & pglite- this is huge!! Y’all won’t need to spin up hosted databases for building soon… 👀
0:26

Postgres running natively in Bolt 🔥 Great work by ElectricSQL team & pglite- this is huge!! Y’all won’t need to spin up hosted databases for building soon… 👀

Eric Simons

19,891 просмотров • 1 год назад

Most AI agents force you into a new browser. Meet Composite, it isn't just a hosted browser session in the cloud, or a completely separate browser. Composite actually does the clicking, typing, and navigation inside your real tabs, in your existing browser. - Uses your existing browser, so there’s no migration, you keep your bookmarks, extensions, workflows - No lock-in. It works with any site, any AI model, you’re in control. - Composite does the clicks, types, and navigation for you. In your tabs. No migration. No lock-in. No learning curve. Download and start now:
0:39

Most AI agents force you into a new browser. Meet Composite, it isn't just a hosted browser session in the cloud, or a completely separate browser. Composite actually does the clicking, typing, and navigation inside your real tabs, in your existing browser. - Uses your existing browser, so there’s no migration, you keep your bookmarks, extensions, workflows - No lock-in. It works with any site, any AI model, you’re in control. - Composite does the clicks, types, and navigation for you. In your tabs. No migration. No lock-in. No learning curve. Download and start now:

The AI Colony

48,585 просмотров • 11 месяцев назад

OSINT + AI 🧠 Vyntral's God’s Eye integrates local AI via Ollama for vuln analysis and reporting. No cloud. No APIs. Fully private. Free. AI is becoming a default layer in open source tooling, not a premium feature. Try it here:
0:35

OSINT + AI 🧠 Vyntral's God’s Eye integrates local AI via Ollama for vuln analysis and reporting. No cloud. No APIs. Fully private. Free. AI is becoming a default layer in open source tooling, not a premium feature. Try it here:

The OSINT Newsletter

53,194 просмотров • 5 месяцев назад

Introducing Voxtral WebGPU: State-of-the-art audio transcription directly in your browser! 🤯 🗣️ Transcribe videos, meeting notes, songs and more 🔐 Runs on-device, meaning no data is sent to a server 🌎 Multilingual (8 languages) 🤗 Completely free (forever) & open source
0:45

Introducing Voxtral WebGPU: State-of-the-art audio transcription directly in your browser! 🤯 🗣️ Transcribe videos, meeting notes, songs and more 🔐 Runs on-device, meaning no data is sent to a server 🌎 Multilingual (8 languages) 🤗 Completely free (forever) & open source

Xenova

19,969 просмотров • 11 месяцев назад

i didn't think this was actually possible. just built an iOS app fully in Replit ⠕ 🤯 the idea is anti-ai instagram only can post via camera no uploads. no filter. no video. just raw photos.
0:43

i didn't think this was actually possible. just built an iOS app fully in Replit ⠕ 🤯 the idea is anti-ai instagram only can post via camera no uploads. no filter. no video. just raw photos.

MakerThrive

15,387 просмотров • 1 месяц назад

Introducing Moonshine Web: real-time speech recognition running 100% locally in your browser! 🚀 Faster and more accurate than Whisper 🔒 Privacy-focused (no data leaves your device) ⚡️ WebGPU accelerated (w/ WASM fallback) 🔥 Powered by ONNX Runtime Web and Transformers.js
0:40

Introducing Moonshine Web: real-time speech recognition running 100% locally in your browser! 🚀 Faster and more accurate than Whisper 🔒 Privacy-focused (no data leaves your device) ⚡️ WebGPU accelerated (w/ WASM fallback) 🔥 Powered by ONNX Runtime Web and Transformers.js

Xenova

27,878 просмотров • 1 год назад

🚨 Claude Code just got REPLACED overnight… for $0 An open-source project is now running a 122B model locally on your MacBook 🤯 No API fees. No cloud. No limits. Just raw power on your own machine. 1 command install. Double-click to launch. If this works at scale… it’s game over for paid AI tools. GitHub ↓
0:34

🚨 Claude Code just got REPLACED overnight… for $0 An open-source project is now running a 122B model locally on your MacBook 🤯 No API fees. No cloud. No limits. Just raw power on your own machine. 1 command install. Double-click to launch. If this works at scale… it’s game over for paid AI tools. GitHub ↓

Shruti Codes

40,704 просмотров • 3 месяцев назад

There is no competition. Only evolution. We're coming sooner than you think. Sign up now for early access and be the first in the game. 🔗
1:16

There is no competition. Only evolution. We're coming sooner than you think. Sign up now for early access and be the first in the game. 🔗

Basketball.fun

55,849 просмотров • 9 месяцев назад

Qwen 3.6 35B running at over 100 tokens per second on my $5,399 MacBook Pro M5 Max. This is the best local AI model I have ever run. 128GB of unified memory. No cloud. No API costs. No rate limits. Just raw local inference at speeds I didn't think were possible on a laptop. This model is more intelligent than GPT 5 on benchmarks. Running locally. On a MacBook. For free after the hardware cost. I said local AI would never compete with frontier. I'm starting to rethink that. The gap is closing faster than anyone expected.
1:04

Qwen 3.6 35B running at over 100 tokens per second on my $5,399 MacBook Pro M5 Max. This is the best local AI model I have ever run. 128GB of unified memory. No cloud. No API costs. No rate limits. Just raw local inference at speeds I didn't think were possible on a laptop. This model is more intelligent than GPT 5 on benchmarks. Running locally. On a MacBook. For free after the hardware cost. I said local AI would never compete with frontier. I'm starting to rethink that. The gap is closing faster than anyone expected.

BridgeMind

62,800 просмотров • 1 месяц назад

Fully local Code Assistant running on NVIDIA GPU! In this tutorial, I'll show you how to run Llama3 using TensorRT and Nvidia's Triton Inference Server to use it as a Code Assistant in VSCode In this thread 🧵, I'll walk you through the integration process, explaining each step simply and clearly 👇 NVIDIA AI NVIDIA AIDev AI at Meta
0:30

Fully local Code Assistant running on NVIDIA GPU! In this tutorial, I'll show you how to run Llama3 using TensorRT and Nvidia's Triton Inference Server to use it as a Code Assistant in VSCode In this thread 🧵, I'll walk you through the integration process, explaining each step simply and clearly 👇 NVIDIA AI NVIDIA AIDev AI at Meta

Daniel San

42,154 просмотров • 2 лет назад

Barack Obama says AI is not hype and is coming faster than you think.
0:43

Barack Obama says AI is not hype and is coming faster than you think.

Kol Tregaskes

21,510 просмотров • 1 год назад

i spent the afternoon experimenting with Gemma 4's vision capabilities made an app that uses roboflow RF-DETR for a first pass of object detections and Gemma to summarize the scene in one sentence for fun i asked Gemma to "describe what you see as if you were a medieval bard" all made with free local AI models (running via webgpu in the browser thanks to transformers js) lots more possibilities to explore with this
0:28

i spent the afternoon experimenting with Gemma 4's vision capabilities made an app that uses roboflow RF-DETR for a first pass of object detections and Gemma to summarize the scene in one sentence for fun i asked Gemma to "describe what you see as if you were a medieval bard" all made with free local AI models (running via webgpu in the browser thanks to transformers js) lots more possibilities to explore with this

AA

700,459 просмотров • 3 месяцев назад