Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

I'm obsessed with pushing local small models to their limits. Qwen3.5:0.8b doing real-time video captioning on a Mac Studio M2 Ultra, streaming descriptions as the video plays. Under 1s per frame — 269 frames captured & described from a 3m49s video. Pause anywhere and read the captions, it describes...

stevibe's profile picture

stevibe

27,081 subscribers

106,441 Aufrufe • vor 3 Monaten •via X (Twitter)

Wissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Real-time video captioning in your browser with @LiquidAI's LFM2-VL model on WebGPU. Sending every frame to a server was never going to be the answer. Imagine the bandwidth, latency and cost. Local inference. No server costs. Infinitely scalable. This is the way.
0:45

Real-time video captioning in your browser with @LiquidAI's LFM2-VL model on WebGPU. Sending every frame to a server was never going to be the answer. Imagine the bandwidth, latency and cost. Local inference. No server costs. Infinitely scalable. This is the way.

Xenova

48,682 Aufrufe • vor 3 Monaten

Qwen3.5-35B-A3B running locally on an M4 chip at 49.5 tokens per second. A 35B model. On a laptop. In real time. LOCAL AI IS GETTING SCARY FAST.
1:10

Qwen3.5-35B-A3B running locally on an M4 chip at 49.5 tokens per second. A 35B model. On a laptop. In real time. LOCAL AI IS GETTING SCARY FAST.

0xMarioNawfal

478,007 Aufrufe • vor 4 Monaten

Qwen3.5:9b reasoning head-to-head: Mac Studio M2 Ultra 64GB: 43.08 tok/s Mac Mini M4 16GB: 13.07 tok/s Qwen
1:18

Qwen3.5:9b reasoning head-to-head: Mac Studio M2 Ultra 64GB: 43.08 tok/s Mac Mini M4 16GB: 13.07 tok/s Qwen

stevibe

243,239 Aufrufe • vor 4 Monaten

Update: Qwen3.5:9b head-to-head (MLX, Apple Silicon optimized) Mac Studio M2 Ultra: 89.74 tok/s Mac Mini M4: 20.82 tok/s MLX basically doubles the speed on both machines.
1:02

Update: Qwen3.5:9b head-to-head (MLX, Apple Silicon optimized) Mac Studio M2 Ultra: 89.74 tok/s Mac Mini M4: 20.82 tok/s MLX basically doubles the speed on both machines.

stevibe

134,256 Aufrufe • vor 4 Monaten

A breakthrough in real-time video generation. As a research preview developed with NVIDIA and shared at NVIDIAGTC this week, we trained a new real-time video model running on Vera Rubin. HD videos generate instantly, with time-to-first-frame under 100ms. Unlocking an entirely new creative paradigm and bolstering the foundations of our General World Model, GWM-1. Real-time generation opens a fundamentally different design space for video models and world simulation. We're investing in co-designing our models alongside advances in hardware to keep pushing this frontier.
0:54

A breakthrough in real-time video generation. As a research preview developed with NVIDIA and shared at NVIDIAGTC this week, we trained a new real-time video model running on Vera Rubin. HD videos generate instantly, with time-to-first-frame under 100ms. Unlocking an entirely new creative paradigm and bolstering the foundations of our General World Model, GWM-1. Real-time generation opens a fundamentally different design space for video models and world simulation. We're investing in co-designing our models alongside advances in hardware to keep pushing this frontier.

Runway

1,161,699 Aufrufe • vor 3 Monaten

SOMEONE VIBE CODED A VIDEO STREAM THAT IS SECRETLY 100% TEXT SO IT CANT BE BLOCKED it plays 360p video at 30fps, but theres no actual video on the page. every frame is just colored text characters being repainted on a canvas to the browser its not media at all, its javascript updating some text its called asciline, and here's the trick: > the server decodes the real video and streams it as binary packed text over websockets > the browser paints thousands of colored block characters fast enough to look like 360p > ad blockers and autoplay blockers cant catch it because theres no video element to catch > it streams in kilobytes since its just strings, so it runs on trash internet since the video is literally text, you can apply css glows to it, let people copy paste a moving frame, or feed it straight to a local llm however, an unblockable stream is also an unblockable ad as well
0:32

SOMEONE VIBE CODED A VIDEO STREAM THAT IS SECRETLY 100% TEXT SO IT CANT BE BLOCKED it plays 360p video at 30fps, but theres no actual video on the page. every frame is just colored text characters being repainted on a canvas to the browser its not media at all, its javascript updating some text its called asciline, and here's the trick: > the server decodes the real video and streams it as binary packed text over websockets > the browser paints thousands of colored block characters fast enough to look like 360p > ad blockers and autoplay blockers cant catch it because theres no video element to catch > it streams in kilobytes since its just strings, so it runs on trash internet since the video is literally text, you can apply css glows to it, let people copy paste a moving frame, or feed it straight to a local llm however, an unblockable stream is also an unblockable ad as well

Om Patel

1,852,905 Aufrufe • vor 26 Tagen

Today we announced RTFM (Real-Time Frame Model) — a world model that generates frames in real time from any camera viewpoint. Unlike standard video models, RTFM understands 3D geometry. You can literally move the camera through the generated world. 🎥👇
2:21

Today we announced RTFM (Real-Time Frame Model) — a world model that generates frames in real time from any camera viewpoint. Unlike standard video models, RTFM understands 3D geometry. You can literally move the camera through the generated world. 🎥👇

Keunhong Park

15,762 Aufrufe • vor 8 Monaten

Runway has unveiled a massive breakthrough in AI video generation at NVIDIA's GTC event, showcasing a new model capable of generating high-definition video in genuine real-time. The new model boasts a "time-to-first-frame" of under 100 milliseconds. This means HD video begins generating and playing almost the instant a command is given. This research preview was co-developed with NVIDIA and runs on their newly announced Vera Rubin architecture. This real-time capability is a foundational step for Runway's General World Model (GWM-1). It pushes the technology beyond simple video generation and into the realm of live, interactive environments.
0:54

Runway has unveiled a massive breakthrough in AI video generation at NVIDIA's GTC event, showcasing a new model capable of generating high-definition video in genuine real-time. The new model boasts a "time-to-first-frame" of under 100 milliseconds. This means HD video begins generating and playing almost the instant a command is given. This research preview was co-developed with NVIDIA and runs on their newly announced Vera Rubin architecture. This real-time capability is a foundational step for Runway's General World Model (GWM-1). It pushes the technology beyond simple video generation and into the realm of live, interactive environments.

Wes Roth

82,506 Aufrufe • vor 3 Monaten

Unbelievable! This is a real video captured on a Houston highway! An SUV was towing a sedan with a chain – at highway speeds. The sedan is seen wildly swerving and barely under control. Read more at
0:42

Unbelievable! This is a real video captured on a Houston highway! An SUV was towing a sedan with a chain – at highway speeds. The sedan is seen wildly swerving and barely under control. Read more at

ABC7 Eyewitness News

127,134 Aufrufe • vor 1 Jahr

This is "Whisper.cpp" a local lightweight AI model that can be run on mobile phones to convert speech to text with real time streaming
0:30

This is "Whisper.cpp" a local lightweight AI model that can be run on mobile phones to convert speech to text with real time streaming

Abdelhamed M.

143,177 Aufrufe • vor 1 Jahr

🥳We’re releasing StreamDiffusionV2 for the live-stream community—from individual creators with one GPU to enterprise platforms with many. StreamDiffusionV2 is our follow-up to StreamDiffusion: #StreamDiffusion powered real products, but temporal consistency still bugged us. We’re fixing that for the community: 🤔Efficiency ≠ live-readiness: many “real-time” video diffusion models are fast, but live streaming demands per-frame deadlines with low jitter. StreamDiffusionV2 balances temporal stability with strict per-frame deadlines, achieves fast interaction, and is ready for your AI Youtuber Stream Live👇 📒Project page: 💻Code:
2:22

🥳We’re releasing StreamDiffusionV2 for the live-stream community—from individual creators with one GPU to enterprise platforms with many. StreamDiffusionV2 is our follow-up to StreamDiffusion: #StreamDiffusion powered real products, but temporal consistency still bugged us. We’re fixing that for the community: 🤔Efficiency ≠ live-readiness: many “real-time” video diffusion models are fast, but live streaming demands per-frame deadlines with low jitter. StreamDiffusionV2 balances temporal stability with strict per-frame deadlines, achieves fast interaction, and is ready for your AI Youtuber Stream Live👇 📒Project page: 💻Code:

Chenfeng_X

20,176 Aufrufe • vor 9 Monaten

Do you see what's happening? Local AI is getting smarter. It's Opus 4.5 level Hardware that hosts those models are flying off the shelf Your window to host local models is shrinking In this video I cover EVERYTHING local AI models and how to host your own, even on Mac Minis:
21:26

Do you see what's happening? Local AI is getting smarter. It's Opus 4.5 level Hardware that hosts those models are flying off the shelf Your window to host local models is shrinking In this video I cover EVERYTHING local AI models and how to host your own, even on Mac Minis:

Alex Finn

55,253 Aufrufe • vor 3 Monaten

Introducing RTFM (Real-Time Frame Model): a highly efficient World Model that generates video frames in real time as you interact with it, powered by a single H100 GPU. RTFM renders persistent and 3D consistent worlds, both real and imaginary. Try our demo of RTFM today!
2:21

Introducing RTFM (Real-Time Frame Model): a highly efficient World Model that generates video frames in real time as you interact with it, powered by a single H100 GPU. RTFM renders persistent and 3D consistent worlds, both real and imaginary. Try our demo of RTFM today!

World Labs

340,567 Aufrufe • vor 8 Monaten

local LLMs on Mac are getting good. but the workflow around models is still messy. you have models in: •⁠ ⁠LM Studio •⁠ ⁠Ollama •⁠ ⁠Hugging Face cache •⁠ ⁠random folders •⁠ ⁠manual downloads and every runtime expects something slightly different. we built ModelHub to clean up this layer. it’s a native macOS menu bar app for discovering, downloading, and managing local LLMs. not a replacement for Ollama, oMLX or LM Studio. it sits beside them. Ollama = run models MLX = Apple Silicon acceleration LM Studio = local model workspace Hugging Face = model ecosystem ModelHub = model discovery + management layer we’re live on Product Hunt today. would love feedback from people running local models on Mac.
1:39

local LLMs on Mac are getting good. but the workflow around models is still messy. you have models in: •⁠ ⁠LM Studio •⁠ ⁠Ollama •⁠ ⁠Hugging Face cache •⁠ ⁠random folders •⁠ ⁠manual downloads and every runtime expects something slightly different. we built ModelHub to clean up this layer. it’s a native macOS menu bar app for discovering, downloading, and managing local LLMs. not a replacement for Ollama, oMLX or LM Studio. it sits beside them. Ollama = run models MLX = Apple Silicon acceleration LM Studio = local model workspace Hugging Face = model ecosystem ModelHub = model discovery + management layer we’re live on Product Hunt today. would love feedback from people running local models on Mac.

sabesh 📟

31,497 Aufrufe • vor 1 Monat

So Runway Aleph 2.0 just dropped, and it introduces a pretty interesting workflow for AI video footage editing. Rather than repeatedly prompting a video model and hoping it makes the change you want, you can edit a specific frame first, then use that frame to guide the video generation. For this test, I take an existing footage inside Runway: • Picked a frame from the original video • Used Nano Banana Pro to add a new effect/object • Brought that frame into Aleph 2.0 to generate the updated video It feels like a more controllable and potentially cheaper way to make targeted edits to existing footage than current AI video omni models available like Seedance and Gemini.
2:59

So Runway Aleph 2.0 just dropped, and it introduces a pretty interesting workflow for AI video footage editing. Rather than repeatedly prompting a video model and hoping it makes the change you want, you can edit a specific frame first, then use that frame to guide the video generation. For this test, I take an existing footage inside Runway: • Picked a frame from the original video • Used Nano Banana Pro to add a new effect/object • Brought that frame into Aleph 2.0 to generate the updated video It feels like a more controllable and potentially cheaper way to make targeted edits to existing footage than current AI video omni models available like Seedance and Gemini.

Curious Refuge

11,332 Aufrufe • vor 25 Tagen

I slowed it down frame by frame! Benjamin Netanyahu’s ring seems to just disappear while he is moving his hand 😳 This is 100% real footage that I screen-recorded directly from the video he posted today. Starting to freak me out… Analyze this Grok and tell us if it is AI
0:23

I slowed it down frame by frame! Benjamin Netanyahu’s ring seems to just disappear while he is moving his hand 😳 This is 100% real footage that I screen-recorded directly from the video he posted today. Starting to freak me out… Analyze this Grok and tell us if it is AI

Matt Wallace

596,019 Aufrufe • vor 3 Monaten

Took it further with Omma AI, (Spline ) now it works on video, and everything working in a Web Browser. Drop a video, Depth Anything v2 calculates the depth map frame by frame, and Three.js renders a fully lit 3D mesh in real time. Depth estimation on video in the browser +Automatic baking pass + Dynamic lighting reacting to the geometry #vibecoding #threejs #webgl
0:40

Took it further with Omma AI, (Spline ) now it works on video, and everything working in a Web Browser. Drop a video, Depth Anything v2 calculates the depth map frame by frame, and Three.js renders a fully lit 3D mesh in real time. Depth estimation on video in the browser +Automatic baking pass + Dynamic lighting reacting to the geometry #vibecoding #threejs #webgl

Joseph Azar

147,333 Aufrufe • vor 2 Monaten

GPT-4V + TTS = AI Sports narrator 🪄⚽️ Passed every frame of a football video to gpt-4-vision-preview, and with some simple prompting asked to generate a narration No edits, this is as it came out from the model (aka can be SO MUCH BETTER)
0:27

GPT-4V + TTS = AI Sports narrator 🪄⚽️ Passed every frame of a football video to gpt-4-vision-preview, and with some simple prompting asked to generate a narration No edits, this is as it came out from the model (aka can be SO MUCH BETTER)

Gonzalo

2,665,026 Aufrufe • vor 2 Jahren

Consistent character with Hunyuan and Skyreel! 🎥✨ In collaboration with Kartel.ai .ai, we worked on a pipeline using ComfyUI with the Hunyuan & Skyreel models—both designed for video. We first captured him volumetrically, then trained a LoRA model directly on video data, allowing us to generate sequences where a person remains consistent across shots. The goal is to maintain identity and style over time, pushing the limits of AI-generated video. Excited to explore this further! 🔥 with J. Salvatore in main actor , thank you ! #AI #GenAI #ComfyUI #LoRA #VideoGeneration #Hunyuan #Skyreel
1:28

Consistent character with Hunyuan and Skyreel! 🎥✨ In collaboration with Kartel.ai .ai, we worked on a pipeline using ComfyUI with the Hunyuan & Skyreel models—both designed for video. We first captured him volumetrically, then trained a LoRA model directly on video data, allowing us to generate sequences where a person remains consistent across shots. The goal is to maintain identity and style over time, pushing the limits of AI-generated video. Excited to explore this further! 🔥 with J. Salvatore in main actor , thank you ! #AI #GenAI #ComfyUI #LoRA #VideoGeneration #Hunyuan #Skyreel

Lovis Odin

13,348 Aufrufe • vor 1 Jahr

Introducing AI video you can watch and interact with, in real-time! Powering this is a new world model that imagines and streams video frames every 40ms(!). No game engine in sight. We call it interactive video, and it's free for anyone to try right now (GPUs permitting)!
0:32

Introducing AI video you can watch and interact with, in real-time! Powering this is a new world model that imagines and streams video frames every 40ms(!). No game engine in sight. We call it interactive video, and it's free for anyone to try right now (GPUs permitting)!

Odyssey

704,482 Aufrufe • vor 1 Jahr