Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Introducing Whisper Timestamped: Multilingual speech recognition with word-level timestamps, running 100% locally in your browser thanks to 🤗 Transformers.js! This unlocks a world of possibilities for in-browser video editing! 🤯 What will you build? 😍 Demo (+ source code) 👇

Xenova

17,221 subscribers

105,952 views • 1 year ago •via X (Twitter)

Arts Education Science & Technology

Anya Rossi• Live Now

Private livecam show

10 Comments

Xenova1 year ago

Source code: Demo:

Yam Peleg1 year ago

This is one of the most useful things all over the open source ai landscape (not joking)

Jason Mayes1 year ago

Oh nice. Guess what I'm adding this to 😉

PDS_B2BMGMT1 year ago

I never got it too work! After you upload audio. Then you wait? How long as the wait?

Caleb1 year ago

This is huge

Cody Bontecou1 year ago

Did something change? Wasn't this already available with your previous whisper-web demo?

Randy Rektor1 year ago

@wesbos @stolinski 👀👀

Milind Mishra ✦1 year ago

@codewithbhargav check this out.

Rohan Jha1 year ago

Can you track in the video by clicking on the words?

llmstock.com mc1 year ago

omg you saved me

Related Videos

It's finally possible: real-time in-browser speech recognition with OpenAI Whisper! 🤯 The model runs fully on-device using Transformers.js and ONNX Runtime Web, and supports multilingual transcription across 100 different languages! 🔥 Check out the demo (+ source code)! 👇

It's finally possible: real-time in-browser speech recognition with OpenAI Whisper! 🤯 The model runs fully on-device using Transformers.js and ONNX Runtime Web, and supports multilingual transcription across 100 different languages! 🔥 Check out the demo (+ source code)! 👇

Xenova

261,247 views • 2 years ago

Is this the future of AI browser agents? 👀 WebGPU-accelerated reasoning LLMs are now supported in Transformers.js! 🤯 Here's MiniThinky-v2 (1B) running 100% locally in the browser at ~60 tps (no API calls)! I can't wait to see what you build with it! Demo + source code in 🧵👇

Is this the future of AI browser agents? 👀 WebGPU-accelerated reasoning LLMs are now supported in Transformers.js! 🤯 Here's MiniThinky-v2 (1B) running 100% locally in the browser at ~60 tps (no API calls)! I can't wait to see what you build with it! Demo + source code in 🧵👇

Xenova

81,346 views • 1 year ago

Florence-2, the new vision foundation model by Microsoft, can now run 100% locally in your browser on WebGPU, thanks to Transformers.js! 🤗🤯 It supports tasks like image captioning, optical character recognition, object detection, and many more! 😍 WOW! Demo (+ source code) 👇

Florence-2, the new vision foundation model by Microsoft, can now run 100% locally in your browser on WebGPU, thanks to Transformers.js! 🤗🤯 It supports tasks like image captioning, optical character recognition, object detection, and many more! 😍 WOW! Demo (+ source code) 👇

Xenova

88,743 views • 1 year ago

Introducing TTS WebGPU: The first ever text-to-speech web app built with WebGPU acceleration! 🔥 High-quality and natural speech generation that runs 100% locally in your browser, powered by OuteTTS and Transformers.js.🤗 Try it out yourself! Demo + source code below 👇

Introducing TTS WebGPU: The first ever text-to-speech web app built with WebGPU acceleration! 🔥 High-quality and natural speech generation that runs 100% locally in your browser, powered by OuteTTS and Transformers.js.🤗 Try it out yourself! Demo + source code below 👇

Xenova

19,666 views • 1 year ago

OmniParser, the new screen parsing tool from Microsoft (and #1 trending model on Hugging Face), can now run 100% locally in your browser with Transformers.js! 🤯 Who's going to be the first to turn this into a browser extension? 👀 Endless possibilities! Demo & code below! 👇

OmniParser, the new screen parsing tool from Microsoft (and #1 trending model on Hugging Face), can now run 100% locally in your browser with Transformers.js! 🤯 Who's going to be the first to turn this into a browser extension? 👀 Endless possibilities! Demo & code below! 👇

Xenova

64,546 views • 1 year ago

Introducing Kokoro.js, a new JavaScript library for running Kokoro TTS, an 82 million parameter text-to-speech model, 100% locally in the browser w/ WASM. Powered by 🤗 Transformers.js. WebGPU support coming soon! 👉 npm i kokoro-js 👈 Link to demo (+ sample code) in 🧵

Introducing Kokoro.js, a new JavaScript library for running Kokoro TTS, an 82 million parameter text-to-speech model, 100% locally in the browser w/ WASM. Powered by 🤗 Transformers.js. WebGPU support coming soon! 👉 npm i kokoro-js 👈 Link to demo (+ sample code) in 🧵

Xenova

40,340 views • 1 year ago

Introducing Moonshine Web: real-time speech recognition running 100% locally in your browser! 🚀 Faster and more accurate than Whisper 🔒 Privacy-focused (no data leaves your device) ⚡️ WebGPU accelerated (w/ WASM fallback) 🔥 Powered by ONNX Runtime Web and Transformers.js

Introducing Moonshine Web: real-time speech recognition running 100% locally in your browser! 🚀 Faster and more accurate than Whisper 🔒 Privacy-focused (no data leaves your device) ⚡️ WebGPU accelerated (w/ WASM fallback) 🔥 Powered by ONNX Runtime Web and Transformers.js

Xenova

27,878 views • 1 year ago

Absolutely wild what's possible with Hugging Face's Transformers.js in the browser! 🤯 🎙️Realtime in-browser speech-to-text with OpenAI Whisper! 📡 Broadcast to subscribed clients with Supabase Realtime. 🌏 Translate to 200 languages with AI at Meta's NLLB-200! Source code 👇

Absolutely wild what's possible with Hugging Face's Transformers.js in the browser! 🤯 🎙️Realtime in-browser speech-to-text with OpenAI Whisper! 📡 Broadcast to subscribed clients with Supabase Realtime. 🌏 Translate to 200 languages with AI at Meta's NLLB-200! Source code 👇

Thor 雷神 ⚡️

52,380 views • 1 year ago

DINOv3 is revolutionary: a new state-of-the-art vision backbone trained to produce rich, dense image features. I loved their demo video so much that I decided to re-create their visualization tool. Everything runs 100% in-browser with 🤗 Transformers.js! Demo + source code 👇

DINOv3 is revolutionary: a new state-of-the-art vision backbone trained to produce rich, dense image features. I loved their demo video so much that I decided to re-create their visualization tool. Everything runs 100% in-browser with 🤗 Transformers.js! Demo + source code 👇

Xenova

74,790 views • 10 months ago

Introducing MusicGen Web: AI-powered music generation directly in your browser, built with 🤗 Transformers.js! 🎵 Everything runs 100% locally, meaning no calls to an API! 🤯 Served as a static website... this costs $0 to host and run! 🔥 Try it out yourself! 👇

Introducing MusicGen Web: AI-powered music generation directly in your browser, built with 🤗 Transformers.js! 🎵 Everything runs 100% locally, meaning no calls to an API! 🤯 Served as a static website... this costs $0 to host and run! 🔥 Try it out yourself! 👇

Xenova

31,211 views • 2 years ago

Introducing Supertonic WebGPU: blazingly fast text-to-speech running 100% locally in your browser. ⚡️ Generate free audiobooks in seconds, no installation required. In this example, I created a 5-hour audiobook of The Great Gatsby in less than 3 minutes! 🤯 Try it yourself! 👇

Introducing Supertonic WebGPU: blazingly fast text-to-speech running 100% locally in your browser. ⚡️ Generate free audiobooks in seconds, no installation required. In this example, I created a 5-hour audiobook of The Great Gatsby in less than 3 minutes! 🤯 Try it yourself! 👇

Xenova

23,463 views • 6 months ago

Okay this is insane... WebGPU-accelerated semantic video tracking, powered by DINOv3 and Transformers.js! 🤯 This will revolutionize AI-powered video editors... which can now run 100% locally in your browser, no server inference required (costs $0)! 😍 Who's building this?

Okay this is insane... WebGPU-accelerated semantic video tracking, powered by DINOv3 and Transformers.js! 🤯 This will revolutionize AI-powered video editors... which can now run 100% locally in your browser, no server inference required (costs $0)! 😍 Who's building this?

Xenova

42,860 views • 9 months ago

Chrome's new `window.ai` feature is going to change the web forever! 🤯 It allows you to run Gemini Nano, a powerful 3.25B parameter LLM, 100% locally in your browser! We've also added experimental support to 🤗 Transformers.js, making it super easy to use! 😍 Check it out! 👇

Chrome's new `window.ai` feature is going to change the web forever! 🤯 It allows you to run Gemini Nano, a powerful 3.25B parameter LLM, 100% locally in your browser! We've also added experimental support to 🤗 Transformers.js, making it super easy to use! 😍 Check it out! 👇

Xenova

580,736 views • 1 year ago

RF-DETR, the state-of-the-art model series for real-time object detection, can now run 100% locally in your browser on WebGPU with 🤗 Transformers.js v4! The models are Apache-2.0 licensed, making them a perfect fit for both personal and commercial applications. Try the demo 👇

RF-DETR, the state-of-the-art model series for real-time object detection, can now run 100% locally in your browser on WebGPU with 🤗 Transformers.js v4! The models are Apache-2.0 licensed, making them a perfect fit for both personal and commercial applications. Try the demo 👇

Xenova

76,917 views • 3 months ago

I seriously cannot believe this is a 0.6B LLM! 🤯 Qwen just released Qwen3, a series of hybrid reasoning models that allow you to control how much "thinking" the model does for a given task. They can even run locally in your browser on WebGPU with 🤗 Transformers.js!

I seriously cannot believe this is a 0.6B LLM! 🤯 Qwen just released Qwen3, a series of hybrid reasoning models that allow you to control how much "thinking" the model does for a given task. They can even run locally in your browser on WebGPU with 🤗 Transformers.js!

Xenova

74,945 views • 1 year ago

NEW: Google releases EmbeddingGemma, a state-of-the-art multilingual embedding model perfect for on-device use cases! At only 308M params, the model can run 100% locally in your browser! 🤯 Explore your documents in an interactive 3D universe with our demo: "The Semantic Galaxy"

NEW: Google releases EmbeddingGemma, a state-of-the-art multilingual embedding model perfect for on-device use cases! At only 308M params, the model can run 100% locally in your browser! 🤯 Explore your documents in an interactive 3D universe with our demo: "The Semantic Galaxy"

Xenova

23,338 views • 9 months ago

Introducing Expect Test your agent code in a real browser Works with your agent. Fully open source

Introducing Expect Test your agent code in a real browser Works with your agent. Fully open source

Aiden Bai

73,293 views • 2 months ago

Someone made Samantha from the HER movie 💑 Running entirely in your browser 🤯- powered by transformers.js

Someone made Samantha from the HER movie 💑 Running entirely in your browser 🤯- powered by transformers.js

Victor M

37,648 views • 1 year ago

Introducing Captions for web. Video editing made simple, thanks to AI — now on a bigger screen. One-click editing, right from your browser.

Introducing Captions for web. Video editing made simple, thanks to AI — now on a bigger screen. One-click editing, right from your browser.

Mirage

378,257 views • 2 years ago

Introducing WORLD BUILDER 🫳🌎 A revolutionary way to Build a World from scratch, for free, directly in your browser

Introducing WORLD BUILDER 🫳🌎 A revolutionary way to Build a World from scratch, for free, directly in your browser

ᴏɴᴄʏʙᴇʀ

153,189 views • 2 years ago