Загрузка видео...

Не удалось загрузить видео

Возникла проблема при загрузке этого видео. Это может быть связано с временными проблемами сети или видео может быть недоступно.

На главную

Most people should probably update their priors on the state of open-source speech-to-speech. It's honestly kind of mind-blowing. We teamed up with Cerebras to build a fully open-source realtime voice demo (models + code) to show what's possible today. Demo : Blog: Go test it, fork it, tweak it,... show more

Thomas Wolf

130,978 subscribers

251,651 просмотров • 2 месяцев назад •via X (Twitter)

Искусство Образование Наука и технологии

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

NVIDIA just released a new open source transcription model, Nemotron Speech ASR, designed from the ground up for low-latency use cases like voice agents. Here's a voice agent built with this new model. 24ms transcription finalization and total voice-to-voice inference time under 500ms. This agent actually uses *three* NVIDIA open source models: - Nemotron Speech ASR - Nemotron 3 Nano 30GB in a 4-bit quant (released in December) - A preview checkpoint of the upcoming Magpie text-to-speech model These models are all truly open source: weights, training data, training code, and inference code. This is a big deal! Jensen said in the CES keynote yesterday that he expects open source models to catch up to proprietary models this year in a number of categories. NVIDIA is putting their weight behind making this happen. (As Alan Kay said, the best way to predict the future is to invent it.) The code for this agent is open source too, of course. You can deploy it to production with Modal and Pipecat AI cloud, or run locally on an NVIDIA DGX Spark or RTX 5090.

NVIDIA just released a new open source transcription model, Nemotron Speech ASR, designed from the ground up for low-latency use cases like voice agents. Here's a voice agent built with this new model. 24ms transcription finalization and total voice-to-voice inference time under 500ms. This agent actually uses three NVIDIA open source models: - Nemotron Speech ASR - Nemotron 3 Nano 30GB in a 4-bit quant (released in December) - A preview checkpoint of the upcoming Magpie text-to-speech model These models are all truly open source: weights, training data, training code, and inference code. This is a big deal! Jensen said in the CES keynote yesterday that he expects open source models to catch up to proprietary models this year in a number of categories. NVIDIA is putting their weight behind making this happen. (As Alan Kay said, the best way to predict the future is to invent it.) The code for this agent is open source too, of course. You can deploy it to production with Modal and Pipecat AI cloud, or run locally on an NVIDIA DGX Spark or RTX 5090.

kwindla

274,801 просмотров • 8 месяцев назад

Say It — private, local text-to-speech for macOS Open models 100% on-device, speak text from any app with a hotkey, and even clone your own voice. Infinite voices. Free & open-source. Listen to the video 🔊

Say It — private, local text-to-speech for macOS Open models 100% on-device, speak text from any app with a hotkey, and even clone your own voice. Infinite voices. Free & open-source. Listen to the video 🔊

calle

69,707 просмотров • 1 месяц назад

Jensen Huang on today's All-In Summit: open-source AI is what allows an entire economy to compete. "in the last six months, $400 billion of venture funding went into AI-native companies. Eighty percent of them use open models. If not for open models, how could they build their dream? The vast majority of the world’s contribution to open source today is coming from China. But once you download it, it’s yours. We fork it. We improve it. We make it ours." ---- Full video on "All-In Podcast" YouTube channel (link in comment)

Jensen Huang on today's All-In Summit: open-source AI is what allows an entire economy to compete. "in the last six months, $400 billion of venture funding went into AI-native companies. Eighty percent of them use open models. If not for open models, how could they build their dream? The vast majority of the world’s contribution to open source today is coming from China. But once you download it, it’s yours. We fork it. We improve it. We make it ours." ---- Full video on "All-In Podcast" YouTube channel (link in comment)

Rohan Paul

32,272 просмотров • 3 дней назад

NVIDIA is making it possible to speak with your voice to the AI characters of the game you're playing. It may look like picking from a NPC dialogue tree but the impressive part of this demo is that the generative AI is reacting to natural speech. Watch the full video (with sound) here: Source: The Verge

NVIDIA is making it possible to speak with your voice to the AI characters of the game you're playing. It may look like picking from a NPC dialogue tree but the impressive part of this demo is that the generative AI is reacting to natural speech. Watch the full video (with sound) here: Source: The Verge

Kris Kashtanova

50,879 просмотров • 3 лет назад

Zuck: "For anyone who shows up now and is doing open source now that we have done it, there's a question. They already have their revealed preference for what they would build if open source didn't exist - it wasn't open source. We need to be careful about relying on their continued behavior for the future of the technology that we're gonna build at this company."

Zuck: "For anyone who shows up now and is doing open source now that we have done it, there's a question. They already have their revealed preference for what they would build if open source didn't exist - it wasn't open source. We need to be careful about relying on their continued behavior for the future of the technology that we're gonna build at this company."

Dwarkesh Patel

288,685 просмотров • 1 год назад

it's so over DeepSeek V3-0324 just dropped and it created this website in one shot, it wrote 800+ lines of code without breaking even once, this is free, open-source, super fast. it's great to see how these open-source models are creating pressure on the big techs to build better models at lower cost.

it's so over DeepSeek V3-0324 just dropped and it created this website in one shot, it wrote 800+ lines of code without breaking even once, this is free, open-source, super fast. it's great to see how these open-source models are creating pressure on the big techs to build better models at lower cost.

Deepanshu Sharma

291,222 просмотров • 1 год назад

Run state-of-the-art RAG applications locally on your computer with ollama and use all the fantastic open-source models like llama3, msk's awesome models, or Command R from Cohere With Verba 1.0, we put it all in your hands 🙌 Get on board for a wild open-source ride, we're bridging any moat as open-source is here to win

Run state-of-the-art RAG applications locally on your computer with ollama and use all the fantastic open-source models like llama3, msk's awesome models, or Command R from Cohere With Verba 1.0, we put it all in your hands 🙌 Get on board for a wild open-source ride, we're bridging any moat as open-source is here to win

Philip Vollet

41,450 просмотров • 2 лет назад

Announcing the Open Model Series: a new series on open source AI models, with merve of Hugging Face. Hugging Face is the open model hub: it hosts model weights, datasets, evals, & demo apps, and maintains the open-source libraries (like transformers) used to run and train them. I think of it like GitHub, but for AI models. You can download open models and run them on your own machines. In this series we'll cover what open source and open weight models are, how they work, how to run them yourself, and why they're important. By the way - this video is edited entirely with Claude! I can make a tutorial on how I did it. If there's a question you want answered about open models, leave it in the comments. We will read them all. Episode 1 is out soon.

Announcing the Open Model Series: a new series on open source AI models, with merve of Hugging Face. Hugging Face is the open model hub: it hosts model weights, datasets, evals, & demo apps, and maintains the open-source libraries (like transformers) used to run and train them. I think of it like GitHub, but for AI models. You can download open models and run them on your own machines. In this series we'll cover what open source and open weight models are, how they work, how to run them yourself, and why they're important. By the way - this video is edited entirely with Claude! I can make a tutorial on how I did it. If there's a question you want answered about open models, leave it in the comments. We will read them all. Episode 1 is out soon.

Harper Carroll

30,392 просмотров • 1 месяц назад

ok this surprised me tried Cline Desktop, the open-source desktop app for open-weight models, and asked it to build me a dashboard to track my brand deals fully expected to babysit it and fix stuff after nope. it figured it out on its own and nailed it on the first go Custom recording

me

100,451 просмотров • 3 дней назад

The open-source & open-weight frontier is 7 months behind the closed-model frontier. Let’s talk about it. Check out last week’s episode for the reasons why you might want to consider open-source & open-weight models. Welcome to the fourth episode of the Open Model Series with merve, Hugging Face AI/ML engineer & open-sourceress! We have been discussing open-source & open-weight AI: what it is, how it works, and how you can run them on your own compute. Please leave all your questions about open-source & open-weight AI in the comments! This is a super important topic that is novel to most people, and it can be challenging to grasp - so rest assured your questions are shared with many others!

The open-source & open-weight frontier is 7 months behind the closed-model frontier. Let’s talk about it. Check out last week’s episode for the reasons why you might want to consider open-source & open-weight models. Welcome to the fourth episode of the Open Model Series with merve, Hugging Face AI/ML engineer & open-sourceress! We have been discussing open-source & open-weight AI: what it is, how it works, and how you can run them on your own compute. Please leave all your questions about open-source & open-weight AI in the comments! This is a super important topic that is novel to most people, and it can be challenging to grasp - so rest assured your questions are shared with many others!

Harper Carroll

17,279 просмотров • 16 дней назад

Avatar Studio is now fully open-source, with the fully permissive MIT license. Fork it, contribute to it, make your own commercial product out of it. Whatever you want! I will be actively following submitted issues and pull requests.

Jag the Hero

26,760 просмотров • 2 месяцев назад

Excited to introduce Fish Speech 1.4 - now open-source and more powerful than ever! 🎉 Our mission is to make cutting-edge voice tech accessible to everyone. What's new: - Trained on 700k hours of multilingual data (up from 200k) - Now supports 8 languages: English, Chinese, German, Japanese, French, Spanish, Korean, and Arabic - Fully open-source, empowering developers and researchers worldwide Key features: - Lightning-fast TTS with ultra-low latency - Instant voice cloning - Self-host or use our cloud service - Simple, flat-rate pricing Try it out: - Playground: - GitHub: - HuggingFace Model: - Demo: - Product Hunt: We can't wait to see what you'll create with Fish Audio. Happy voice building! 🎧🐠

Excited to introduce Fish Speech 1.4 - now open-source and more powerful than ever! 🎉 Our mission is to make cutting-edge voice tech accessible to everyone. What's new: - Trained on 700k hours of multilingual data (up from 200k) - Now supports 8 languages: English, Chinese, German, Japanese, French, Spanish, Korean, and Arabic - Fully open-source, empowering developers and researchers worldwide Key features: - Lightning-fast TTS with ultra-low latency - Instant voice cloning - Self-host or use our cloud service - Simple, flat-rate pricing Try it out: - Playground: - GitHub: - HuggingFace Model: - Demo: - Product Hunt: We can't wait to see what you'll create with Fish Audio. Happy voice building! 🎧🐠

Fish Audio

149,977 просмотров • 2 лет назад

Today we’re releasing Chroma 1.0 → the world first open-source, end-to-end, real-time speech-to-speech model → with personalized voice cloning Trained by FlashLabs. Deployed on FlashAI👉 An open research-grade alternative to the OpenAI Realtime model. Voice Test dubbing Elon Musk and Lex Fridman: 🔥What’s real (evals and benchmarks attached): ⚡ 2× faster than real-time ) 📘 SGLang Cookbook: 📄 Paper + benchmarks: 🤗 Models: 💻 Inference code: 🔁 RT if you believe real-time AI should be open 💬 Reply if you’re building on Conversational Voice AI products

Today we’re releasing Chroma 1.0 → the world first open-source, end-to-end, real-time speech-to-speech model → with personalized voice cloning Trained by FlashLabs. Deployed on FlashAI👉 An open research-grade alternative to the OpenAI Realtime model. Voice Test dubbing Elon Musk and Lex Fridman: 🔥What’s real (evals and benchmarks attached): ⚡ 2× faster than real-time ) 📘 SGLang Cookbook: 📄 Paper + benchmarks: 🤗 Models: 💻 Inference code: 🔁 RT if you believe real-time AI should be open 💬 Reply if you’re building on Conversational Voice AI products

FlashLabs

1,249,149 просмотров • 7 месяцев назад

Open-source AI enabled home robot with voice chat. Tell it what to do and it will try to clean up your home for you. This is locally running Qwen2.5 on my desktop. No need to send information from your home to the cloud.

Open-source AI enabled home robot with voice chat. Tell it what to do and it will try to clean up your home for you. This is locally running Qwen2.5 on my desktop. No need to send information from your home to the cloud.

Chris Paxton

26,763 просмотров • 1 год назад

You probably know OpenClaw🦞, one of the fastest-growing open-source projects around. An OpenClaw harness lets you build, code, analyze, and take real control of your machine. But the more access an agent has to your machine, the more it matters where your data goes & who can see it. With QVAC, you can run your OpenClaw agent fully on your own machine in a few minutes. Nothing leaves your computer. Full setup guide on the blog, see first comment below. 💡 Pro tip: already running OpenClaw? Send the blog article to your agent and let the it do the set up.

You probably know OpenClaw🦞, one of the fastest-growing open-source projects around. An OpenClaw harness lets you build, code, analyze, and take real control of your machine. But the more access an agent has to your machine, the more it matters where your data goes & who can see it. With QVAC, you can run your OpenClaw agent fully on your own machine in a few minutes. Nothing leaves your computer. Full setup guide on the blog, see first comment below. 💡 Pro tip: already running OpenClaw? Send the blog article to your agent and let the it do the set up.

QVAC

15,019,651 просмотров • 3 месяцев назад

4 years ago we were on the brink of AI becoming proprietary and centralized, when OpenAI kept GPT3 closed and VCs started dumping money on researchers. From fully open science, to fully closed, in a matter of months. It was scary, and 1,000+ leading researchers and scientists banded together to show the world that it was possible to do the same work in the open, and build an ecosystem that benefits everyone. That was the BigScience Research Workshop BLOOM project, and it put us back on track to open science, starting with forward-thinking organizations like Meta releasing OPT. Look at us now. Open models have not only caught up, they're state of the art now. Not just LLMs, but models for document AI, speech to text, text to speech, generating images and more. We're closing in on 2 million open weight models on Hugging Face. Thanks for the reminder Thomas Wolf .

4 years ago we were on the brink of AI becoming proprietary and centralized, when OpenAI kept GPT3 closed and VCs started dumping money on researchers. From fully open science, to fully closed, in a matter of months. It was scary, and 1,000+ leading researchers and scientists banded together to show the world that it was possible to do the same work in the open, and build an ecosystem that benefits everyone. That was the BigScience Research Workshop BLOOM project, and it put us back on track to open science, starting with forward-thinking organizations like Meta releasing OPT. Look at us now. Open models have not only caught up, they're state of the art now. Not just LLMs, but models for document AI, speech to text, text to speech, generating images and more. We're closing in on 2 million open weight models on Hugging Face. Thanks for the reminder Thomas Wolf .

Jeff Boudier 🤗

21,947 просмотров • 1 год назад

Today we're announcing Mastra Factory! Most teams just want to build their product - not take on building and maintaining a factory too. So we're open-sourcing ours. Now you can own your factory without having to build it yourself. Demo:

Today we're announcing Mastra Factory! Most teams just want to build their product - not take on building and maintaining a factory too. So we're open-sourcing ours. Now you can own your factory without having to build it yourself. Demo:

Alex Booker

14,654 просмотров • 8 дней назад

Following the release of Kimi K3, tylercowen explains why trying to ban Chinese open-source AI models is a losing strategy and that American companies should compete instead. "Open source is coming and is here, whether we like it or not. Of course, a lot of it will be from China. We should allow American competitors to proceed on an even footing. But the attempt to outlaw it, ban it, or use sanctions against it is going to fail miserably.” "I plead that the Trump administration gives up on this crusade. It will not work."

Following the release of Kimi K3, tylercowen explains why trying to ban Chinese open-source AI models is a losing strategy and that American companies should compete instead. "Open source is coming and is here, whether we like it or not. Of course, a lot of it will be from China. We should allow American competitors to proceed on an even footing. But the attempt to outlaw it, ban it, or use sanctions against it is going to fail miserably.” "I plead that the Trump administration gives up on this crusade. It will not work."

TBPN

138,212 просмотров • 1 месяц назад