Загрузка видео...

Не удалось загрузить видео

Возникла проблема при загрузке этого видео. Это может быть связано с временными проблемами сети или видео может быть недоступно.

На главную

Most people should probably update their priors on the state of open-source speech-to-speech. It's honestly kind of mind-blowing. We teamed up with Cerebras to build a fully open-source realtime voice demo (models + code) to show what's possible today. Demo : Blog: Go test it, fork it, tweak it,... show more

Thomas Wolf

121,219 subscribers

250,435 просмотров • 1 месяц назад •via X (Twitter)

Искусство Образование Наука и технологии

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

NVIDIA just released a new open source transcription model, Nemotron Speech ASR, designed from the ground up for low-latency use cases like voice agents. Here's a voice agent built with this new model. 24ms transcription finalization and total voice-to-voice inference time under 500ms. This agent actually uses *three* NVIDIA open source models: - Nemotron Speech ASR - Nemotron 3 Nano 30GB in a 4-bit quant (released in December) - A preview checkpoint of the upcoming Magpie text-to-speech model These models are all truly open source: weights, training data, training code, and inference code. This is a big deal! Jensen said in the CES keynote yesterday that he expects open source models to catch up to proprietary models this year in a number of categories. NVIDIA is putting their weight behind making this happen. (As Alan Kay said, the best way to predict the future is to invent it.) The code for this agent is open source too, of course. You can deploy it to production with Modal and Pipecat AI cloud, or run locally on an NVIDIA DGX Spark or RTX 5090.

NVIDIA just released a new open source transcription model, Nemotron Speech ASR, designed from the ground up for low-latency use cases like voice agents. Here's a voice agent built with this new model. 24ms transcription finalization and total voice-to-voice inference time under 500ms. This agent actually uses three NVIDIA open source models: - Nemotron Speech ASR - Nemotron 3 Nano 30GB in a 4-bit quant (released in December) - A preview checkpoint of the upcoming Magpie text-to-speech model These models are all truly open source: weights, training data, training code, and inference code. This is a big deal! Jensen said in the CES keynote yesterday that he expects open source models to catch up to proprietary models this year in a number of categories. NVIDIA is putting their weight behind making this happen. (As Alan Kay said, the best way to predict the future is to invent it.) The code for this agent is open source too, of course. You can deploy it to production with Modal and Pipecat AI cloud, or run locally on an NVIDIA DGX Spark or RTX 5090.

kwindla

274,568 просмотров • 6 месяцев назад

NVIDIA is making it possible to speak with your voice to the AI characters of the game you're playing. It may look like picking from a NPC dialogue tree but the impressive part of this demo is that the generative AI is reacting to natural speech. Watch the full video (with sound) here: Source: The Verge

NVIDIA is making it possible to speak with your voice to the AI characters of the game you're playing. It may look like picking from a NPC dialogue tree but the impressive part of this demo is that the generative AI is reacting to natural speech. Watch the full video (with sound) here: Source: The Verge

Kris Kashtanova

50,879 просмотров • 3 лет назад

when I trade notes with Dylan Patel of SemiAnalysis I learn something new No Priors on open source ai models, neoclouds, poker, power constraints, and what it would take to challenge Nvidia

when I trade notes with Dylan Patel of SemiAnalysis I learn something new No Priors on open source ai models, neoclouds, poker, power constraints, and what it would take to challenge Nvidia

sarah guo

145,979 просмотров • 11 месяцев назад

it's so over DeepSeek V3-0324 just dropped and it created this website in one shot, it wrote 800+ lines of code without breaking even once, this is free, open-source, super fast. it's great to see how these open-source models are creating pressure on the big techs to build better models at lower cost.

it's so over DeepSeek V3-0324 just dropped and it created this website in one shot, it wrote 800+ lines of code without breaking even once, this is free, open-source, super fast. it's great to see how these open-source models are creating pressure on the big techs to build better models at lower cost.

Deepanshu Sharma

291,159 просмотров • 1 год назад

Zuck: "For anyone who shows up now and is doing open source now that we have done it, there's a question. They already have their revealed preference for what they would build if open source didn't exist - it wasn't open source. We need to be careful about relying on their continued behavior for the future of the technology that we're gonna build at this company."

Zuck: "For anyone who shows up now and is doing open source now that we have done it, there's a question. They already have their revealed preference for what they would build if open source didn't exist - it wasn't open source. We need to be careful about relying on their continued behavior for the future of the technology that we're gonna build at this company."

Dwarkesh Patel

288,685 просмотров • 1 год назад

Run state-of-the-art RAG applications locally on your computer with ollama and use all the fantastic open-source models like llama3, msk's awesome models, or Command R from Cohere With Verba 1.0, we put it all in your hands 🙌 Get on board for a wild open-source ride, we're bridging any moat as open-source is here to win

Run state-of-the-art RAG applications locally on your computer with ollama and use all the fantastic open-source models like llama3, msk's awesome models, or Command R from Cohere With Verba 1.0, we put it all in your hands 🙌 Get on board for a wild open-source ride, we're bridging any moat as open-source is here to win

Philip Vollet

41,450 просмотров • 2 лет назад

Avatar Studio is now fully open-source, with the fully permissive MIT license. Fork it, contribute to it, make your own commercial product out of it. Whatever you want! I will be actively following submitted issues and pull requests.

Jag the Hero

26,712 просмотров • 16 дней назад

Excited to introduce Fish Speech 1.4 - now open-source and more powerful than ever! 🎉 Our mission is to make cutting-edge voice tech accessible to everyone. What's new: - Trained on 700k hours of multilingual data (up from 200k) - Now supports 8 languages: English, Chinese, German, Japanese, French, Spanish, Korean, and Arabic - Fully open-source, empowering developers and researchers worldwide Key features: - Lightning-fast TTS with ultra-low latency - Instant voice cloning - Self-host or use our cloud service - Simple, flat-rate pricing Try it out: - Playground: - GitHub: - HuggingFace Model: - Demo: - Product Hunt: We can't wait to see what you'll create with Fish Audio. Happy voice building! 🎧🐠

Excited to introduce Fish Speech 1.4 - now open-source and more powerful than ever! 🎉 Our mission is to make cutting-edge voice tech accessible to everyone. What's new: - Trained on 700k hours of multilingual data (up from 200k) - Now supports 8 languages: English, Chinese, German, Japanese, French, Spanish, Korean, and Arabic - Fully open-source, empowering developers and researchers worldwide Key features: - Lightning-fast TTS with ultra-low latency - Instant voice cloning - Self-host or use our cloud service - Simple, flat-rate pricing Try it out: - Playground: - GitHub: - HuggingFace Model: - Demo: - Product Hunt: We can't wait to see what you'll create with Fish Audio. Happy voice building! 🎧🐠

Fish Audio

149,977 просмотров • 1 год назад

Today we’re releasing Chroma 1.0 → the world first open-source, end-to-end, real-time speech-to-speech model → with personalized voice cloning Trained by FlashLabs. Deployed on FlashAI👉 An open research-grade alternative to the OpenAI Realtime model. Voice Test dubbing Elon Musk and Lex Fridman: 🔥What’s real (evals and benchmarks attached): ⚡ 2× faster than real-time ) 📘 SGLang Cookbook: 📄 Paper + benchmarks: 🤗 Models: 💻 Inference code: 🔁 RT if you believe real-time AI should be open 💬 Reply if you’re building on Conversational Voice AI products

Today we’re releasing Chroma 1.0 → the world first open-source, end-to-end, real-time speech-to-speech model → with personalized voice cloning Trained by FlashLabs. Deployed on FlashAI👉 An open research-grade alternative to the OpenAI Realtime model. Voice Test dubbing Elon Musk and Lex Fridman: 🔥What’s real (evals and benchmarks attached): ⚡ 2× faster than real-time ) 📘 SGLang Cookbook: 📄 Paper + benchmarks: 🤗 Models: 💻 Inference code: 🔁 RT if you believe real-time AI should be open 💬 Reply if you’re building on Conversational Voice AI products

FlashLabs

1,248,841 просмотров • 6 месяцев назад

4 years ago we were on the brink of AI becoming proprietary and centralized, when OpenAI kept GPT3 closed and VCs started dumping money on researchers. From fully open science, to fully closed, in a matter of months. It was scary, and 1,000+ leading researchers and scientists banded together to show the world that it was possible to do the same work in the open, and build an ecosystem that benefits everyone. That was the BigScience Research Workshop BLOOM project, and it put us back on track to open science, starting with forward-thinking organizations like Meta releasing OPT. Look at us now. Open models have not only caught up, they're state of the art now. Not just LLMs, but models for document AI, speech to text, text to speech, generating images and more. We're closing in on 2 million open weight models on Hugging Face. Thanks for the reminder Thomas Wolf .

4 years ago we were on the brink of AI becoming proprietary and centralized, when OpenAI kept GPT3 closed and VCs started dumping money on researchers. From fully open science, to fully closed, in a matter of months. It was scary, and 1,000+ leading researchers and scientists banded together to show the world that it was possible to do the same work in the open, and build an ecosystem that benefits everyone. That was the BigScience Research Workshop BLOOM project, and it put us back on track to open science, starting with forward-thinking organizations like Meta releasing OPT. Look at us now. Open models have not only caught up, they're state of the art now. Not just LLMs, but models for document AI, speech to text, text to speech, generating images and more. We're closing in on 2 million open weight models on Hugging Face. Thanks for the reminder Thomas Wolf .

Jeff Boudier 🤗

21,947 просмотров • 1 год назад

Open-source AI enabled home robot with voice chat. Tell it what to do and it will try to clean up your home for you. This is locally running Qwen2.5 on my desktop. No need to send information from your home to the cloud.

Open-source AI enabled home robot with voice chat. Tell it what to do and it will try to clean up your home for you. This is locally running Qwen2.5 on my desktop. No need to send information from your home to the cloud.

Chris Paxton

26,750 просмотров • 1 год назад

You probably know OpenClaw🦞, one of the fastest-growing open-source projects around. An OpenClaw harness lets you build, code, analyze, and take real control of your machine. But the more access an agent has to your machine, the more it matters where your data goes & who can see it. With QVAC, you can run your OpenClaw agent fully on your own machine in a few minutes. Nothing leaves your computer. Full setup guide on the blog, see first comment below. 💡 Pro tip: already running OpenClaw? Send the blog article to your agent and let the it do the set up.

You probably know OpenClaw🦞, one of the fastest-growing open-source projects around. An OpenClaw harness lets you build, code, analyze, and take real control of your machine. But the more access an agent has to your machine, the more it matters where your data goes & who can see it. With QVAC, you can run your OpenClaw agent fully on your own machine in a few minutes. Nothing leaves your computer. Full setup guide on the blog, see first comment below. 💡 Pro tip: already running OpenClaw? Send the blog article to your agent and let the it do the set up.

QVAC

15,019,651 просмотров • 1 месяц назад

Following the release of Kimi K3, tylercowen explains why trying to ban Chinese open-source AI models is a losing strategy and that American companies should compete instead. "Open source is coming and is here, whether we like it or not. Of course, a lot of it will be from China. We should allow American competitors to proceed on an even footing. But the attempt to outlaw it, ban it, or use sanctions against it is going to fail miserably.” "I plead that the Trump administration gives up on this crusade. It will not work."

Following the release of Kimi K3, tylercowen explains why trying to ban Chinese open-source AI models is a losing strategy and that American companies should compete instead. "Open source is coming and is here, whether we like it or not. Of course, a lot of it will be from China. We should allow American competitors to proceed on an even footing. But the attempt to outlaw it, ban it, or use sanctions against it is going to fail miserably.” "I plead that the Trump administration gives up on this crusade. It will not work."

TBPN

137,380 просмотров • 14 дней назад

Elon exposes OpenAI -- OpenAI execs betrayed the founding mission as soon as there was revenue and profits to be had -- If it started as a for-profit, Elon would own 50% Elon Musk: “There's a mountain of evidence that shows that OpenAI was created as an open source nonprofit.” “That's the exact description in the incorporation documents. They have completely violated that.” “And they tried to change the definition of OpenAI to mean open to everyone instead of open source, even though it always meant open source.” “ I came up with the name. That’s how I know.” “ I mean, essentially, since I came up with the idea for the company, named it, provided the A, B, and C rounds of funding, recruited the critical personnel, and told them everything I know, if that had been a commercial corporation, I'd probably own half the company.” “It was totally at my discretion. I could have done that.” “But I created it as an open source nonprofit for the world.” Chamath: “ Do you think the right thing to do is to take those models and just open source them today?” Elon: “ Yeah, I think that is what it was created to do, so it should.” “Try using any of the recent so-called OpenAI open source models, they don't work.” “They open sourced a broken, non-working version of their models as a fig leaf.” “I mean, do you know anyone who's running OpenAI's open source models? Jason: “No.” Elon: “Exactly.”

Elon exposes OpenAI -- OpenAI execs betrayed the founding mission as soon as there was revenue and profits to be had -- If it started as a for-profit, Elon would own 50% Elon Musk: “There's a mountain of evidence that shows that OpenAI was created as an open source nonprofit.” “That's the exact description in the incorporation documents. They have completely violated that.” “And they tried to change the definition of OpenAI to mean open to everyone instead of open source, even though it always meant open source.” “ I came up with the name. That’s how I know.” “ I mean, essentially, since I came up with the idea for the company, named it, provided the A, B, and C rounds of funding, recruited the critical personnel, and told them everything I know, if that had been a commercial corporation, I'd probably own half the company.” “It was totally at my discretion. I could have done that.” “But I created it as an open source nonprofit for the world.” Chamath: “ Do you think the right thing to do is to take those models and just open source them today?” Elon: “ Yeah, I think that is what it was created to do, so it should.” “Try using any of the recent so-called OpenAI open source models, they don't work.” “They open sourced a broken, non-working version of their models as a fig leaf.” “I mean, do you know anyone who's running OpenAI's open source models? Jason: “No.” Elon: “Exactly.”

The All-In Podcast

387,223 просмотров • 9 месяцев назад

ElevenLabs has officially LOST to Open-Source ResembleAI allows you to clone ANY voice without verification using on 5-10 seconds of audio, and dominates on paralinguistic tags for human-like expressions. Most "fast" text-to-speech models sound robotic. Most "quality" TTS models are slow. None incorporate authentication at a foundational level. Resemble AI solved all three. Chatterbox Turbo delivers: 🟢<150ms time-to-first-sound 🟢State-of-the-art quality that beats larger proprietary models 🟢Natural, programmable expressions 🟢Zero-shot voice cloning with just 5 seconds of audio 🟢PerTh watermarking for authenticated and verifiable audio 🟢Open source – full transparency, no black boxes Try it on HuggingFace:

ElevenLabs has officially LOST to Open-Source ResembleAI allows you to clone ANY voice without verification using on 5-10 seconds of audio, and dominates on paralinguistic tags for human-like expressions. Most "fast" text-to-speech models sound robotic. Most "quality" TTS models are slow. None incorporate authentication at a foundational level. Resemble AI solved all three. Chatterbox Turbo delivers: 🟢<150ms time-to-first-sound 🟢State-of-the-art quality that beats larger proprietary models 🟢Natural, programmable expressions 🟢Zero-shot voice cloning with just 5 seconds of audio 🟢PerTh watermarking for authenticated and verifiable audio 🟢Open source – full transparency, no black boxes Try it on HuggingFace:

AI Breakfast

208,603 просмотров • 7 месяцев назад

Meet MoshiVis🎙️🖼️, the first open-source real-time speech model that can talk about images! It sees, understands, and talks about images — naturally, and out loud. Voice interaction with a compact model endowed with visual understanding opens up new applications, from audio description for the visual impaired to visual access to information. Try it out 👉 Blog post 👉

Meet MoshiVis🎙️🖼️, the first open-source real-time speech model that can talk about images! It sees, understands, and talks about images — naturally, and out loud. Voice interaction with a compact model endowed with visual understanding opens up new applications, from audio description for the visual impaired to visual access to information. Try it out 👉 Blog post 👉

kyutai

47,965 просмотров • 1 год назад

Who knew that inviting AI into your video chats could be fun && functional? We used Cloudflare Developers Calls and the OpenAI Realtime API with WebRTC to add AI to our open source Orange Meets demo app. I forked it to make my own murder mystery app 😈 Code and details in 🧵

Who knew that inviting AI into your video chats could be fun && functional? We used Cloudflare Developers Calls and the OpenAI Realtime API with WebRTC to add AI to our open source Orange Meets demo app. I forked it to make my own murder mystery app 😈 Code and details in 🧵

Ricky

16,796 просмотров • 1 год назад

we built this thing called Palmier > it's like a video editor but for ai and open source > generate ai footage using leading models, mix it with your real footage, and connect your Claude to edit videos for you > we used it to make 15+ cinematic yc launch videos > it's free to try today, no waitlist

we built this thing called Palmier > it's like a video editor but for ai and open source > generate ai footage using leading models, mix it with your real footage, and connect your Claude to edit videos for you > we used it to make 15+ cinematic yc launch videos > it's free to try today, no waitlist

Marcos Rico Peng

16,352 просмотров • 1 месяц назад

i had opus credits to burn so i recreated github with instant navigation and the ui that i would want you can use it today most of your workflow should work on it, private repos are supported, and it's open source

i had opus credits to burn so i recreated github with instant navigation and the ui that i would want you can use it today most of your workflow should work on it, private repos are supported, and it's open source

Rhys

161,535 просмотров • 5 месяцев назад