Загрузка видео...

Не удалось загрузить видео

На главную

Really proud to share something we’ve been working on for a while: Magenta RealTime 2 (MTR2), a live music model that is highly interactive (MIDI, audio, text, lots of parameters) and low-latency (~200ms end-to-end), and runs locally on a MacBook!

Ilaria__Manco's profile picture

Ilaria Manco

3,065 subscribers

44,633 просмотров • 1 месяц назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Introducing Magenta RealTime 2 (MRT2): the live music model you can play as an instrument. MRT2 offers MIDI and prompt controls, and runs natively on a MacBook with <200ms latency. Open weights. Open source inference engine. Suite of apps and plugins. Hear what it can do and try it out for yourself below 🧵
1:30

Introducing Magenta RealTime 2 (MRT2): the live music model you can play as an instrument. MRT2 offers MIDI and prompt controls, and runs natively on a MacBook with <200ms latency. Open weights. Open source inference engine. Suite of apps and plugins. Hear what it can do and try it out for yourself below 🧵

Google Magenta Project

112,191 просмотров • 1 месяц назад

Introducing Kitten TTS, a SOTA tiny text-to-speech model - Just 15M parameters - Runs without a GPU - Model size less than 25 MB - Multiple high-quality voices - Ultra-fast - even runs on low-end edge devices Github and HF links below
1:00

Introducing Kitten TTS, a SOTA tiny text-to-speech model - Just 15M parameters - Runs without a GPU - Model size less than 25 MB - Multiple high-quality voices - Ultra-fast - even runs on low-end edge devices Github and HF links below

Divam Gupta

348,769 просмотров • 11 месяцев назад

good morning /v1/chat/completions This is a test we ran overnight on TensorRT-LLM with modified kernels serving a custom 1B parameter model we trained for a customer ~200ms end-to-end latency (not TTFB, full request). Beats their current Cerebras stack on latency and quality
0:23

good morning /v1/chat/completions This is a test we ran overnight on TensorRT-LLM with modified kernels serving a custom 1B parameter model we trained for a customer ~200ms end-to-end latency (not TTFB, full request). Beats their current Cerebras stack on latency and quality

Sam Hogan 🇺🇸

43,655 просмотров • 5 месяцев назад

Realtime interactive generative models FTW! Announcing a new 🌊 of details and features for Magenta RealTime, the open weights live music AI model from GDM! * Live Jamming with audio input 🎤🎸🎵 * Personalize your own models 🔧 * Tech report 📜 Links below in the 🧵...
1:31

Realtime interactive generative models FTW! Announcing a new 🌊 of details and features for Magenta RealTime, the open weights live music AI model from GDM! * Live Jamming with audio input 🎤🎸🎵 * Personalize your own models 🔧 * Tech report 📜 Links below in the 🧵...

Jesse Engel

183,387 просмотров • 11 месяцев назад

🔊🔛🔥 ... Groq Inc launched voice generation today. GroqCloud now has realtime transcription, LLMs, *and* text-to-speech. You can build super-responsive, ultra low-latency voice agents end-to-end entirely on Groq! At Daily, we're big fans of Groq's fast, low-latency inference. Pipecat AI supports all the Groq models, including the new voice model. Lately, we've been obsessively playing a voice chat game that Mark Backman wrote. (My high score is 6, so far.) Here's Mark, with Groq's `Celeste-PlayAI` voice.
0:47

🔊🔛🔥 ... Groq Inc launched voice generation today. GroqCloud now has realtime transcription, LLMs, *and* text-to-speech. You can build super-responsive, ultra low-latency voice agents end-to-end entirely on Groq! At Daily, we're big fans of Groq's fast, low-latency inference. Pipecat AI supports all the Groq models, including the new voice model. Lately, we've been obsessively playing a voice chat game that Mark Backman wrote. (My high score is 6, so far.) Here's Mark, with Groq's `Celeste-PlayAI` voice.

kwindla

31,791 просмотров • 1 год назад

Also we'd like to take this special occasion to share something we've been working on. There is still a lot of development ahead, but since it's 10th anniversary we'd like to share something exciting for the end of the news!
0:35

Also we'd like to take this special occasion to share something we've been working on. There is still a lot of development ahead, but since it's 10th anniversary we'd like to share something exciting for the end of the news!

Rabi-Ribi

131,187 просмотров • 5 месяцев назад

Along with text, images, video and code, Gemini is able to process raw audio signal end-to-end. 🔊 It can listen to and understand speech, making it not only useful for transcription but a model that has a much more nuanced perception of its environment. ↓
3:44

Along with text, images, video and code, Gemini is able to process raw audio signal end-to-end. 🔊 It can listen to and understand speech, making it not only useful for transcription but a model that has a much more nuanced perception of its environment. ↓

Google DeepMind

140,169 просмотров • 2 лет назад

something i forgot to mention is that this is actually a player model ive been working on and not a mod lol.
1:08

something i forgot to mention is that this is actually a player model ive been working on and not a mod lol.

GoldyBer

12,707 просмотров • 10 дней назад

1/ I’m excited for Speak to be a featured use case for OpenAI’s Realtime API launch today! We’ve been working closely with them on this API for a while. And speech-to-speech is going to be a game changer not just for Speak but for all software.
2:28

1/ I’m excited for Speak to be a featured use case for OpenAI’s Realtime API launch today! We’ve been working closely with them on this API for a while. And speech-to-speech is going to be a game changer not just for Speak but for all software.

Connor Zwick

60,705 просмотров • 1 год назад

Transformer Explainer Really cool interactive tool to learn about the inner workings of a Transformer model. Apparently, it runs a GPT-2 instance locally in the user's browser and allows you to experiment with your own inputs. This is a nice tool to learn more about the different components inside the Transformer and the transformations that occur. Tool:
0:29

Transformer Explainer Really cool interactive tool to learn about the inner workings of a Transformer model. Apparently, it runs a GPT-2 instance locally in the user's browser and allows you to experiment with your own inputs. This is a nice tool to learn more about the different components inside the Transformer and the transformations that occur. Tool:

elvis

121,921 просмотров • 1 год назад

🎶 Lyria RealTime is a new experimental interactive music generation model that allows anyone to interactively create, control and perform music in real time. Available via the Gemini API and you can try the demo app on Google AI Studio.
0:28

🎶 Lyria RealTime is a new experimental interactive music generation model that allows anyone to interactively create, control and perform music in real time. Available via the Gemini API and you can try the demo app on Google AI Studio.

Google AI Developers

25,739 просмотров • 1 год назад

Excited to share a new humanoid robot platform we’ve been working on. Berkeley Humanoid is a reliable and low-cost mid-scale research platform for learning-based control. We demonstrate the robot walking on various terrains and dynamic hopping with a simple RL controller.
0:49

Excited to share a new humanoid robot platform we’ve been working on. Berkeley Humanoid is a reliable and low-cost mid-scale research platform for learning-based control. We demonstrate the robot walking on various terrains and dynamic hopping with a simple RL controller.

Qiayuan Liao

80,436 просмотров • 1 год назад

hanbin: to give you a quick update on what we’ve been up to lately, you know how our personal color content dropped recently? along with that, we’ve been working hard on a bunch of other things for you guys~ gunwook: we’ve really gone back to our roots and are working super hard. lately it feels like we’re trainees again. we’re taking a lot of lessons, working late nights on music, and growing in so many ways ♡ fighting 🫶
0:26

hanbin: to give you a quick update on what we’ve been up to lately, you know how our personal color content dropped recently? along with that, we’ve been working hard on a bunch of other things for you guys~ gunwook: we’ve really gone back to our roots and are working super hard. lately it feels like we’re trainees again. we’re taking a lot of lessons, working late nights on music, and growing in so many ways ♡ fighting 🫶

𝐬𝐮𝐧𝐠._.𝐦𝐞𝐨𝐰

22,749 просмотров • 3 месяцев назад

I'm *very* excited to share something we’ve been working on for a while now... It's a set of AI agents tailor-made for founders and built around each founder's specific workflows. Here’s an early look at some of the things the agents can do:
2:52

I'm *very* excited to share something we’ve been working on for a while now... It's a set of AI agents tailor-made for founders and built around each founder's specific workflows. Here’s an early look at some of the things the agents can do:

Ran Aroussi

30,170 просмотров • 1 год назад

Hey everyone, excited to share a sneak-peak into something we’ve been working on Introducing Hype - a mobile app that makes it easy to trade memecoins and crypto Comment HYPE or DM me for early access to the testflight
2:02

Hey everyone, excited to share a sneak-peak into something we’ve been working on Introducing Hype - a mobile app that makes it easy to trade memecoins and crypto Comment HYPE or DM me for early access to the testflight

ravi

42,006 просмотров • 2 лет назад

We’ve been busy! — Original Stories by Antibody, Aug 30 on — Really excited to see these go out into the world. Telling our own stories, building our own worlds is something Pat and I have been wanting to do for some time now. Live-action, animation, motion graphics: it’s a bit of a mix’n’mash. The first 3 go live on youtube and at the end of the month. Head over to and follow to catch them when they go live.
1:00

We’ve been busy! — Original Stories by Antibody, Aug 30 on — Really excited to see these go out into the world. Telling our own stories, building our own worlds is something Pat and I have been wanting to do for some time now. Live-action, animation, motion graphics: it’s a bit of a mix’n’mash. The first 3 go live on youtube and at the end of the month. Head over to and follow to catch them when they go live.

raoulmarks

13,017 просмотров • 1 год назад

We’ve been working tirelessly on something very special and can’t wait to share it 🫢 Take a sneak peek now and let us know what you think!
0:24

We’ve been working tirelessly on something very special and can’t wait to share it 🫢 Take a sneak peek now and let us know what you think!

Paste

17,900 просмотров • 3 лет назад

🚨 New model alert! Dialog by vibx — a leading text-to-speech model — now runs on GroqCloud™. That means natural-sounding speech with ultra-low latency, making real-time voice applications smoother and more responsive. Learn more &amp; build fast — links in the comments!
1:12

🚨 New model alert! Dialog by vibx — a leading text-to-speech model — now runs on GroqCloud™. That means natural-sounding speech with ultra-low latency, making real-time voice applications smoother and more responsive. Learn more &amp; build fast — links in the comments!

Groq Inc

47,183 просмотров • 1 год назад

Something we’ve been working on behind the scenes for a little while now…so excited to show this to you all! Get the 🍿 ready, we’ve got A LOT of content coming your way!
1:10

Something we’ve been working on behind the scenes for a little while now…so excited to show this to you all! Get the 🍿 ready, we’ve got A LOT of content coming your way!

Ian Poulter

58,814 просмотров • 1 год назад