Загрузка видео...
Не удалось загрузить видео
OpenAI's S2S preview is polished but it still thinks in steps. Speech → text → model → text → speech. That's not how humans converse. Introducing Hydra. A native speech-to-speech model that doesn't wait for turn-taking, doesn't flatten emotion into text, and doesn't break when you interrupt it mid-sentence.... show more
329,032 просмотров • 6 месяцев назад •via X (Twitter)
Комментарии: 0
Нет доступных комментариев
Здесь появятся комментарии из оригинального поста
![Google presents AudioPaLM: A Large Language Model That Can Speak and Listen paper page: introduce AudioPaLM, a large language model for speech understanding and generation. AudioPaLM fuses text-based and speech-based language models, PaLM-2 [Anil et al., 2023] and AudioLM [Borsos et al., 2022], into a unified multimodal architecture that can process and generate text and speech with applications including speech recognition and speech-to-speech translation. AudioPaLM inherits the capability to preserve paralinguistic information such as speaker identity and intonation from AudioLM and the linguistic knowledge present only in text large language models such as PaLM-2. We demonstrate that initializing AudioPaLM with the weights of a text-only large language model improves speech processing, successfully leveraging the larger quantity of text training data used in pretraining to assist with the speech tasks. The resulting model significantly outperforms existing systems for speech translation tasks and has the ability to perform zero-shot speech-to-text translation for many languages for which input/target language combinations were not seen in training. AudioPaLM also demonstrates features of audio language models, such as transferring a voice across languages based on a short spoken prompt.](https://image.24vids.com/tw-1672048076469698561/ext_tw_video_thumb/1672047839378300928/pu/img/MuoOBsAyUd-HAI7D.jpg)
![.Andrew Doyle: “If you look at all the various definitions of hate speech across European statute books, none of them agree. No one knows what it is really.” The concept of hate speech is being used to erode free speech across Europe, argues comedian and writer Andrew Doyle, author of “Free Speech and Why It Matters.” “No one can define hate speech. No one knows what it means. And [yes] human beings hate. That's an emotion that has developed in us over many, many years. You can't wish away a human emotion with the stroke of a pen. You may as well try and legislate against envy. It doesn't make sense,” he says. “People [are] trying to eliminate free speech or draw their own exceptions or carve out exceptions. That's why the First Amendment—even though it's a great protection—is not invulnerable to attack or modification or misinterpretation. All of that can still happen.” Free speech, he says, is never something that’s won, it’s something that needs to be fought for always.](https://image.24vids.com/tw-2005646550840508745/amplify_video_thumb/2005645811594436608/img/iUCllLJi4gVJeaXO.jpg)
