Загрузка видео...

Не удалось загрузить видео

На главную

Today, Meta released Llama 3.2 unlocking capabilities to translate and dub videos on Reels automatically. The Gaia community is lightning-quick in putting new nodes to good use 🟣 Whisper (Speech to text) 🔵 Qwen 72b (Translation) 🟢 GPT-sovits (Text to speech) Currently, Meta only supports automatic translation from Spanish...

Gaianet_AI's profile picture

Gaia 🌱

418,676 subscribers

33,758 просмотров • 1 год назад •via X (Twitter)

Наука и технологииНовости и политикаОбразование
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 10

Фото профиля Kay
Kay1 год назад

@Meta #Gaia #GaianetAi #decentralizedAi Let's connect

Фото профиля Alsunder Atleta CLONE $MGT🌕👾
Alsunder Atleta CLONE $MGT🌕👾1 год назад

@Meta very powerful #Gaia #GaianetAi #decentralizedAi

Фото профиля Lidya (Ø,G) ꧁IP꧂
Lidya (Ø,G) ꧁IP꧂1 год назад

@Meta Go @din_lol_ Go @din_lol_ $koi

Фото профиля MR.DON $BEYOND💪💸💸
MR.DON $BEYOND💪💸💸1 год назад

@Meta The future of AI ✅💯#Gaia #GaiaNetAI #DecentralizedAI

Фото профиля Eva Crypto 🌱
Eva Crypto 🌱1 год назад

@Meta Hi, check my dm. Let’s connect

Фото профиля SpiderCrypto 🧑‍🍳🧲
SpiderCrypto 🧑‍🍳🧲1 год назад

@Meta How can i use this for the videos I make on x?

Фото профиля Young Sammy 💎
Young Sammy 💎1 год назад

@Meta Gaia stepping up what Meta does ⚡️ #Gaia #GaianetAi #decentralizedAi

Фото профиля CR.G 👁‍🗨.nad
CR.G 👁‍🗨.nad1 год назад

@Meta future together Gaanet #gaia #GaianetAi

Фото профиля yoyoh6969
yoyoh69691 год назад

@Meta Great updates and becoming more exciting each day. #Gaia #GaianetAi #DecentralizedAI

Фото профиля 0xnimu 🧙‍♂️,🧙‍♂️꧁IP꧂
0xnimu 🧙‍♂️,🧙‍♂️꧁IP꧂1 год назад

@Meta lets try Llama 3.2 unlocking capabilities #Gaia #GaianetAi #decentralizedAI

Похожие видео

Google presents AudioPaLM: A Large Language Model That Can Speak and Listen paper page: introduce AudioPaLM, a large language model for speech understanding and generation. AudioPaLM fuses text-based and speech-based language models, PaLM-2 [Anil et al., 2023] and AudioLM [Borsos et al., 2022], into a unified multimodal architecture that can process and generate text and speech with applications including speech recognition and speech-to-speech translation. AudioPaLM inherits the capability to preserve paralinguistic information such as speaker identity and intonation from AudioLM and the linguistic knowledge present only in text large language models such as PaLM-2. We demonstrate that initializing AudioPaLM with the weights of a text-only large language model improves speech processing, successfully leveraging the larger quantity of text training data used in pretraining to assist with the speech tasks. The resulting model significantly outperforms existing systems for speech translation tasks and has the ability to perform zero-shot speech-to-text translation for many languages for which input/target language combinations were not seen in training. AudioPaLM also demonstrates features of audio language models, such as transferring a voice across languages based on a short spoken prompt.
4:10

Google presents AudioPaLM: A Large Language Model That Can Speak and Listen paper page: introduce AudioPaLM, a large language model for speech understanding and generation. AudioPaLM fuses text-based and speech-based language models, PaLM-2 [Anil et al., 2023] and AudioLM [Borsos et al., 2022], into a unified multimodal architecture that can process and generate text and speech with applications including speech recognition and speech-to-speech translation. AudioPaLM inherits the capability to preserve paralinguistic information such as speaker identity and intonation from AudioLM and the linguistic knowledge present only in text large language models such as PaLM-2. We demonstrate that initializing AudioPaLM with the weights of a text-only large language model improves speech processing, successfully leveraging the larger quantity of text training data used in pretraining to assist with the speech tasks. The resulting model significantly outperforms existing systems for speech translation tasks and has the ability to perform zero-shot speech-to-text translation for many languages for which input/target language combinations were not seen in training. AudioPaLM also demonstrates features of audio language models, such as transferring a voice across languages based on a short spoken prompt.

AK

290,517 просмотров • 3 лет назад

🚨UPDATE: I never thought that Typing could get Typeless! Meet Typeless 1.0.2 for Mac that has made your voice so powerful. Dictate, Translate & Ask anything in any language or accent and #Typeless 1.0.2 will type it for you 10x faster with errors fixed. 1/ Dictation: With Typeless dictation, you'll get the smartest voice keyboard that understands your intent, helps organize thoughts, and turns your natural speech into clear, structured, perfect writing in every application. Press "Fn" Key to start and stop dictation. Or hold to say something short. 2/ Translation: With Typeless translation, you can talk in your own first language, and Typeless will translate it into any target language—empowering you to write in every foreign language just like a native speaker. "Fn" + "Space" Keys to Start Translation and "Fn" Key to stop translation. 3/ Ask Anything: With Typeless Ask Anything, you can use your voice to make edits to any selected text and simply say how you want to change it, get quick answers, and do quick actions. Press "Fn" + "Space" Keys to start ask anything and "Fn" stop asking anything.
8:26

🚨UPDATE: I never thought that Typing could get Typeless! Meet Typeless 1.0.2 for Mac that has made your voice so powerful. Dictate, Translate & Ask anything in any language or accent and #Typeless 1.0.2 will type it for you 10x faster with errors fixed. 1/ Dictation: With Typeless dictation, you'll get the smartest voice keyboard that understands your intent, helps organize thoughts, and turns your natural speech into clear, structured, perfect writing in every application. Press "Fn" Key to start and stop dictation. Or hold to say something short. 2/ Translation: With Typeless translation, you can talk in your own first language, and Typeless will translate it into any target language—empowering you to write in every foreign language just like a native speaker. "Fn" + "Space" Keys to Start Translation and "Fn" Key to stop translation. 3/ Ask Anything: With Typeless Ask Anything, you can use your voice to make edits to any selected text and simply say how you want to change it, get quick answers, and do quick actions. Press "Fn" + "Space" Keys to start ask anything and "Fn" stop asking anything.

Wesley

173,808 просмотров • 6 месяцев назад

Real-time translation that sounds like you 🚀 We've been building speech-to-speech simultaneous translation for a while. The newest piece is on-the-fly voice cloning: the model picks up your voice as you speak and carries it into the other language. Here's the alpha running live during our all-hands: you speak in Japanese, the room hears you in English, and it still sounds like you. It's early and the edges are rough, but this is the experience we've been building toward. Coming very soon. Demo video below 👇 #VoiceAI #SpeechAI #RealTimeTranslation #VoiceCloning #AI
1:29

Real-time translation that sounds like you 🚀 We've been building speech-to-speech simultaneous translation for a while. The newest piece is on-the-fly voice cloning: the model picks up your voice as you speak and carries it into the other language. Here's the alpha running live during our all-hands: you speak in Japanese, the room hears you in English, and it still sounds like you. It's early and the edges are rough, but this is the experience we've been building toward. Coming very soon. Demo video below 👇 #VoiceAI #SpeechAI #RealTimeTranslation #VoiceCloning #AI

Kotoba

68,392 просмотров • 5 дней назад

We will have around 2.5 hours of Chinese speech and and around half hour for different languages speakers. ( Most English). So please download your translator on your phone. I use Google translate voice translate. Or if you have a better one that will be great! If you can't join in or you can't understand, you can just listen to feel the energy. We are sorry we can't translate to English when we are in the meeting because there is too much information. We will translate to English soon after the conference. And you can translate to your language later. We will produce each speaker info and speech later to upload here. So you don't need to worry. But it will take some time. Thank you for your understanding and support 🙏🙏🙏 Best wishes! Pi Network #Pinetwork #PiGVV
1:07

We will have around 2.5 hours of Chinese speech and and around half hour for different languages speakers. ( Most English). So please download your translator on your phone. I use Google translate voice translate. Or if you have a better one that will be great! If you can't join in or you can't understand, you can just listen to feel the energy. We are sorry we can't translate to English when we are in the meeting because there is too much information. We will translate to English soon after the conference. And you can translate to your language later. We will produce each speaker info and speech later to upload here. So you don't need to worry. But it will take some time. Thank you for your understanding and support 🙏🙏🙏 Best wishes! Pi Network #Pinetwork #PiGVV

Doris Yin 东方紫莲🪷

20,625 просмотров • 3 лет назад

Today, we released Gemini 3.5 Live Translate, our latest audio model for live speech-to-speech translation. It supports over 70 languages and starts translating as soon as you start talking, streaming translations while listening to what you say next. No awkward pauses or choppy audio, just real connection without language barriers. So, how does it work? 🤔 The model is able to make split-second decisions to juggle speed and translation quality so conversations actually feel fluid, human, and natural. In order to do this, the model must receive and contextualize the input while simultaneously outputting the translated speech. Through this process, Gemini 3.5 Live Translate manages to stay mere seconds behind each speaker and can even maintain pacing, pitch, and intonation across extended sessions. See it in action below, or try it yourself in the Google Translate app on iOS & Android.
0:25

Today, we released Gemini 3.5 Live Translate, our latest audio model for live speech-to-speech translation. It supports over 70 languages and starts translating as soon as you start talking, streaming translations while listening to what you say next. No awkward pauses or choppy audio, just real connection without language barriers. So, how does it work? 🤔 The model is able to make split-second decisions to juggle speed and translation quality so conversations actually feel fluid, human, and natural. In order to do this, the model must receive and contextualize the input while simultaneously outputting the translated speech. Through this process, Gemini 3.5 Live Translate manages to stay mere seconds behind each speaker and can even maintain pacing, pitch, and intonation across extended sessions. See it in action below, or try it yourself in the Google Translate app on iOS & Android.

Google AI

3,987,895 просмотров • 2 месяцев назад

Typing just became… Typeless. Meet Typeless 1.0.2 for Mac — a tool that transforms your voice into clear, accurate writing across your Mac. Speak naturally and let Typeless handle the typing, corrections, and structure for you. With Typeless, you can dictate, translate, or ask for quick edits in any language or accent. It converts your speech into polished text up to 10× faster than traditional typing, while automatically fixing mistakes along the way. --- 1️⃣ Dictation Typeless acts as a powerful voice keyboard that works across all applications on your Mac. When you speak, it understands your intent, organizes your ideas, and converts your natural speech into well-structured writing. Whether you're drafting emails, notes, documents, or messages, Typeless helps you turn spoken thoughts into clean text instantly. Controls - Press Fn to start or stop dictation - Hold Fn for quick, short dictation --- 2️⃣ Translation Typeless makes writing in other languages effortless. You can speak in your native language and have Typeless translate your words instantly into the language you want. This allows you to communicate, write, and respond in foreign languages smoothly and naturally. Controls - Press Fn + Space to start translation - Press Fn to stop translation --- 3️⃣ Ask Anything Typeless Typeless also lets you interact with your text using voice commands. You can select any text and simply say how you want it changed. Typeless can edit, rewrite, answer questions, or perform quick actions based on your request, making editing and improving text much faster. Controls - Press Fn + Space to start Ask Anything - Press Fn to stop Ask Anything --- With Typeless, your voice becomes the fastest and easiest way to write, edit, and communicate on your Mac. Your voice is now your keyboard. Get Typeless → Available now on Mac, Windows, iOS, and Android. #Typeless
5:30

Typing just became… Typeless. Meet Typeless 1.0.2 for Mac — a tool that transforms your voice into clear, accurate writing across your Mac. Speak naturally and let Typeless handle the typing, corrections, and structure for you. With Typeless, you can dictate, translate, or ask for quick edits in any language or accent. It converts your speech into polished text up to 10× faster than traditional typing, while automatically fixing mistakes along the way. --- 1️⃣ Dictation Typeless acts as a powerful voice keyboard that works across all applications on your Mac. When you speak, it understands your intent, organizes your ideas, and converts your natural speech into well-structured writing. Whether you're drafting emails, notes, documents, or messages, Typeless helps you turn spoken thoughts into clean text instantly. Controls - Press Fn to start or stop dictation - Hold Fn for quick, short dictation --- 2️⃣ Translation Typeless makes writing in other languages effortless. You can speak in your native language and have Typeless translate your words instantly into the language you want. This allows you to communicate, write, and respond in foreign languages smoothly and naturally. Controls - Press Fn + Space to start translation - Press Fn to stop translation --- 3️⃣ Ask Anything Typeless Typeless also lets you interact with your text using voice commands. You can select any text and simply say how you want it changed. Typeless can edit, rewrite, answer questions, or perform quick actions based on your request, making editing and improving text much faster. Controls - Press Fn + Space to start Ask Anything - Press Fn to stop Ask Anything --- With Typeless, your voice becomes the fastest and easiest way to write, edit, and communicate on your Mac. Your voice is now your keyboard. Get Typeless → Available now on Mac, Windows, iOS, and Android. #Typeless

Kuria Chronicles

43,623 просмотров • 5 месяцев назад

🚨 Darlington Council has signed off TWELVE translation contracts worth up to £720,000. Seriously, why?! Darlington has around 107,000 residents. Roughly 8,400 weren’t born in the UK. And of course, many of those people will speak English. Yet somehow the council has signed off 12 separate translation contracts worth up to £60,000 each. No wonder the council is £170m in debt! Then remember… We all carry a device in our pocket that can translate almost any language in seconds for free. Yet our public sector continues spending tens of millions on translation every year. Honestly… what are we doing?
1:16

🚨 Darlington Council has signed off TWELVE translation contracts worth up to £720,000. Seriously, why?! Darlington has around 107,000 residents. Roughly 8,400 weren’t born in the UK. And of course, many of those people will speak English. Yet somehow the council has signed off 12 separate translation contracts worth up to £60,000 each. No wonder the council is £170m in debt! Then remember… We all carry a device in our pocket that can translate almost any language in seconds for free. Yet our public sector continues spending tens of millions on translation every year. Honestly… what are we doing?

Lee Nallalingham

105,127 просмотров • 1 месяц назад

Ok I've used Codex 5.4 Extra High for something that saved me so many hours and thousands of dollars and may interest you: -> how I automatically translate my game in 9 languages 1) I did the whole game in English, with no localization in mind 2) Then everybody told me that the reach is way higher by adding local languages 3) So I had a long chat with Codex to write a great spec to build a localization interface and super simple process for afterwards (I want to keep the simplicity) 4) Then translated the game in 9 languages! 5) Every localization is challenged a second time to improve 6) We are talking 580 keys per language - it took 1h35 to find all the hardcoded text and add keys - then it took 1h15 min to do all v1 translations 7) BONUS: it translates automatically all audio with ElevenLabs (using their text to speech skill) Total: Roughly 3 hours to implement a translation system and to translate the game Can any Japanese person tell me if the translation is good? There were 2 challenges: - translating once - keeping the game translated Now it's a blessing: I still work on the game like the usual, and if I add new text, it will automatically create the keys and translate in all languages just with basic instructions in Agents.md + a pre-commit hook to ensure it's done. I hope to use the tool for a professional or community-based human review in the future! Hope it helps:)
1:04

Ok I've used Codex 5.4 Extra High for something that saved me so many hours and thousands of dollars and may interest you: -> how I automatically translate my game in 9 languages 1) I did the whole game in English, with no localization in mind 2) Then everybody told me that the reach is way higher by adding local languages 3) So I had a long chat with Codex to write a great spec to build a localization interface and super simple process for afterwards (I want to keep the simplicity) 4) Then translated the game in 9 languages! 5) Every localization is challenged a second time to improve 6) We are talking 580 keys per language - it took 1h35 to find all the hardcoded text and add keys - then it took 1h15 min to do all v1 translations 7) BONUS: it translates automatically all audio with ElevenLabs (using their text to speech skill) Total: Roughly 3 hours to implement a translation system and to translate the game Can any Japanese person tell me if the translation is good? There were 2 challenges: - translating once - keeping the game translated Now it's a blessing: I still work on the game like the usual, and if I add new text, it will automatically create the keys and translate in all languages just with basic instructions in Agents.md + a pre-commit hook to ensure it's done. I hope to use the tool for a professional or community-based human review in the future! Hope it helps:)

Nicolas Zullo

13,418 просмотров • 4 месяцев назад

The future of DeFi is DeFAI 🟧 $ANON is at the forefront of this with our main goal of making DeFi easy to access & use FOR EVERYONE (DeFi is bigger then just you and me). Which is why Hey Anon currently supports multiple languages, including Korean, Chinese, Spanish, Italian, Portuguese, Turkish, Japanese, and Finnish & we're currently working on expanding to support all languages. Currently it can understand inputs in these languages but defaults to responding in English. The team is working on enhancing language features, such as adding natural language voice support for both anon & Gemma AI.
1:25

The future of DeFi is DeFAI 🟧 $ANON is at the forefront of this with our main goal of making DeFi easy to access & use FOR EVERYONE (DeFi is bigger then just you and me). Which is why Hey Anon currently supports multiple languages, including Korean, Chinese, Spanish, Italian, Portuguese, Turkish, Japanese, and Finnish & we're currently working on expanding to support all languages. Currently it can understand inputs in these languages but defaults to responding in English. The team is working on enhancing language features, such as adding natural language voice support for both anon & Gemma AI.

Daniele 🟧 ( Meme Quant )

56,011 просмотров • 1 год назад

Text-to-speech is moving way too fast. Just a few days ago, I tweeted about PersonaPlex-7B, NVIDIA's new open source TTS ( And today, Qwen just open-sourced Qwen3-TTS 🤯 It’s a revolutionary text-to-speech model built for control. Not just about generating speech, but about shaping how it sounds directly from language. You can guide the pace, the tone, and the expressiveness straight from text, without touching audio graphs or hand-tuning parameters. That’s the real shift! What makes Qwen3-TTS stand out is how practical it already is: → voice cloning from just a few seconds of audio → voice creation without any reference sample → support for 10 languages out of the box → end-to-end latency down to ~97ms → works in both streaming and non-streaming setups The models come in two sizes (0.6B and 1.7B), so you can trade off quality and hardware cost depending on your setup. You can work with curated voices, designed voices, or cloned ones, and it integrates cleanly with vLLM for production use. It also ships as a simple Python package you can pip install. If you’re building real-time voice systems, this removes a lot of friction! 100% free and open source. I put the repo in the 🧵↓
0:41

Text-to-speech is moving way too fast. Just a few days ago, I tweeted about PersonaPlex-7B, NVIDIA's new open source TTS ( And today, Qwen just open-sourced Qwen3-TTS 🤯 It’s a revolutionary text-to-speech model built for control. Not just about generating speech, but about shaping how it sounds directly from language. You can guide the pace, the tone, and the expressiveness straight from text, without touching audio graphs or hand-tuning parameters. That’s the real shift! What makes Qwen3-TTS stand out is how practical it already is: → voice cloning from just a few seconds of audio → voice creation without any reference sample → support for 10 languages out of the box → end-to-end latency down to ~97ms → works in both streaming and non-streaming setups The models come in two sizes (0.6B and 1.7B), so you can trade off quality and hardware cost depending on your setup. You can work with curated voices, designed voices, or cloned ones, and it integrates cleanly with vLLM for production use. It also ships as a simple Python package you can pip install. If you’re building real-time voice systems, this removes a lot of friction! 100% free and open source. I put the repo in the 🧵↓

Charly Wargnier

59,144 просмотров • 7 месяцев назад

BUILD 🔥: Microsoft is preparing new image and voice models for the announcement on June 2. > MAI Voice 2, a multilingual model supporting 15 news languages and a wider range of emotional spectrum (check voice samples in the article) > MAI Transcribe 1.5, a new model for speech-to-text use cases. > MAI Image 2.5, already announced last week, is now available on LM Arena in preview. Compared to MAI Image 2, it supports file uploads and can be used for image editing.
0:40

BUILD 🔥: Microsoft is preparing new image and voice models for the announcement on June 2. > MAI Voice 2, a multilingual model supporting 15 news languages and a wider range of emotional spectrum (check voice samples in the article) > MAI Transcribe 1.5, a new model for speech-to-text use cases. > MAI Image 2.5, already announced last week, is now available on LM Arena in preview. Compared to MAI Image 2, it supports file uploads and can be used for image editing.

🚨 AI News | TestingCatalog

46,535 просмотров • 3 месяцев назад

Left Kemi Badenoch talks about the first community of Jews in the Manchester back in the 1780s Right: The first English translation of the Quran was in 1649 by Alexander Ross, and a 1641 document refers to "a sect of Mahomatens" being "discovered here in London" Badenoch is trying to paint a close relationship with the UK and Judiasm, but choses not to refer to the close relationship between the UK and Muslims Just as Badenoch chose to refer to the attack on the Synagogue in her speech, but chose to ignore a mosque being set alight in her speech I'm actually quite happy and excited to learn of the history of the early Jewish communities, because our diversity makes us richer and better as a nation living together in peace I just find it really sad that Badenoch is choosing a narrative that seeks to divide the nation instead of one that seeks to unite the nation For anyone interested, you can read the first ever English translation of the Quran, but an Englishman at this link
0:27

Left Kemi Badenoch talks about the first community of Jews in the Manchester back in the 1780s Right: The first English translation of the Quran was in 1649 by Alexander Ross, and a 1641 document refers to "a sect of Mahomatens" being "discovered here in London" Badenoch is trying to paint a close relationship with the UK and Judiasm, but choses not to refer to the close relationship between the UK and Muslims Just as Badenoch chose to refer to the attack on the Synagogue in her speech, but chose to ignore a mosque being set alight in her speech I'm actually quite happy and excited to learn of the history of the early Jewish communities, because our diversity makes us richer and better as a nation living together in peace I just find it really sad that Badenoch is choosing a narrative that seeks to divide the nation instead of one that seeks to unite the nation For anyone interested, you can read the first ever English translation of the Quran, but an Englishman at this link

Farrukh

191,605 просмотров • 10 месяцев назад

I built an app that makes it easy to caption and translate clips while preserving the original voice. built for global communities and the creators who help them grow. a town hall can’t fit every timezone. for example, “Meet at the Clubhouse” by Bored Ape Yacht Club 🍌 or the “OG Show” by Grateful Ape🍌 + Other Games are digital social experiences I can’t attend live due to scheduling. so communities and myself run on replays, highlights, and clipped moments. creators need tools to capture these cultural moments in audio easily and it deserves to travel farther than one language. now it’s even possible to cross language barriers without losing the speaker’s voice. dubbing is powered by ElevenLabs, which I believe is leading in frontier voice and speech models. community creators and ambassadors can localize moments that matter most, making important updates easier to understand in their audience’s native language. and even without dubbing & translation, it’s great to make beautifully designed audiograms. private beta at the moment. public soon. so what do you think? does it translate well to your language? worth building out further? let me know
1:00

I built an app that makes it easy to caption and translate clips while preserving the original voice. built for global communities and the creators who help them grow. a town hall can’t fit every timezone. for example, “Meet at the Clubhouse” by Bored Ape Yacht Club 🍌 or the “OG Show” by Grateful Ape🍌 + Other Games are digital social experiences I can’t attend live due to scheduling. so communities and myself run on replays, highlights, and clipped moments. creators need tools to capture these cultural moments in audio easily and it deserves to travel farther than one language. now it’s even possible to cross language barriers without losing the speaker’s voice. dubbing is powered by ElevenLabs, which I believe is leading in frontier voice and speech models. community creators and ambassadors can localize moments that matter most, making important updates easier to understand in their audience’s native language. and even without dubbing & translation, it’s great to make beautifully designed audiograms. private beta at the moment. public soon. so what do you think? does it translate well to your language? worth building out further? let me know

NANA

12,397 просмотров • 1 месяц назад

Today, we’re thrilled to introduce GAIA, a modular creation engine for the AI age. At its core, GAIA is a multiplayer creation engine designed to bring democratized Generative AI abilities to everyone, hence its name. It abstracts away the complexities of leveraging open-source software, hardware requirements, and technical intricacies, allowing creators to focus solely on creating, together. GAIA has been instrumental in powering the imagination and creative works of our studio, significantly boosting productivity, collaboration, and creativity. It has saved our team thousands of man-days in production work, enabling us to dream bigger, bolder, and execute more swiftly. When used by experienced creators, GAIA, with its ever-growing toolsets built by core contributors, stands to be the best AI creative co-pilot for industry-specific production workflows—from gaming to fashion, and from personal consumption to real estate renderings. GAIA's self-reinforcing flywheel is poised to dramatically enhance the platform's capabilities in both the near and long term: The cost of GPUs and compute will continue to improve. Open-source AI models are becoming increasingly powerful over time, as seen by the evolution from Stable Diffusion 1 to Lightning, alongside other impressive OSS creations like AnimateDiff, LoRAs, and ControlNet. The architecture of AI workflows will become more fine-grained, allowing exponentially increasing control over final outputs. The data and connections that AI workflows can make, both in-app and out-of-app, will grow more sophisticated. GAIA already allows for the chaining of Generative Image AI recipes, grouping complex node-based programs into simple consumer-facing interfaces. Soon, with multi-modality workflows, creators will be able to leverage not only images but also text and sound to create even more complex workflows. Today is the least capable GAIA will ever be. It already provides superpowers unachievable by many creators who know how to harness them. We have an extremely exciting backlog of features lined up, starting with social features. Our mission as Ather Collective core contributors is to get GAIA into the hands of as many creators and businesses as possible. While we believe in e/acc, our north star for Ather Collective remains: Equitable, Accessible, Composable, and Collaborative. If you would like to be a part of the early access users of GAIA, please register using this link: Our team will open up capacity as soon as we are able to. There is only one way AI benefits humanity, and that’s through open AI. Let’s be a part of it. ✌🏻
0:50

Today, we’re thrilled to introduce GAIA, a modular creation engine for the AI age. At its core, GAIA is a multiplayer creation engine designed to bring democratized Generative AI abilities to everyone, hence its name. It abstracts away the complexities of leveraging open-source software, hardware requirements, and technical intricacies, allowing creators to focus solely on creating, together. GAIA has been instrumental in powering the imagination and creative works of our studio, significantly boosting productivity, collaboration, and creativity. It has saved our team thousands of man-days in production work, enabling us to dream bigger, bolder, and execute more swiftly. When used by experienced creators, GAIA, with its ever-growing toolsets built by core contributors, stands to be the best AI creative co-pilot for industry-specific production workflows—from gaming to fashion, and from personal consumption to real estate renderings. GAIA's self-reinforcing flywheel is poised to dramatically enhance the platform's capabilities in both the near and long term: The cost of GPUs and compute will continue to improve. Open-source AI models are becoming increasingly powerful over time, as seen by the evolution from Stable Diffusion 1 to Lightning, alongside other impressive OSS creations like AnimateDiff, LoRAs, and ControlNet. The architecture of AI workflows will become more fine-grained, allowing exponentially increasing control over final outputs. The data and connections that AI workflows can make, both in-app and out-of-app, will grow more sophisticated. GAIA already allows for the chaining of Generative Image AI recipes, grouping complex node-based programs into simple consumer-facing interfaces. Soon, with multi-modality workflows, creators will be able to leverage not only images but also text and sound to create even more complex workflows. Today is the least capable GAIA will ever be. It already provides superpowers unachievable by many creators who know how to harness them. We have an extremely exciting backlog of features lined up, starting with social features. Our mission as Ather Collective core contributors is to get GAIA into the hands of as many creators and businesses as possible. While we believe in e/acc, our north star for Ather Collective remains: Equitable, Accessible, Composable, and Collaborative. If you would like to be a part of the early access users of GAIA, please register using this link: Our team will open up capacity as soon as we are able to. There is only one way AI benefits humanity, and that’s through open AI. Let’s be a part of it. ✌🏻

TIN | Sipher Odyssey & Ather Labs

14,194 просмотров • 2 лет назад

Today we're announcing #GAIA1: a 9B parameter world model, trained on 4,700 hours of driving data, able to simulate complex and diverse driving scenes from video, text and action inputs. This model is 480x larger than the preview we shared earlier this year and the results are incredible. These videos are entirely synthetically generated by Wayve's generative AI, GAIA-1. But there is more here than just generating videos, GAIA is an entire world model. A world model allows us to simulate the future, conditioned on video, text and action inputs, which can be leveraged for making informed decisions when driving. Why is this game-changing for autonomous driving? 1. Safety. One limitation with AI systems like today's Large Language Models is that they are autoregressive, next-word prediction algorithms, but aren't necessarily aware of the implications of their decisions. A world model allows us to give our AI the capability to be aware of its decisions, by simulating the future, which is important for self-driving safety. 2. Synthetic training data. I believe synthetic training data is the future for AI, because it is safer, cheaper, and infinitely scalable. GAIA-1 unlocks unprecedented realism and diversity of synthetic data for self-driving. 3. Long-tail robustness. One of the biggest challenges for self-driving is long-tail robustness: dealing with the enormous magnitude of edge cases we see on the road. An advantage of generative AI is its incredible ability to recombine experiences in new ways. This is exciting for self-driving as it means we can learn from two edge case scenarios, and combine them to become a corner case. For example, we can experience driving in fog, and experience of jay-walking pedestrians, and GAIA can learn from these experiences to understand how to generate a fog+jay walking scenario. Check out many more videos in our blog or further technical details in our paper: Or come chat with our team who are at the International Conference on Computer Vision (#ICCV2023) this week in Paris in Booth 32 Jamie Shotton
0:41

Today we're announcing #GAIA1: a 9B parameter world model, trained on 4,700 hours of driving data, able to simulate complex and diverse driving scenes from video, text and action inputs. This model is 480x larger than the preview we shared earlier this year and the results are incredible. These videos are entirely synthetically generated by Wayve's generative AI, GAIA-1. But there is more here than just generating videos, GAIA is an entire world model. A world model allows us to simulate the future, conditioned on video, text and action inputs, which can be leveraged for making informed decisions when driving. Why is this game-changing for autonomous driving? 1. Safety. One limitation with AI systems like today's Large Language Models is that they are autoregressive, next-word prediction algorithms, but aren't necessarily aware of the implications of their decisions. A world model allows us to give our AI the capability to be aware of its decisions, by simulating the future, which is important for self-driving safety. 2. Synthetic training data. I believe synthetic training data is the future for AI, because it is safer, cheaper, and infinitely scalable. GAIA-1 unlocks unprecedented realism and diversity of synthetic data for self-driving. 3. Long-tail robustness. One of the biggest challenges for self-driving is long-tail robustness: dealing with the enormous magnitude of edge cases we see on the road. An advantage of generative AI is its incredible ability to recombine experiences in new ways. This is exciting for self-driving as it means we can learn from two edge case scenarios, and combine them to become a corner case. For example, we can experience driving in fog, and experience of jay-walking pedestrians, and GAIA can learn from these experiences to understand how to generate a fog+jay walking scenario. Check out many more videos in our blog or further technical details in our paper: Or come chat with our team who are at the International Conference on Computer Vision (#ICCV2023) this week in Paris in Booth 32 Jamie Shotton

Alex Kendall

631,869 просмотров • 2 лет назад

💡 What is a Gaia Domain?! Gaia Domains were created to make AI infrastructure truly sovereign. Each domain is a programmable environment you own and control on-chain, where your logic, models, and data stay in your hands at all times. With Gaia, you set the rules: choose which AI agents to deploy, configure your workflows, and decide how others can interact with your domain. Domains integrate seamlessly with smart contracts, other domains, and a wide range of decentralized tools is simple and secure. Every part of your domain operates on Gaia’s decentralized node network, protecting your work from centralized servers or closed AI systems. Thankfully, getting started is quick. Domains are ready out of the box with open-source language models and SDKs, so you can launch and iterate fast. Their modular design makes them easy to adapt, and EVM compatibility means they fit right into the broader DeAI ecosystem. Earning is built in at every step: you can run services, sell access, or enable delegated tasks with all transactions managed on-chain for total transparency. Gaia Domains open new ground for developers, DAOs, founders, researchers, and enterprises seeking to decentralize their AI stack. Questions? Reach out to our DevRels Tobiloba 🦀 Harish Kotra 🥑 meowy🦀! Get started here: In this video, Tobiloba 🦀 demonstrates how to integrate Gaia's public domains for AI agents, applications, chatbots, and frameworks, or even interact directly via the Gaia chat UI 🔽
8:25

💡 What is a Gaia Domain?! Gaia Domains were created to make AI infrastructure truly sovereign. Each domain is a programmable environment you own and control on-chain, where your logic, models, and data stay in your hands at all times. With Gaia, you set the rules: choose which AI agents to deploy, configure your workflows, and decide how others can interact with your domain. Domains integrate seamlessly with smart contracts, other domains, and a wide range of decentralized tools is simple and secure. Every part of your domain operates on Gaia’s decentralized node network, protecting your work from centralized servers or closed AI systems. Thankfully, getting started is quick. Domains are ready out of the box with open-source language models and SDKs, so you can launch and iterate fast. Their modular design makes them easy to adapt, and EVM compatibility means they fit right into the broader DeAI ecosystem. Earning is built in at every step: you can run services, sell access, or enable delegated tasks with all transactions managed on-chain for total transparency. Gaia Domains open new ground for developers, DAOs, founders, researchers, and enterprises seeking to decentralize their AI stack. Questions? Reach out to our DevRels Tobiloba 🦀 Harish Kotra 🥑 meowy🦀! Get started here: In this video, Tobiloba 🦀 demonstrates how to integrate Gaia's public domains for AI agents, applications, chatbots, and frameworks, or even interact directly via the Gaia chat UI 🔽

Gaia 🌱

15,830 просмотров • 1 год назад

OpenAI shipped a new speech-to-speech model today: gpt-realtime-2 This is the first speech-to-speech model good enough to use in my voice agents that do "real work." Or real play, for that matter. Here's gpt-realtime-2 as the brain of the ship AI in Gradient Bang. The voice-to-voice response and tool calling times here are unedited, so you can see exactly what the interaction with the model is like in an agent with a very complex system instruction and frequent tool calls. (I did clip out the subagent task execution segments, after gpt-realtime-2 starts a subagent via a tool call. Subagents in this config used gpt-5.2 "medium" effort.)
3:13

OpenAI shipped a new speech-to-speech model today: gpt-realtime-2 This is the first speech-to-speech model good enough to use in my voice agents that do "real work." Or real play, for that matter. Here's gpt-realtime-2 as the brain of the ship AI in Gradient Bang. The voice-to-voice response and tool calling times here are unedited, so you can see exactly what the interaction with the model is like in an agent with a very complex system instruction and frequent tool calls. (I did clip out the subagent task execution segments, after gpt-realtime-2 starts a subagent via a tool call. Subagents in this config used gpt-5.2 "medium" effort.)

kwindla

55,222 просмотров • 3 месяцев назад

I may speak in Hindi, I may speak in English, I may speak in Telugu or I may speak in Tamil. How does it matter to the Hon'ble MP? Because now, with the arrangements made by the Hon’ble Speaker, he can get the translation in any language that he desires. So what is this argument that “she spoke in Hindi, therefore I can’t understand?" The facilities are available. Technology has been used. He can understand in any language he wants. But because he has not read the Bill thoroughly and because he wants to divert from the topic, he is bringing all these things and I take objection to it. - Smt Nirmala Sitharaman in Lok Sabha.
1:29

I may speak in Hindi, I may speak in English, I may speak in Telugu or I may speak in Tamil. How does it matter to the Hon'ble MP? Because now, with the arrangements made by the Hon’ble Speaker, he can get the translation in any language that he desires. So what is this argument that “she spoke in Hindi, therefore I can’t understand?" The facilities are available. Technology has been used. He can understand in any language he wants. But because he has not read the Bill thoroughly and because he wants to divert from the topic, he is bringing all these things and I take objection to it. - Smt Nirmala Sitharaman in Lok Sabha.

Nirmala Sitharaman Office

294,960 просмотров • 8 месяцев назад

Mati Staniszewski on why ElevenLabs is betting on a cascaded approach for voice agents: “Our approach, as you think about voice agents, conversational agents, is effectively a cascaded approach. You use transcription or speech-to-text, an LLM, text-to-speech, and orchestrate all of that together. Then you have speech-to-speech, which goes directly from speech, and there’s a speech response on the other side. Today, we are optimizing heavily on a cascaded approach. As we work with a lot of the businesses and enterprises, they will need that visibility into what happens. They will want to execute certain tasks on top of that. They want good visibility into each of the steps and great accuracy of all the models. But beyond that, they can abstract away what’s the LLM layer, what’s the intelligence layer, and the integrations are easier in that system. That’s where we are betting a lot of the research work on how you can make that great, and we think we can make that great.” John Collison @matiii ElevenLabs
1:09

Mati Staniszewski on why ElevenLabs is betting on a cascaded approach for voice agents: “Our approach, as you think about voice agents, conversational agents, is effectively a cascaded approach. You use transcription or speech-to-text, an LLM, text-to-speech, and orchestrate all of that together. Then you have speech-to-speech, which goes directly from speech, and there’s a speech response on the other side. Today, we are optimizing heavily on a cascaded approach. As we work with a lot of the businesses and enterprises, they will need that visibility into what happens. They will want to execute certain tasks on top of that. They want good visibility into each of the steps and great accuracy of all the models. But beyond that, they can abstract away what’s the LLM layer, what’s the intelligence layer, and the integrations are easier in that system. That’s where we are betting a lot of the research work on how you can make that great, and we think we can make that great.” John Collison @matiii ElevenLabs

Stripe

18,535 просмотров • 4 месяцев назад

Today is a good day for open science. As part of our continued commitment to the growth and development of an open ecosystem, today at Meta FAIR we’re announcing four new publicly available AI models and additional research artifacts to inspire innovation in the community and help advance AI in a responsible way. More in the video from Joelle Pineau. What we’re releasing: 🦎 Meta Chameleon 7B & 34B language models that support mixed-modal input and text-only outputs. 🪙 Meta Multi-Token Prediction Pretrained Language Models for code completion using Multi-Token Prediction. 🎼 Meta JASCO Generative text-to-music models capable of accepting various conditioning inputs for greater controllability. Paper available today with a pretrained model coming soon. 🗣️ Meta AudioSeal An audio watermarking model that we believe is the first designed specifically for the localized detection of AI-generated speech, available under a commercial license. 📝 Additional RAI artifacts Including research, data and code to measure and improve the representation of geographical and cultural preferences and diversity in AI systems. We believe that access to state-of-the-art AI creates opportunities for everyone – not just a small handful of Big Tech companies. We’re excited to share this work and to see how the community learns, iterates and builds using this technology. Details and access to everything released by FAIR today ➡️
1:14

Today is a good day for open science. As part of our continued commitment to the growth and development of an open ecosystem, today at Meta FAIR we’re announcing four new publicly available AI models and additional research artifacts to inspire innovation in the community and help advance AI in a responsible way. More in the video from Joelle Pineau. What we’re releasing: 🦎 Meta Chameleon 7B & 34B language models that support mixed-modal input and text-only outputs. 🪙 Meta Multi-Token Prediction Pretrained Language Models for code completion using Multi-Token Prediction. 🎼 Meta JASCO Generative text-to-music models capable of accepting various conditioning inputs for greater controllability. Paper available today with a pretrained model coming soon. 🗣️ Meta AudioSeal An audio watermarking model that we believe is the first designed specifically for the localized detection of AI-generated speech, available under a commercial license. 📝 Additional RAI artifacts Including research, data and code to measure and improve the representation of geographical and cultural preferences and diversity in AI systems. We believe that access to state-of-the-art AI creates opportunities for everyone – not just a small handful of Big Tech companies. We’re excited to share this work and to see how the community learns, iterates and builds using this technology. Details and access to everything released by FAIR today ➡️

AI at Meta

380,978 просмотров • 2 лет назад