Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Today, Meta released Llama 3.2 unlocking capabilities to translate and dub videos on Reels automatically. The Gaia community is lightning-quick in putting new nodes to good use 🟣 Whisper (Speech to text) 🔵 Qwen 72b (Translation) 🟢 GPT-sovits (Text to speech) Currently, Meta only supports automatic translation from Spanish...

Gaianet_AI's profile picture

Gaia 🌱

424,264 subscribers

33,701 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & TechnologieNachrichten & PolitikBildung
LIVE

Anya Rossi• Live Now

Private livecam show

10 Kommentare

Profilbild von Kay
Kayvor 1 Jahr

@Meta #Gaia #GaianetAi #decentralizedAi Let's connect

Profilbild von Alsunder Atleta CLONE $MGT🌕👾
Alsunder Atleta CLONE $MGT🌕👾vor 1 Jahr

@Meta very powerful #Gaia #GaianetAi #decentralizedAi

Profilbild von Lidya (Ø,G) ꧁IP꧂
Lidya (Ø,G) ꧁IP꧂vor 1 Jahr

@Meta Go @din_lol_ Go @din_lol_ $koi

Profilbild von MR.DON $BEYOND💪💸💸
MR.DON $BEYOND💪💸💸vor 1 Jahr

@Meta The future of AI ✅💯#Gaia #GaiaNetAI #DecentralizedAI

Profilbild von Eva Crypto 🌱
Eva Crypto 🌱vor 1 Jahr

@Meta Hi, check my dm. Let’s connect

Profilbild von SpiderCrypto 🧑‍🍳🧲
SpiderCrypto 🧑‍🍳🧲vor 1 Jahr

@Meta How can i use this for the videos I make on x?

Profilbild von Young Sammy 💎
Young Sammy 💎vor 1 Jahr

@Meta Gaia stepping up what Meta does ⚡️ #Gaia #GaianetAi #decentralizedAi

Profilbild von CR.G 👁‍🗨.nad
CR.G 👁‍🗨.nadvor 1 Jahr

@Meta future together Gaanet #gaia #GaianetAi

Profilbild von yoyoh6969
yoyoh6969vor 1 Jahr

@Meta Great updates and becoming more exciting each day. #Gaia #GaianetAi #DecentralizedAI

Profilbild von 0xnimu 🧙‍♂️,🧙‍♂️꧁IP꧂
0xnimu 🧙‍♂️,🧙‍♂️꧁IP꧂vor 1 Jahr

@Meta lets try Llama 3.2 unlocking capabilities #Gaia #GaianetAi #decentralizedAI

Ähnliche Videos

Google presents AudioPaLM: A Large Language Model That Can Speak and Listen paper page: introduce AudioPaLM, a large language model for speech understanding and generation. AudioPaLM fuses text-based and speech-based language models, PaLM-2 [Anil et al., 2023] and AudioLM [Borsos et al., 2022], into a unified multimodal architecture that can process and generate text and speech with applications including speech recognition and speech-to-speech translation. AudioPaLM inherits the capability to preserve paralinguistic information such as speaker identity and intonation from AudioLM and the linguistic knowledge present only in text large language models such as PaLM-2. We demonstrate that initializing AudioPaLM with the weights of a text-only large language model improves speech processing, successfully leveraging the larger quantity of text training data used in pretraining to assist with the speech tasks. The resulting model significantly outperforms existing systems for speech translation tasks and has the ability to perform zero-shot speech-to-text translation for many languages for which input/target language combinations were not seen in training. AudioPaLM also demonstrates features of audio language models, such as transferring a voice across languages based on a short spoken prompt.
4:10

Google presents AudioPaLM: A Large Language Model That Can Speak and Listen paper page: introduce AudioPaLM, a large language model for speech understanding and generation. AudioPaLM fuses text-based and speech-based language models, PaLM-2 [Anil et al., 2023] and AudioLM [Borsos et al., 2022], into a unified multimodal architecture that can process and generate text and speech with applications including speech recognition and speech-to-speech translation. AudioPaLM inherits the capability to preserve paralinguistic information such as speaker identity and intonation from AudioLM and the linguistic knowledge present only in text large language models such as PaLM-2. We demonstrate that initializing AudioPaLM with the weights of a text-only large language model improves speech processing, successfully leveraging the larger quantity of text training data used in pretraining to assist with the speech tasks. The resulting model significantly outperforms existing systems for speech translation tasks and has the ability to perform zero-shot speech-to-text translation for many languages for which input/target language combinations were not seen in training. AudioPaLM also demonstrates features of audio language models, such as transferring a voice across languages based on a short spoken prompt.

AK

290,517 Aufrufe • vor 3 Jahren

🚨UPDATE: I never thought that Typing could get Typeless! Meet Typeless 1.0.2 for Mac that has made your voice so powerful. Dictate, Translate & Ask anything in any language or accent and #Typeless 1.0.2 will type it for you 10x faster with errors fixed. 1/ Dictation: With Typeless dictation, you'll get the smartest voice keyboard that understands your intent, helps organize thoughts, and turns your natural speech into clear, structured, perfect writing in every application. Press "Fn" Key to start and stop dictation. Or hold to say something short. 2/ Translation: With Typeless translation, you can talk in your own first language, and Typeless will translate it into any target language—empowering you to write in every foreign language just like a native speaker. "Fn" + "Space" Keys to Start Translation and "Fn" Key to stop translation. 3/ Ask Anything: With Typeless Ask Anything, you can use your voice to make edits to any selected text and simply say how you want to change it, get quick answers, and do quick actions. Press "Fn" + "Space" Keys to start ask anything and "Fn" stop asking anything.
8:26

🚨UPDATE: I never thought that Typing could get Typeless! Meet Typeless 1.0.2 for Mac that has made your voice so powerful. Dictate, Translate & Ask anything in any language or accent and #Typeless 1.0.2 will type it for you 10x faster with errors fixed. 1/ Dictation: With Typeless dictation, you'll get the smartest voice keyboard that understands your intent, helps organize thoughts, and turns your natural speech into clear, structured, perfect writing in every application. Press "Fn" Key to start and stop dictation. Or hold to say something short. 2/ Translation: With Typeless translation, you can talk in your own first language, and Typeless will translate it into any target language—empowering you to write in every foreign language just like a native speaker. "Fn" + "Space" Keys to Start Translation and "Fn" Key to stop translation. 3/ Ask Anything: With Typeless Ask Anything, you can use your voice to make edits to any selected text and simply say how you want to change it, get quick answers, and do quick actions. Press "Fn" + "Space" Keys to start ask anything and "Fn" stop asking anything.

Wesley

173,808 Aufrufe • vor 5 Monaten

We will have around 2.5 hours of Chinese speech and and around half hour for different languages speakers. ( Most English). So please download your translator on your phone. I use Google translate voice translate. Or if you have a better one that will be great! If you can't join in or you can't understand, you can just listen to feel the energy. We are sorry we can't translate to English when we are in the meeting because there is too much information. We will translate to English soon after the conference. And you can translate to your language later. We will produce each speaker info and speech later to upload here. So you don't need to worry. But it will take some time. Thank you for your understanding and support 🙏🙏🙏 Best wishes! Pi Network #Pinetwork #PiGVV
1:07

We will have around 2.5 hours of Chinese speech and and around half hour for different languages speakers. ( Most English). So please download your translator on your phone. I use Google translate voice translate. Or if you have a better one that will be great! If you can't join in or you can't understand, you can just listen to feel the energy. We are sorry we can't translate to English when we are in the meeting because there is too much information. We will translate to English soon after the conference. And you can translate to your language later. We will produce each speaker info and speech later to upload here. So you don't need to worry. But it will take some time. Thank you for your understanding and support 🙏🙏🙏 Best wishes! Pi Network #Pinetwork #PiGVV

Doris Yin 东方紫莲🪷

20,625 Aufrufe • vor 3 Jahren

Today, we released Gemini 3.5 Live Translate, our latest audio model for live speech-to-speech translation. It supports over 70 languages and starts translating as soon as you start talking, streaming translations while listening to what you say next. No awkward pauses or choppy audio, just real connection without language barriers. So, how does it work? 🤔 The model is able to make split-second decisions to juggle speed and translation quality so conversations actually feel fluid, human, and natural. In order to do this, the model must receive and contextualize the input while simultaneously outputting the translated speech. Through this process, Gemini 3.5 Live Translate manages to stay mere seconds behind each speaker and can even maintain pacing, pitch, and intonation across extended sessions. See it in action below, or try it yourself in the Google Translate app on iOS & Android.
0:25

Today, we released Gemini 3.5 Live Translate, our latest audio model for live speech-to-speech translation. It supports over 70 languages and starts translating as soon as you start talking, streaming translations while listening to what you say next. No awkward pauses or choppy audio, just real connection without language barriers. So, how does it work? 🤔 The model is able to make split-second decisions to juggle speed and translation quality so conversations actually feel fluid, human, and natural. In order to do this, the model must receive and contextualize the input while simultaneously outputting the translated speech. Through this process, Gemini 3.5 Live Translate manages to stay mere seconds behind each speaker and can even maintain pacing, pitch, and intonation across extended sessions. See it in action below, or try it yourself in the Google Translate app on iOS & Android.

Google AI

3,975,903 Aufrufe • vor 1 Monat

Typing just became… Typeless. Meet Typeless 1.0.2 for Mac — a tool that transforms your voice into clear, accurate writing across your Mac. Speak naturally and let Typeless handle the typing, corrections, and structure for you. With Typeless, you can dictate, translate, or ask for quick edits in any language or accent. It converts your speech into polished text up to 10× faster than traditional typing, while automatically fixing mistakes along the way. --- 1️⃣ Dictation Typeless acts as a powerful voice keyboard that works across all applications on your Mac. When you speak, it understands your intent, organizes your ideas, and converts your natural speech into well-structured writing. Whether you're drafting emails, notes, documents, or messages, Typeless helps you turn spoken thoughts into clean text instantly. Controls - Press Fn to start or stop dictation - Hold Fn for quick, short dictation --- 2️⃣ Translation Typeless makes writing in other languages effortless. You can speak in your native language and have Typeless translate your words instantly into the language you want. This allows you to communicate, write, and respond in foreign languages smoothly and naturally. Controls - Press Fn + Space to start translation - Press Fn to stop translation --- 3️⃣ Ask Anything Typeless Typeless also lets you interact with your text using voice commands. You can select any text and simply say how you want it changed. Typeless can edit, rewrite, answer questions, or perform quick actions based on your request, making editing and improving text much faster. Controls - Press Fn + Space to start Ask Anything - Press Fn to stop Ask Anything --- With Typeless, your voice becomes the fastest and easiest way to write, edit, and communicate on your Mac. Your voice is now your keyboard. Get Typeless → Available now on Mac, Windows, iOS, and Android. #Typeless
5:30

Typing just became… Typeless. Meet Typeless 1.0.2 for Mac — a tool that transforms your voice into clear, accurate writing across your Mac. Speak naturally and let Typeless handle the typing, corrections, and structure for you. With Typeless, you can dictate, translate, or ask for quick edits in any language or accent. It converts your speech into polished text up to 10× faster than traditional typing, while automatically fixing mistakes along the way. --- 1️⃣ Dictation Typeless acts as a powerful voice keyboard that works across all applications on your Mac. When you speak, it understands your intent, organizes your ideas, and converts your natural speech into well-structured writing. Whether you're drafting emails, notes, documents, or messages, Typeless helps you turn spoken thoughts into clean text instantly. Controls - Press Fn to start or stop dictation - Hold Fn for quick, short dictation --- 2️⃣ Translation Typeless makes writing in other languages effortless. You can speak in your native language and have Typeless translate your words instantly into the language you want. This allows you to communicate, write, and respond in foreign languages smoothly and naturally. Controls - Press Fn + Space to start translation - Press Fn to stop translation --- 3️⃣ Ask Anything Typeless Typeless also lets you interact with your text using voice commands. You can select any text and simply say how you want it changed. Typeless can edit, rewrite, answer questions, or perform quick actions based on your request, making editing and improving text much faster. Controls - Press Fn + Space to start Ask Anything - Press Fn to stop Ask Anything --- With Typeless, your voice becomes the fastest and easiest way to write, edit, and communicate on your Mac. Your voice is now your keyboard. Get Typeless → Available now on Mac, Windows, iOS, and Android. #Typeless

Kuria Chronicles

43,623 Aufrufe • vor 3 Monaten

The future of DeFi is DeFAI 🟧 $ANON is at the forefront of this with our main goal of making DeFi easy to access & use FOR EVERYONE (DeFi is bigger then just you and me). Which is why Hey Anon currently supports multiple languages, including Korean, Chinese, Spanish, Italian, Portuguese, Turkish, Japanese, and Finnish & we're currently working on expanding to support all languages. Currently it can understand inputs in these languages but defaults to responding in English. The team is working on enhancing language features, such as adding natural language voice support for both anon & Gemma AI.
1:25

The future of DeFi is DeFAI 🟧 $ANON is at the forefront of this with our main goal of making DeFi easy to access & use FOR EVERYONE (DeFi is bigger then just you and me). Which is why Hey Anon currently supports multiple languages, including Korean, Chinese, Spanish, Italian, Portuguese, Turkish, Japanese, and Finnish & we're currently working on expanding to support all languages. Currently it can understand inputs in these languages but defaults to responding in English. The team is working on enhancing language features, such as adding natural language voice support for both anon & Gemma AI.

Daniele 🟧 ( Meme Quant )

55,995 Aufrufe • vor 1 Jahr

Text-to-speech is moving way too fast. Just a few days ago, I tweeted about PersonaPlex-7B, NVIDIA's new open source TTS ( And today, Qwen just open-sourced Qwen3-TTS 🤯 It’s a revolutionary text-to-speech model built for control. Not just about generating speech, but about shaping how it sounds directly from language. You can guide the pace, the tone, and the expressiveness straight from text, without touching audio graphs or hand-tuning parameters. That’s the real shift! What makes Qwen3-TTS stand out is how practical it already is: → voice cloning from just a few seconds of audio → voice creation without any reference sample → support for 10 languages out of the box → end-to-end latency down to ~97ms → works in both streaming and non-streaming setups The models come in two sizes (0.6B and 1.7B), so you can trade off quality and hardware cost depending on your setup. You can work with curated voices, designed voices, or cloned ones, and it integrates cleanly with vLLM for production use. It also ships as a simple Python package you can pip install. If you’re building real-time voice systems, this removes a lot of friction! 100% free and open source. I put the repo in the 🧵↓
0:41

Text-to-speech is moving way too fast. Just a few days ago, I tweeted about PersonaPlex-7B, NVIDIA's new open source TTS ( And today, Qwen just open-sourced Qwen3-TTS 🤯 It’s a revolutionary text-to-speech model built for control. Not just about generating speech, but about shaping how it sounds directly from language. You can guide the pace, the tone, and the expressiveness straight from text, without touching audio graphs or hand-tuning parameters. That’s the real shift! What makes Qwen3-TTS stand out is how practical it already is: → voice cloning from just a few seconds of audio → voice creation without any reference sample → support for 10 languages out of the box → end-to-end latency down to ~97ms → works in both streaming and non-streaming setups The models come in two sizes (0.6B and 1.7B), so you can trade off quality and hardware cost depending on your setup. You can work with curated voices, designed voices, or cloned ones, and it integrates cleanly with vLLM for production use. It also ships as a simple Python package you can pip install. If you’re building real-time voice systems, this removes a lot of friction! 100% free and open source. I put the repo in the 🧵↓

Charly Wargnier

59,144 Aufrufe • vor 5 Monaten

BUILD 🔥: Microsoft is preparing new image and voice models for the announcement on June 2. > MAI Voice 2, a multilingual model supporting 15 news languages and a wider range of emotional spectrum (check voice samples in the article) > MAI Transcribe 1.5, a new model for speech-to-text use cases. > MAI Image 2.5, already announced last week, is now available on LM Arena in preview. Compared to MAI Image 2, it supports file uploads and can be used for image editing.
0:40

BUILD 🔥: Microsoft is preparing new image and voice models for the announcement on June 2. > MAI Voice 2, a multilingual model supporting 15 news languages and a wider range of emotional spectrum (check voice samples in the article) > MAI Transcribe 1.5, a new model for speech-to-text use cases. > MAI Image 2.5, already announced last week, is now available on LM Arena in preview. Compared to MAI Image 2, it supports file uploads and can be used for image editing.

🚨 AI News | TestingCatalog

46,446 Aufrufe • vor 1 Monat

Left Kemi Badenoch talks about the first community of Jews in the Manchester back in the 1780s Right: The first English translation of the Quran was in 1649 by Alexander Ross, and a 1641 document refers to "a sect of Mahomatens" being "discovered here in London" Badenoch is trying to paint a close relationship with the UK and Judiasm, but choses not to refer to the close relationship between the UK and Muslims Just as Badenoch chose to refer to the attack on the Synagogue in her speech, but chose to ignore a mosque being set alight in her speech I'm actually quite happy and excited to learn of the history of the early Jewish communities, because our diversity makes us richer and better as a nation living together in peace I just find it really sad that Badenoch is choosing a narrative that seeks to divide the nation instead of one that seeks to unite the nation For anyone interested, you can read the first ever English translation of the Quran, but an Englishman at this link
0:27

Left Kemi Badenoch talks about the first community of Jews in the Manchester back in the 1780s Right: The first English translation of the Quran was in 1649 by Alexander Ross, and a 1641 document refers to "a sect of Mahomatens" being "discovered here in London" Badenoch is trying to paint a close relationship with the UK and Judiasm, but choses not to refer to the close relationship between the UK and Muslims Just as Badenoch chose to refer to the attack on the Synagogue in her speech, but chose to ignore a mosque being set alight in her speech I'm actually quite happy and excited to learn of the history of the early Jewish communities, because our diversity makes us richer and better as a nation living together in peace I just find it really sad that Badenoch is choosing a narrative that seeks to divide the nation instead of one that seeks to unite the nation For anyone interested, you can read the first ever English translation of the Quran, but an Englishman at this link

Farrukh

191,605 Aufrufe • vor 9 Monaten

I built an app that makes it easy to caption and translate clips while preserving the original voice. built for global communities and the creators who help them grow. a town hall can’t fit every timezone. for example, “Meet at the Clubhouse” by Bored Ape Yacht Club 🍌 or the “OG Show” by Grateful Ape🍌 + Other Games are digital social experiences I can’t attend live due to scheduling. so communities and myself run on replays, highlights, and clipped moments. creators need tools to capture these cultural moments in audio easily and it deserves to travel farther than one language. now it’s even possible to cross language barriers without losing the speaker’s voice. dubbing is powered by ElevenLabs, which I believe is leading in frontier voice and speech models. community creators and ambassadors can localize moments that matter most, making important updates easier to understand in their audience’s native language. and even without dubbing & translation, it’s great to make beautifully designed audiograms. private beta at the moment. public soon. so what do you think? does it translate well to your language? worth building out further? let me know
1:00

I built an app that makes it easy to caption and translate clips while preserving the original voice. built for global communities and the creators who help them grow. a town hall can’t fit every timezone. for example, “Meet at the Clubhouse” by Bored Ape Yacht Club 🍌 or the “OG Show” by Grateful Ape🍌 + Other Games are digital social experiences I can’t attend live due to scheduling. so communities and myself run on replays, highlights, and clipped moments. creators need tools to capture these cultural moments in audio easily and it deserves to travel farther than one language. now it’s even possible to cross language barriers without losing the speaker’s voice. dubbing is powered by ElevenLabs, which I believe is leading in frontier voice and speech models. community creators and ambassadors can localize moments that matter most, making important updates easier to understand in their audience’s native language. and even without dubbing & translation, it’s great to make beautifully designed audiograms. private beta at the moment. public soon. so what do you think? does it translate well to your language? worth building out further? let me know

NANA

11,535 Aufrufe • vor 2 Tagen

Today, we’re thrilled to introduce GAIA, a modular creation engine for the AI age. At its core, GAIA is a multiplayer creation engine designed to bring democratized Generative AI abilities to everyone, hence its name. It abstracts away the complexities of leveraging open-source software, hardware requirements, and technical intricacies, allowing creators to focus solely on creating, together. GAIA has been instrumental in powering the imagination and creative works of our studio, significantly boosting productivity, collaboration, and creativity. It has saved our team thousands of man-days in production work, enabling us to dream bigger, bolder, and execute more swiftly. When used by experienced creators, GAIA, with its ever-growing toolsets built by core contributors, stands to be the best AI creative co-pilot for industry-specific production workflows—from gaming to fashion, and from personal consumption to real estate renderings. GAIA's self-reinforcing flywheel is poised to dramatically enhance the platform's capabilities in both the near and long term: The cost of GPUs and compute will continue to improve. Open-source AI models are becoming increasingly powerful over time, as seen by the evolution from Stable Diffusion 1 to Lightning, alongside other impressive OSS creations like AnimateDiff, LoRAs, and ControlNet. The architecture of AI workflows will become more fine-grained, allowing exponentially increasing control over final outputs. The data and connections that AI workflows can make, both in-app and out-of-app, will grow more sophisticated. GAIA already allows for the chaining of Generative Image AI recipes, grouping complex node-based programs into simple consumer-facing interfaces. Soon, with multi-modality workflows, creators will be able to leverage not only images but also text and sound to create even more complex workflows. Today is the least capable GAIA will ever be. It already provides superpowers unachievable by many creators who know how to harness them. We have an extremely exciting backlog of features lined up, starting with social features. Our mission as Ather Collective core contributors is to get GAIA into the hands of as many creators and businesses as possible. While we believe in e/acc, our north star for Ather Collective remains: Equitable, Accessible, Composable, and Collaborative. If you would like to be a part of the early access users of GAIA, please register using this link: Our team will open up capacity as soon as we are able to. There is only one way AI benefits humanity, and that’s through open AI. Let’s be a part of it. ✌🏻
0:50

Today, we’re thrilled to introduce GAIA, a modular creation engine for the AI age. At its core, GAIA is a multiplayer creation engine designed to bring democratized Generative AI abilities to everyone, hence its name. It abstracts away the complexities of leveraging open-source software, hardware requirements, and technical intricacies, allowing creators to focus solely on creating, together. GAIA has been instrumental in powering the imagination and creative works of our studio, significantly boosting productivity, collaboration, and creativity. It has saved our team thousands of man-days in production work, enabling us to dream bigger, bolder, and execute more swiftly. When used by experienced creators, GAIA, with its ever-growing toolsets built by core contributors, stands to be the best AI creative co-pilot for industry-specific production workflows—from gaming to fashion, and from personal consumption to real estate renderings. GAIA's self-reinforcing flywheel is poised to dramatically enhance the platform's capabilities in both the near and long term: The cost of GPUs and compute will continue to improve. Open-source AI models are becoming increasingly powerful over time, as seen by the evolution from Stable Diffusion 1 to Lightning, alongside other impressive OSS creations like AnimateDiff, LoRAs, and ControlNet. The architecture of AI workflows will become more fine-grained, allowing exponentially increasing control over final outputs. The data and connections that AI workflows can make, both in-app and out-of-app, will grow more sophisticated. GAIA already allows for the chaining of Generative Image AI recipes, grouping complex node-based programs into simple consumer-facing interfaces. Soon, with multi-modality workflows, creators will be able to leverage not only images but also text and sound to create even more complex workflows. Today is the least capable GAIA will ever be. It already provides superpowers unachievable by many creators who know how to harness them. We have an extremely exciting backlog of features lined up, starting with social features. Our mission as Ather Collective core contributors is to get GAIA into the hands of as many creators and businesses as possible. While we believe in e/acc, our north star for Ather Collective remains: Equitable, Accessible, Composable, and Collaborative. If you would like to be a part of the early access users of GAIA, please register using this link: Our team will open up capacity as soon as we are able to. There is only one way AI benefits humanity, and that’s through open AI. Let’s be a part of it. ✌🏻

TIN | Sipher Odyssey & Ather Labs

14,194 Aufrufe • vor 2 Jahren

Today we're announcing #GAIA1: a 9B parameter world model, trained on 4,700 hours of driving data, able to simulate complex and diverse driving scenes from video, text and action inputs. This model is 480x larger than the preview we shared earlier this year and the results are incredible. These videos are entirely synthetically generated by Wayve's generative AI, GAIA-1. But there is more here than just generating videos, GAIA is an entire world model. A world model allows us to simulate the future, conditioned on video, text and action inputs, which can be leveraged for making informed decisions when driving. Why is this game-changing for autonomous driving? 1. Safety. One limitation with AI systems like today's Large Language Models is that they are autoregressive, next-word prediction algorithms, but aren't necessarily aware of the implications of their decisions. A world model allows us to give our AI the capability to be aware of its decisions, by simulating the future, which is important for self-driving safety. 2. Synthetic training data. I believe synthetic training data is the future for AI, because it is safer, cheaper, and infinitely scalable. GAIA-1 unlocks unprecedented realism and diversity of synthetic data for self-driving. 3. Long-tail robustness. One of the biggest challenges for self-driving is long-tail robustness: dealing with the enormous magnitude of edge cases we see on the road. An advantage of generative AI is its incredible ability to recombine experiences in new ways. This is exciting for self-driving as it means we can learn from two edge case scenarios, and combine them to become a corner case. For example, we can experience driving in fog, and experience of jay-walking pedestrians, and GAIA can learn from these experiences to understand how to generate a fog+jay walking scenario. Check out many more videos in our blog or further technical details in our paper: Or come chat with our team who are at the International Conference on Computer Vision (#ICCV2023) this week in Paris in Booth 32 Jamie Shotton
0:41

Today we're announcing #GAIA1: a 9B parameter world model, trained on 4,700 hours of driving data, able to simulate complex and diverse driving scenes from video, text and action inputs. This model is 480x larger than the preview we shared earlier this year and the results are incredible. These videos are entirely synthetically generated by Wayve's generative AI, GAIA-1. But there is more here than just generating videos, GAIA is an entire world model. A world model allows us to simulate the future, conditioned on video, text and action inputs, which can be leveraged for making informed decisions when driving. Why is this game-changing for autonomous driving? 1. Safety. One limitation with AI systems like today's Large Language Models is that they are autoregressive, next-word prediction algorithms, but aren't necessarily aware of the implications of their decisions. A world model allows us to give our AI the capability to be aware of its decisions, by simulating the future, which is important for self-driving safety. 2. Synthetic training data. I believe synthetic training data is the future for AI, because it is safer, cheaper, and infinitely scalable. GAIA-1 unlocks unprecedented realism and diversity of synthetic data for self-driving. 3. Long-tail robustness. One of the biggest challenges for self-driving is long-tail robustness: dealing with the enormous magnitude of edge cases we see on the road. An advantage of generative AI is its incredible ability to recombine experiences in new ways. This is exciting for self-driving as it means we can learn from two edge case scenarios, and combine them to become a corner case. For example, we can experience driving in fog, and experience of jay-walking pedestrians, and GAIA can learn from these experiences to understand how to generate a fog+jay walking scenario. Check out many more videos in our blog or further technical details in our paper: Or come chat with our team who are at the International Conference on Computer Vision (#ICCV2023) this week in Paris in Booth 32 Jamie Shotton

Alex Kendall

631,856 Aufrufe • vor 2 Jahren

OpenAI shipped a new speech-to-speech model today: gpt-realtime-2 This is the first speech-to-speech model good enough to use in my voice agents that do "real work." Or real play, for that matter. Here's gpt-realtime-2 as the brain of the ship AI in Gradient Bang. The voice-to-voice response and tool calling times here are unedited, so you can see exactly what the interaction with the model is like in an agent with a very complex system instruction and frequent tool calls. (I did clip out the subagent task execution segments, after gpt-realtime-2 starts a subagent via a tool call. Subagents in this config used gpt-5.2 "medium" effort.)
3:13

OpenAI shipped a new speech-to-speech model today: gpt-realtime-2 This is the first speech-to-speech model good enough to use in my voice agents that do "real work." Or real play, for that matter. Here's gpt-realtime-2 as the brain of the ship AI in Gradient Bang. The voice-to-voice response and tool calling times here are unedited, so you can see exactly what the interaction with the model is like in an agent with a very complex system instruction and frequent tool calls. (I did clip out the subagent task execution segments, after gpt-realtime-2 starts a subagent via a tool call. Subagents in this config used gpt-5.2 "medium" effort.)

kwindla

54,912 Aufrufe • vor 2 Monaten

💡 What is a Gaia Domain?! Gaia Domains were created to make AI infrastructure truly sovereign. Each domain is a programmable environment you own and control on-chain, where your logic, models, and data stay in your hands at all times. With Gaia, you set the rules: choose which AI agents to deploy, configure your workflows, and decide how others can interact with your domain. Domains integrate seamlessly with smart contracts, other domains, and a wide range of decentralized tools is simple and secure. Every part of your domain operates on Gaia’s decentralized node network, protecting your work from centralized servers or closed AI systems. Thankfully, getting started is quick. Domains are ready out of the box with open-source language models and SDKs, so you can launch and iterate fast. Their modular design makes them easy to adapt, and EVM compatibility means they fit right into the broader DeAI ecosystem. Earning is built in at every step: you can run services, sell access, or enable delegated tasks with all transactions managed on-chain for total transparency. Gaia Domains open new ground for developers, DAOs, founders, researchers, and enterprises seeking to decentralize their AI stack. Questions? Reach out to our DevRels Tobiloba 🦀 Harish Kotra 🥑 meowy🦀! Get started here: In this video, Tobiloba 🦀 demonstrates how to integrate Gaia's public domains for AI agents, applications, chatbots, and frameworks, or even interact directly via the Gaia chat UI 🔽
8:25

💡 What is a Gaia Domain?! Gaia Domains were created to make AI infrastructure truly sovereign. Each domain is a programmable environment you own and control on-chain, where your logic, models, and data stay in your hands at all times. With Gaia, you set the rules: choose which AI agents to deploy, configure your workflows, and decide how others can interact with your domain. Domains integrate seamlessly with smart contracts, other domains, and a wide range of decentralized tools is simple and secure. Every part of your domain operates on Gaia’s decentralized node network, protecting your work from centralized servers or closed AI systems. Thankfully, getting started is quick. Domains are ready out of the box with open-source language models and SDKs, so you can launch and iterate fast. Their modular design makes them easy to adapt, and EVM compatibility means they fit right into the broader DeAI ecosystem. Earning is built in at every step: you can run services, sell access, or enable delegated tasks with all transactions managed on-chain for total transparency. Gaia Domains open new ground for developers, DAOs, founders, researchers, and enterprises seeking to decentralize their AI stack. Questions? Reach out to our DevRels Tobiloba 🦀 Harish Kotra 🥑 meowy🦀! Get started here: In this video, Tobiloba 🦀 demonstrates how to integrate Gaia's public domains for AI agents, applications, chatbots, and frameworks, or even interact directly via the Gaia chat UI 🔽

Gaia 🌱

15,821 Aufrufe • vor 1 Jahr

I may speak in Hindi, I may speak in English, I may speak in Telugu or I may speak in Tamil. How does it matter to the Hon'ble MP? Because now, with the arrangements made by the Hon’ble Speaker, he can get the translation in any language that he desires. So what is this argument that “she spoke in Hindi, therefore I can’t understand?" The facilities are available. Technology has been used. He can understand in any language he wants. But because he has not read the Bill thoroughly and because he wants to divert from the topic, he is bringing all these things and I take objection to it. - Smt Nirmala Sitharaman in Lok Sabha.
1:29

I may speak in Hindi, I may speak in English, I may speak in Telugu or I may speak in Tamil. How does it matter to the Hon'ble MP? Because now, with the arrangements made by the Hon’ble Speaker, he can get the translation in any language that he desires. So what is this argument that “she spoke in Hindi, therefore I can’t understand?" The facilities are available. Technology has been used. He can understand in any language he wants. But because he has not read the Bill thoroughly and because he wants to divert from the topic, he is bringing all these things and I take objection to it. - Smt Nirmala Sitharaman in Lok Sabha.

Nirmala Sitharaman Office

294,960 Aufrufe • vor 7 Monaten

Mati Staniszewski on why ElevenLabs is betting on a cascaded approach for voice agents: “Our approach, as you think about voice agents, conversational agents, is effectively a cascaded approach. You use transcription or speech-to-text, an LLM, text-to-speech, and orchestrate all of that together. Then you have speech-to-speech, which goes directly from speech, and there’s a speech response on the other side. Today, we are optimizing heavily on a cascaded approach. As we work with a lot of the businesses and enterprises, they will need that visibility into what happens. They will want to execute certain tasks on top of that. They want good visibility into each of the steps and great accuracy of all the models. But beyond that, they can abstract away what’s the LLM layer, what’s the intelligence layer, and the integrations are easier in that system. That’s where we are betting a lot of the research work on how you can make that great, and we think we can make that great.” John Collison Mati Staniszewski ElevenLabs
1:09

Mati Staniszewski on why ElevenLabs is betting on a cascaded approach for voice agents: “Our approach, as you think about voice agents, conversational agents, is effectively a cascaded approach. You use transcription or speech-to-text, an LLM, text-to-speech, and orchestrate all of that together. Then you have speech-to-speech, which goes directly from speech, and there’s a speech response on the other side. Today, we are optimizing heavily on a cascaded approach. As we work with a lot of the businesses and enterprises, they will need that visibility into what happens. They will want to execute certain tasks on top of that. They want good visibility into each of the steps and great accuracy of all the models. But beyond that, they can abstract away what’s the LLM layer, what’s the intelligence layer, and the integrations are easier in that system. That’s where we are betting a lot of the research work on how you can make that great, and we think we can make that great.” John Collison Mati Staniszewski ElevenLabs

Stripe

17,118 Aufrufe • vor 2 Monaten

Today is a good day for open science. As part of our continued commitment to the growth and development of an open ecosystem, today at Meta FAIR we’re announcing four new publicly available AI models and additional research artifacts to inspire innovation in the community and help advance AI in a responsible way. More in the video from Joelle Pineau. What we’re releasing: 🦎 Meta Chameleon 7B & 34B language models that support mixed-modal input and text-only outputs. 🪙 Meta Multi-Token Prediction Pretrained Language Models for code completion using Multi-Token Prediction. 🎼 Meta JASCO Generative text-to-music models capable of accepting various conditioning inputs for greater controllability. Paper available today with a pretrained model coming soon. 🗣️ Meta AudioSeal An audio watermarking model that we believe is the first designed specifically for the localized detection of AI-generated speech, available under a commercial license. 📝 Additional RAI artifacts Including research, data and code to measure and improve the representation of geographical and cultural preferences and diversity in AI systems. We believe that access to state-of-the-art AI creates opportunities for everyone – not just a small handful of Big Tech companies. We’re excited to share this work and to see how the community learns, iterates and builds using this technology. Details and access to everything released by FAIR today ➡️
1:14

Today is a good day for open science. As part of our continued commitment to the growth and development of an open ecosystem, today at Meta FAIR we’re announcing four new publicly available AI models and additional research artifacts to inspire innovation in the community and help advance AI in a responsible way. More in the video from Joelle Pineau. What we’re releasing: 🦎 Meta Chameleon 7B & 34B language models that support mixed-modal input and text-only outputs. 🪙 Meta Multi-Token Prediction Pretrained Language Models for code completion using Multi-Token Prediction. 🎼 Meta JASCO Generative text-to-music models capable of accepting various conditioning inputs for greater controllability. Paper available today with a pretrained model coming soon. 🗣️ Meta AudioSeal An audio watermarking model that we believe is the first designed specifically for the localized detection of AI-generated speech, available under a commercial license. 📝 Additional RAI artifacts Including research, data and code to measure and improve the representation of geographical and cultural preferences and diversity in AI systems. We believe that access to state-of-the-art AI creates opportunities for everyone – not just a small handful of Big Tech companies. We’re excited to share this work and to see how the community learns, iterates and builds using this technology. Details and access to everything released by FAIR today ➡️

AI at Meta

380,751 Aufrufe • vor 2 Jahren

Most voice models are great at cloning voices, but they still manage to erase the person. I have an accent. Voice models don't know how to preserve it. Whenever I clone my voice, models get the words right, but mess up the rhythm badly. They flatten my vowels, and everything drifts toward a generic American accent. I'm attaching one example from Mirage. This is the first model I have heard of that can reproduce access as-is. • My accent stays intact, even when speaking English and Spanish • My pacing and cadence feel intentional, not averaged • The expressivity of my voice comes through Best part: Mirage only needs a short sample of your voice to clone it. I think this solves the hard part of voice cloning: intelligibility is easy, but identity is what makes a huge difference. Listen to the attached sample, and you'll notice the difference if you compare it with any other model out there. If you want to try this out, check out this link: Thanks to the Mirage team for collaborating with me on this post.
0:21

Most voice models are great at cloning voices, but they still manage to erase the person. I have an accent. Voice models don't know how to preserve it. Whenever I clone my voice, models get the words right, but mess up the rhythm badly. They flatten my vowels, and everything drifts toward a generic American accent. I'm attaching one example from Mirage. This is the first model I have heard of that can reproduce access as-is. • My accent stays intact, even when speaking English and Spanish • My pacing and cadence feel intentional, not averaged • The expressivity of my voice comes through Best part: Mirage only needs a short sample of your voice to clone it. I think this solves the hard part of voice cloning: intelligibility is easy, but identity is what makes a huge difference. Listen to the attached sample, and you'll notice the difference if you compare it with any other model out there. If you want to try this out, check out this link: Thanks to the Mirage team for collaborating with me on this post.

Santiago

31,245 Aufrufe • vor 6 Monaten

Don't use ChatGPT for academic writing. It may get flagged as AI-generated text. Instead, use Paperpal — an AI-powered personal writing assistant. Especially if your first language is not English. Think of Paperl as the elder brother of Grammarly, especially designed for academic writing. Go to and sign up. You can either start writing in Paperpal or paste a text you have already written. Paperpal will evaluate your writing and give you detailed suggestions to improve it. If English is not your first language, you can write in your own language and Paperpal will translate it for you. You can also install a Paperpal add-in in MS Word. Click on "Insert" and then "Get Add-ins." Search for the Paperpal add-in, and press "Add." And you will have Paperpal inside MS Word. Paperpal will give you helpful suggestion as you write. You can write in your own language and get Paperpal to translate it into English. Paperpal supports following languages: Bulgarian, Chinese, Czech, Danish, Dutch, Estonian, Finnish, French, German, Greek, Hungarian, Indonesian, Italian, Japanese, Korean, Latvian, Lithuanian, Polish, Portuguese, Romanian, Russian, Slovak, Slovenian, Spanish, Swedish, Turkish, Ukrainian. Please note Paperpal's give you 500 free suggestions a month after which you will have to buy a subscription. If you use it judiciously, you won't have to pay any money. ----- Found this post helpful? 1. Retweet to share it with your friends. 2. Bookmark it so you can come back to it later. 3. Follow me for regular posts on how to supercharge your academic writing with AI-powered apps.
0:25

Don't use ChatGPT for academic writing. It may get flagged as AI-generated text. Instead, use Paperpal — an AI-powered personal writing assistant. Especially if your first language is not English. Think of Paperl as the elder brother of Grammarly, especially designed for academic writing. Go to and sign up. You can either start writing in Paperpal or paste a text you have already written. Paperpal will evaluate your writing and give you detailed suggestions to improve it. If English is not your first language, you can write in your own language and Paperpal will translate it for you. You can also install a Paperpal add-in in MS Word. Click on "Insert" and then "Get Add-ins." Search for the Paperpal add-in, and press "Add." And you will have Paperpal inside MS Word. Paperpal will give you helpful suggestion as you write. You can write in your own language and get Paperpal to translate it into English. Paperpal supports following languages: Bulgarian, Chinese, Czech, Danish, Dutch, Estonian, Finnish, French, German, Greek, Hungarian, Indonesian, Italian, Japanese, Korean, Latvian, Lithuanian, Polish, Portuguese, Romanian, Russian, Slovak, Slovenian, Spanish, Swedish, Turkish, Ukrainian. Please note Paperpal's give you 500 free suggestions a month after which you will have to buy a subscription. If you use it judiciously, you won't have to pay any money. ----- Found this post helpful? 1. Retweet to share it with your friends. 2. Bookmark it so you can come back to it later. 3. Follow me for regular posts on how to supercharge your academic writing with AI-powered apps.

Mushtaq Bilal, PhD

344,393 Aufrufe • vor 3 Jahren

Typing isn’t the hard part. Slowing your thoughts down to match a keyboard is. That’s what made Typeless | Typeless click for me, especially its Translation Mode. You simply speak in your own language, naturally. Typeless instantly converts that into clear, well-structured text in another language. What surprised me most: - The translation sounds human, not stiff or robotic - Grammar is fixed automatically - Tone is refined - Sentences are organized cleanly The output looks professional right away. No rewriting. No polishing. It doesn’t feel like basic voice typing. It feels more like explaining your thoughts to a smart assistant that knows how to write them properly. Since it works on both Mac and iOS, you can talk, translate, and finish your work wherever you are. If you write emails, blogs, notes, or communicate across languages daily, this can save serious time. Try it here: Get Typeless for iPhone: #Productivity #TranslationMode #Typeless #VoiceTyping #SpeakToWrite #CreatorTools
3:16

Typing isn’t the hard part. Slowing your thoughts down to match a keyboard is. That’s what made Typeless | Typeless click for me, especially its Translation Mode. You simply speak in your own language, naturally. Typeless instantly converts that into clear, well-structured text in another language. What surprised me most: - The translation sounds human, not stiff or robotic - Grammar is fixed automatically - Tone is refined - Sentences are organized cleanly The output looks professional right away. No rewriting. No polishing. It doesn’t feel like basic voice typing. It feels more like explaining your thoughts to a smart assistant that knows how to write them properly. Since it works on both Mac and iOS, you can talk, translate, and finish your work wherever you are. If you write emails, blogs, notes, or communicate across languages daily, this can save serious time. Try it here: Get Typeless for iPhone: #Productivity #TranslationMode #Typeless #VoiceTyping #SpeakToWrite #CreatorTools

Markandey Sharma

66,650 Aufrufe • vor 4 Monaten