Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Today, Meta released Llama 3.2 unlocking capabilities to translate and dub videos on Reels automatically. The Gaia community is lightning-quick in putting new nodes to good use 🟣 Whisper (Speech to text) 🔵 Qwen 72b (Translation) 🟢 GPT-sovits (Text to speech) Currently, Meta only supports automatic translation from Spanish... show more

Gaia 🌱

424,264 subscribers

33,701 views • 1 year ago •via X (Twitter)

Science & Technology News & Politics Education

Anya Rossi• Live Now

Private livecam show

10 Comments

Kay1 year ago

@Meta #Gaia #GaianetAi #decentralizedAi Let's connect

Alsunder Atleta CLONE $MGT🌕👾1 year ago

@Meta very powerful #Gaia #GaianetAi #decentralizedAi

Lidya (Ø,G) ꧁IP꧂1 year ago

@Meta Go @din_lol_ Go @din_lol_ $koi

MR.DON $BEYOND💪💸💸1 year ago

@Meta The future of AI ✅💯#Gaia #GaiaNetAI #DecentralizedAI

Eva Crypto 🌱1 year ago

@Meta Hi, check my dm. Let’s connect

SpiderCrypto 🧑‍🍳🧲1 year ago

@Meta How can i use this for the videos I make on x?

Young Sammy 💎1 year ago

@Meta Gaia stepping up what Meta does ⚡️ #Gaia #GaianetAi #decentralizedAi

CR.G 👁‍🗨.nad1 year ago

@Meta future together Gaanet #gaia #GaianetAi

yoyoh69691 year ago

@Meta Great updates and becoming more exciting each day. #Gaia #GaianetAi #DecentralizedAI

0xnimu 🧙‍♂️,🧙‍♂️꧁IP꧂1 year ago

@Meta lets try Llama 3.2 unlocking capabilities #Gaia #GaianetAi #decentralizedAI

Related Videos

✨ bolt.new + BuildShip = Voice-to-Voice Translation App 🎙️ 🚀 Build your own AI-powered translator: - Convert speech → text (OpenAI Whisper) - Translate into any language - Generate lifelike speech (TTS) - Upload & retrieve translated audio files

✨ bolt.new + BuildShip = Voice-to-Voice Translation App 🎙️ 🚀 Build your own AI-powered translator: - Convert speech → text (OpenAI Whisper) - Translate into any language - Generate lifelike speech (TTS) - Upload & retrieve translated audio files

BuildShip

12,731 views • 1 year ago

Preview of a Gaia 🌱 device! Turn-by-turn voice conversation with your own knowledge assistant (a Gaia node). 💸 $15 worth of hardware (pre-tariff!) 🌱 Voice-to-text, LLM and text-to-voice AI models on Gaia nodes 📖 Open source all-the-way — hardware, firmware, server, AI models 🦀 Rust all-the-way from firmware to AI server Notice how I switched to another language (Chinese) in the middle of the conversation and it seamlessly switched too. Very smart. PS. we are still optimizing performance before the software release.

Preview of a Gaia 🌱 device! Turn-by-turn voice conversation with your own knowledge assistant (a Gaia node). 💸 $15 worth of hardware (pre-tariff!) 🌱 Voice-to-text, LLM and text-to-voice AI models on Gaia nodes 📖 Open source all-the-way — hardware, firmware, server, AI models 🦀 Rust all-the-way from firmware to AI server Notice how I switched to another language (Chinese) in the middle of the conversation and it seamlessly switched too. Very smart. PS. we are still optimizing performance before the software release.

Michael Yuan

14,983 views • 1 year ago

Ray-Ban Meta glasses can now translate speech between English, French, Italian, and Spanish, and multimodal Meta AI is finally rolling out to Europe. Details here:

Ray-Ban Meta glasses can now translate speech between English, French, Italian, and Spanish, and multimodal Meta AI is finally rolling out to Europe. Details here:

UploadVR

28,129 views • 1 year ago

This is wild. Used AI to translate this from English to Japanese. It changed my mouth to match the Japanese. Anyone know if the translation is good?

This is wild. Used AI to translate this from English to Japanese. It changed my mouth to match the Japanese. Anyone know if the translation is good?

Jim - Iowa Tesla

5,248,844 views • 2 years ago

Introducing SeamlessM4T, the first all-in-one, multilingual multimodal translation model. This single model can perform tasks across speech-to-text, speech-to-speech, text-to-text translation & speech recognition for up to 100 languages depending on the task. Details ⬇️

Introducing SeamlessM4T, the first all-in-one, multilingual multimodal translation model. This single model can perform tasks across speech-to-text, speech-to-speech, text-to-text translation & speech recognition for up to 100 languages depending on the task. Details ⬇️

AI at Meta

592,726 views • 2 years ago

I’m incredibly excited to share a sneak peak of Wayve’s GAIA-1, a major step forward in action and language-conditioned world models for #AutonomousDriving. Here’s a glimpse of what GAIA-1 can do - more in the 🧵. (These are not real videos!) But what's a world model?

I’m incredibly excited to share a sneak peak of Wayve’s GAIA-1, a major step forward in action and language-conditioned world models for #AutonomousDriving. Here’s a glimpse of what GAIA-1 can do - more in the 🧵. (These are not real videos!) But what's a world model?

Jamie Shotton

198,918 views • 3 years ago

Google presents AudioPaLM: A Large Language Model That Can Speak and Listen paper page: introduce AudioPaLM, a large language model for speech understanding and generation. AudioPaLM fuses text-based and speech-based language models, PaLM-2 [Anil et al., 2023] and AudioLM [Borsos et al., 2022], into a unified multimodal architecture that can process and generate text and speech with applications including speech recognition and speech-to-speech translation. AudioPaLM inherits the capability to preserve paralinguistic information such as speaker identity and intonation from AudioLM and the linguistic knowledge present only in text large language models such as PaLM-2. We demonstrate that initializing AudioPaLM with the weights of a text-only large language model improves speech processing, successfully leveraging the larger quantity of text training data used in pretraining to assist with the speech tasks. The resulting model significantly outperforms existing systems for speech translation tasks and has the ability to perform zero-shot speech-to-text translation for many languages for which input/target language combinations were not seen in training. AudioPaLM also demonstrates features of audio language models, such as transferring a voice across languages based on a short spoken prompt.

Google presents AudioPaLM: A Large Language Model That Can Speak and Listen paper page: introduce AudioPaLM, a large language model for speech understanding and generation. AudioPaLM fuses text-based and speech-based language models, PaLM-2 [Anil et al., 2023] and AudioLM [Borsos et al., 2022], into a unified multimodal architecture that can process and generate text and speech with applications including speech recognition and speech-to-speech translation. AudioPaLM inherits the capability to preserve paralinguistic information such as speaker identity and intonation from AudioLM and the linguistic knowledge present only in text large language models such as PaLM-2. We demonstrate that initializing AudioPaLM with the weights of a text-only large language model improves speech processing, successfully leveraging the larger quantity of text training data used in pretraining to assist with the speech tasks. The resulting model significantly outperforms existing systems for speech translation tasks and has the ability to perform zero-shot speech-to-text translation for many languages for which input/target language combinations were not seen in training. AudioPaLM also demonstrates features of audio language models, such as transferring a voice across languages based on a short spoken prompt.

AK

290,517 views • 3 years ago

🚨 Exciting news! We've just launched in-video Text Translate, taking our video translation to the next level! 🌍🚀 Now we don't just translate your voice, we translate on-screen text too! - Automatic text detection - Instant translation to your chosen languages - AI-powered style matching Try it now at and scale your content worldwide! 🌐

🚨 Exciting news! We've just launched in-video Text Translate, taking our video translation to the next level! 🌍🚀 Now we don't just translate your voice, we translate on-screen text too! - Automatic text detection - Instant translation to your chosen languages - AI-powered style matching Try it now at and scale your content worldwide! 🌐

HeyGen

17,427 views • 1 year ago

QVAC Translate is becoming amazing. 100% local on device, 100% private. Supports already tens of languages. Audio and video translation. Working now on: - translation of any document in any format to any format - real-time conversation translation Team is impressive. In private beta now. Powered by QVAC SDK. Soon at

QVAC Translate is becoming amazing. 100% local on device, 100% private. Supports already tens of languages. Audio and video translation. Working now on: - translation of any document in any format to any format - real-time conversation translation Team is impressive. In private beta now. Powered by QVAC SDK. Soon at

Paolo Ardoino 🤖

34,169 views • 10 months ago

Creators, meet your new translation hack on X! 🌍🎥 Our Translation Bot—your tool for watching videos in any language. How it works: Tag @HeyGenLabs + your desired language as a reply, and we’ll translate it—complete with lip sync and the original speaker’s voice! Try it now!

Creators, meet your new translation hack on X! 🌍🎥 Our Translation Bot—your tool for watching videos in any language. How it works: Tag @HeyGenLabs + your desired language as a reply, and we’ll translate it—complete with lip sync and the original speaker’s voice! Try it now!

HeyGen Developers

110,074,757 views • 1 year ago

In this demo, we show real-time voice translation between Indian languages. The user can speak in their preferred language, and the system translates and responds in another, preserving both meaning and natural delivery. Speech recognition, translation, and expressive text-to-speech work together seamlessly.

In this demo, we show real-time voice translation between Indian languages. The user can speak in their preferred language, and the system translates and responds in another, preserving both meaning and natural delivery. Speech recognition, translation, and expressive text-to-speech work together seamlessly.

Pratyush Kumar

15,206 views • 4 months ago

Quick demo of the voice to voice translation between English and Twi that you can try today on our web app. This one is from the perspective of a tourist visiting Ghana and needing to get around. Brought to you by the amazing team at Ghana Natural Language Processing (NLP) Algorine Research

Quick demo of the voice to voice translation between English and Twi that you can try today on our web app. This one is from the perspective of a tourist visiting Ghana and needing to get around. Brought to you by the amazing team at Ghana Natural Language Processing (NLP) Algorine Research

Paul Azunre

165,075 views • 2 years ago

This is “Dublr” a final year project by Agha Usman over at GIKI - Uses AI to translate & generate realistic lip syncing from any language to English! See the output! Brilliant!

This is “Dublr” a final year project by Agha Usman over at GIKI - Uses AI to translate & generate realistic lip syncing from any language to English! See the output! Brilliant!

Habibullah Khan

40,551 views • 3 years ago

🚨UPDATE: I never thought that Typing could get Typeless! Meet Typeless 1.0.2 for Mac that has made your voice so powerful. Dictate, Translate & Ask anything in any language or accent and #Typeless 1.0.2 will type it for you 10x faster with errors fixed. 1/ Dictation: With Typeless dictation, you'll get the smartest voice keyboard that understands your intent, helps organize thoughts, and turns your natural speech into clear, structured, perfect writing in every application. Press "Fn" Key to start and stop dictation. Or hold to say something short. 2/ Translation: With Typeless translation, you can talk in your own first language, and Typeless will translate it into any target language—empowering you to write in every foreign language just like a native speaker. "Fn" + "Space" Keys to Start Translation and "Fn" Key to stop translation. 3/ Ask Anything: With Typeless Ask Anything, you can use your voice to make edits to any selected text and simply say how you want to change it, get quick answers, and do quick actions. Press "Fn" + "Space" Keys to start ask anything and "Fn" stop asking anything.

🚨UPDATE: I never thought that Typing could get Typeless! Meet Typeless 1.0.2 for Mac that has made your voice so powerful. Dictate, Translate & Ask anything in any language or accent and #Typeless 1.0.2 will type it for you 10x faster with errors fixed. 1/ Dictation: With Typeless dictation, you'll get the smartest voice keyboard that understands your intent, helps organize thoughts, and turns your natural speech into clear, structured, perfect writing in every application. Press "Fn" Key to start and stop dictation. Or hold to say something short. 2/ Translation: With Typeless translation, you can talk in your own first language, and Typeless will translate it into any target language—empowering you to write in every foreign language just like a native speaker. "Fn" + "Space" Keys to Start Translation and "Fn" Key to stop translation. 3/ Ask Anything: With Typeless Ask Anything, you can use your voice to make edits to any selected text and simply say how you want to change it, get quick answers, and do quick actions. Press "Fn" + "Space" Keys to start ask anything and "Fn" stop asking anything.

Wesley

173,808 views • 4 months ago

This is the most important part of Anura Kumara Dissanayake’s statement to Parliament today. Unfortunately, the official translation did not do justice to what he said. Here is the exact text, along with a fairly reasonable English translation.

This is the most important part of Anura Kumara Dissanayake’s statement to Parliament today. Unfortunately, the official translation did not do justice to what he said. Here is the exact text, along with a fairly reasonable English translation.

Ranga Sirilal

14,169 views • 3 months ago

Add near real-time voice translation to your apps with Gemini 3.5 Live Translate via the Gemini Live API. 🎙️ Watch how the model handles live broadcast ingestion and translation with continuous speech-to-speech streaming (S2ST) and synced transcripts, letting users tune into global radio broadcasts in their native language.

Add near real-time voice translation to your apps with Gemini 3.5 Live Translate via the Gemini Live API. 🎙️ Watch how the model handles live broadcast ingestion and translation with continuous speech-to-speech streaming (S2ST) and synced transcripts, letting users tune into global radio broadcasts in their native language.

Google AI Developers

3,543,687 views • 29 days ago

Google Translate is getting new AI-powered updates that provide more context and clearer nuances for your translations. English is my second language and this would've been a lifesaver when I was learning English. You can now: 📲 Easily see translation alternatives with quick explanations of when/why/how to use each one 💬 Tap “understand” to dive deeper on the nuances of translation options 🗣️ Seamlessly ask follow up questions and refine your translation for your specific conversation

Google Translate is getting new AI-powered updates that provide more context and clearer nuances for your translations. English is my second language and this would've been a lifesaver when I was learning English. You can now: 📲 Easily see translation alternatives with quick explanations of when/why/how to use each one 💬 Tap “understand” to dive deeper on the nuances of translation options 🗣️ Seamlessly ask follow up questions and refine your translation for your specific conversation

Rose Yao

35,616 views • 4 months ago

How to translate videos to any language

How to translate videos to any language

BC🇬🇭🇺🇸

23,624 views • 1 year ago

We're releasing Hibiki-Zero, a new real-time and multilingual speech translation model that can translate 🇫🇷French, 🇪🇸Spanish, 🇵🇹Portuguese and 🇩🇪German to English: accurate, low-latency, high audio quality, with voice transfer. And best of all: open-source.

We're releasing Hibiki-Zero, a new real-time and multilingual speech translation model that can translate 🇫🇷French, 🇪🇸Spanish, 🇵🇹Portuguese and 🇩🇪German to English: accurate, low-latency, high audio quality, with voice transfer. And best of all: open-source.

kyutai

80,693 views • 4 months ago

Listen up 🔊 We’ve made some updates to our Gemini Audio models and capabilities: — Gemini’s live speech-to-speech translation capability is rolling out in a beta experience to the Google Translate app, bringing you real-time audio translation that captures the nuance of human speech — Gemini 2.5 Flash and 2.5 Pro Text-to-Speech preview models bring improved adherence to style prompts, precision pacing with context-aware speed adjustments, and character voice consistency for multi-speaker scenarios — Gemini 2.5 Flash Native Audio is now updated, with improvements to handle complex workflows, navigate user instructions, and hold natural conversations

Listen up 🔊 We’ve made some updates to our Gemini Audio models and capabilities: — Gemini’s live speech-to-speech translation capability is rolling out in a beta experience to the Google Translate app, bringing you real-time audio translation that captures the nuance of human speech — Gemini 2.5 Flash and 2.5 Pro Text-to-Speech preview models bring improved adherence to style prompts, precision pacing with context-aware speed adjustments, and character voice consistency for multi-speaker scenarios — Gemini 2.5 Flash Native Audio is now updated, with improvements to handle complex workflows, navigate user instructions, and hold natural conversations

Google AI

1,092,358 views • 7 months ago