Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Introducing Omni, one unified model can support any-to-any multimodal modeling, including multimodal understanding, image/video generation and editing, world modeling and 3D reconstruction. All in one that adopts standard mixture-of-experts arch with only 3B activations.

Ceyuan Yang

2,195 subscribers

31,625 views • 3 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

We’re open-sourcing HY-World 2.0, a multimodal world model that generates, reconstructs, and simulates interactive *3D worlds* from text, images, and videos. Outputs can be integrated into game engines and embodied simulation pipelines. Key highlights: 🔹 One-click world generation Turn text or image into interactive 3D worlds automatically. 🔹 Pipeline-ready 3D outputs Editable 3D worlds for Unity and Unreal Engine, with standard 3D exports including mesh, 3DGS, and point clouds. 🔹 Unified world model system One model family for world generation and reconstruction across synthetic and real-world scenes. 🔹 Interactive character mode Explore generated 3D worlds in real time with physics-aware movement and collision support. ✨ Apply for access: 🔗 GitHub: 🤗 Hugging Face: 📄 Technical Report:

We’re open-sourcing HY-World 2.0, a multimodal world model that generates, reconstructs, and simulates interactive 3D worlds from text, images, and videos. Outputs can be integrated into game engines and embodied simulation pipelines. Key highlights: 🔹 One-click world generation Turn text or image into interactive 3D worlds automatically. 🔹 Pipeline-ready 3D outputs Editable 3D worlds for Unity and Unreal Engine, with standard 3D exports including mesh, 3DGS, and point clouds. 🔹 Unified world model system One model family for world generation and reconstruction across synthetic and real-world scenes. 🔹 Interactive character mode Explore generated 3D worlds in real time with physics-aware movement and collision support. ✨ Apply for access: 🔗 GitHub: 🤗 Hugging Face: 📄 Technical Report:

Tencent Hy

371,581 views • 4 months ago

Rewrite The Odyssey in your own playable game demo! No 3D modeling, no coding, just one image! With HappyOyster World Model, you can turn any image into an interactive game demo in seconds.

Rewrite The Odyssey in your own playable game demo! No 3D modeling, no coding, just one image! With HappyOyster World Model, you can turn any image into an interactive game demo in seconds.

HappyOyster

1,659,412 views • 14 days ago

Meet Gemini Omni Flash on SeaArt. A natively multimodal model for video generation and conversational editing. Edit with natural language. Keep scenes and story consistent across edits. Motion follows real-world physics and logic. From prompt to scene — in one flow.

Meet Gemini Omni Flash on SeaArt. A natively multimodal model for video generation and conversational editing. Edit with natural language. Keep scenes and story consistent across edits. Motion follows real-world physics and logic. From prompt to scene — in one flow.

SeaArt.Ai🐋

30,455 views • 1 month ago

🔥 Introducing Genie 1.0, our first step towards building multimodal AI. Genie is a text-to-3d model capable of creating any 3d object you can dream of in under 10 seconds with materials, quad mesh retopology, variable polycount, and in all standard formats! Try it on web and in Luma’s iOS app now → #generativeai #textto3d #multimodalai

🔥 Introducing Genie 1.0, our first step towards building multimodal AI. Genie is a text-to-3d model capable of creating any 3d object you can dream of in under 10 seconds with materials, quad mesh retopology, variable polycount, and in all standard formats! Try it on web and in Luma’s iOS app now → #generativeai #textto3d #multimodalai

Luma

1,242,101 views • 2 years ago

Super excited to introduce Gemma 4 12B! 💎 - Multimodal: audio, image, video, and text input - Novel architecture: we removed the multimodal encoders for a unified, streamlined arch - New MacOS desktop app powered by LiteRT - MTP support Excited to see what you build with it!

Super excited to introduce Gemma 4 12B! 💎 - Multimodal: audio, image, video, and text input - Novel architecture: we removed the multimodal encoders for a unified, streamlined arch - New MacOS desktop app powered by LiteRT - MTP support Excited to see what you build with it!

Omar Sanseviero

125,656 views • 2 months ago

One for all, and all for one 🧧 Introducing Ming-flash-omni-2.0: A specialist in every domain, unified as a capable generalist. A gift from Ling =) - Unified Acoustic Synthesis: Speech, audio, and music combined for unbounded creativity; - "Seeing" to "Knowing": Moving beyond input to true deep semantic understanding; - Native Visual Fusion: Seamless generation, editing, and segmentation;

One for all, and all for one 🧧 Introducing Ming-flash-omni-2.0: A specialist in every domain, unified as a capable generalist. A gift from Ling =) - Unified Acoustic Synthesis: Speech, audio, and music combined for unbounded creativity; - "Seeing" to "Knowing": Moving beyond input to true deep semantic understanding; - Native Visual Fusion: Seamless generation, editing, and segmentation;

Ant Ling

1,925,484 views • 6 months ago

✨ All in One, Wan for All✨ We are excited to introduce our latest model to our talented community creators: Wan2.1-VACE, All-in-One Video Creation and Editing model. Model size: 1.3B, 14B License: Apache-2.0 📌 Wan2.1-VACE provides solutions for various tasks, including reference-to-video generation (R2V), video-to-video editing (V2V), and masked video-to-video editing (MV2V), allowing creators to freely combine these capabilities to achieve complex tasks. 👉 Multimodal inputs enhancing the controllability of video generation. 👉 Unified single model for consistent solutions across tasks. 👉 Free combination of capabilities unlocking deeper creative potentials. 😄 Wanna try? 1️⃣ Github: 2️⃣Hugging Face: 3️⃣ ModelScope: 4️⃣ API Service: 5️⃣ Coming soon!

✨ All in One, Wan for All✨ We are excited to introduce our latest model to our talented community creators: Wan2.1-VACE, All-in-One Video Creation and Editing model. Model size: 1.3B, 14B License: Apache-2.0 📌 Wan2.1-VACE provides solutions for various tasks, including reference-to-video generation (R2V), video-to-video editing (V2V), and masked video-to-video editing (MV2V), allowing creators to freely combine these capabilities to achieve complex tasks. 👉 Multimodal inputs enhancing the controllability of video generation. 👉 Unified single model for consistent solutions across tasks. 👉 Free combination of capabilities unlocking deeper creative potentials. 😄 Wanna try? 1️⃣ Github: 2️⃣Hugging Face: 3️⃣ ModelScope: 4️⃣ API Service: 5️⃣ Coming soon!

Wan

198,569 views • 1 year ago

We asked Logan Kilpatrick what stood out most from Google I/O. His answer: Gemini Omni, Google's new multimodal AI model. "The model can take in any input and produce any output. Text, audio, video, image." "You get a bunch of really interesting capability transfer when you bring it all into a single model." Right now the killer use case is video editing. "It's like having a VFX studio on demand."

We asked Logan Kilpatrick what stood out most from Google I/O. His answer: Gemini Omni, Google's new multimodal AI model. "The model can take in any input and produce any output. Text, audio, video, image." "You get a bunch of really interesting capability transfer when you bring it all into a single model." Right now the killer use case is video editing. "It's like having a VFX studio on demand."

MTS

18,884 views • 2 months ago

(1/10) 🔥Thrilled to introduce OneDiffusion—our latest work in unified diffusion modeling! 🚀 This model bridges the gap between image synthesis and understanding, excelling in a wide range of tasks: T2I, conditional generation, image understanding, identity preservation, multiview generation, and even camera pose estimation. Learn more at: Project: arXiv: Code (on the way):

(1/10) 🔥Thrilled to introduce OneDiffusion—our latest work in unified diffusion modeling! 🚀 This model bridges the gap between image synthesis and understanding, excelling in a wide range of tasks: T2I, conditional generation, image understanding, identity preservation, multiview generation, and even camera pose estimation. Learn more at: Project: arXiv: Code (on the way):

Jiasen Lu

33,426 views • 1 year ago

Seedance 2.5 is now live on Byteplus Lumina! • Generate native 30s videos in a single generation • Reshape any part of the frame with next-level video editing control • Take full control of your production with up to 50 multimodal references, now with support for 3D white models

Seedance 2.5 is now live on Byteplus Lumina! • Generate native 30s videos in a single generation • Reshape any part of the frame with next-level video editing control • Take full control of your production with up to 50 multimodal references, now with support for 3D white models

Lumina

895,379 views • 12 days ago

Introducing DJI Modify, DJI's first 3D model editing software that seamlessly integrates with DJI Terra. With various 3D model retouching features, it caters to various industries and offers solutions for common modeling issues. Try it for FREE 👉

Introducing DJI Modify, DJI's first 3D model editing software that seamlessly integrates with DJI Terra. With various 3D model retouching features, it caters to various industries and offers solutions for common modeling issues. Try it for FREE 👉

DJI Enterprise

41,636 views • 2 years ago

🚀 Introducing Emu3.5 — a large-scale multimodal world model that natively predicts the next vision-language state. 🔥 Trained on over 10T interleaved vision-language tokens and enhanced with reinforcement learning, Emu3.5 achieves powerful multimodal reasoning and generation. ⚡ Powered by our new Discrete Diffusion Adaptation (DiDA) for 20× faster inference. 🔥 Emu3.5 outperforms Nano Banana across image generation, editing, interleaved tasks and more. 🌍 Explore Emu3.5: Github: #Emu3 #MultimodalAI #WorldModel #NextTokenPrediction

🚀 Introducing Emu3.5 — a large-scale multimodal world model that natively predicts the next vision-language state. 🔥 Trained on over 10T interleaved vision-language tokens and enhanced with reinforcement learning, Emu3.5 achieves powerful multimodal reasoning and generation. ⚡ Powered by our new Discrete Diffusion Adaptation (DiDA) for 20× faster inference. 🔥 Emu3.5 outperforms Nano Banana across image generation, editing, interleaved tasks and more. 🌍 Explore Emu3.5: Github: #Emu3 #MultimodalAI #WorldModel #NextTokenPrediction

BAAI

51,880 views • 9 months ago

“ xAI team is currently working heavily on coding models. Right now, the main focus is training a specialized coding model that will be both fast and smart. I believe we’ll share it with you guys in a few weeks. That’s exciting. Second ,after coding, we all see that the main weakness of Grok 4 is its multimodal capabilities. In fact, it was so bad that Grok was effectively looking at the world while squinting through glass trying to see blurry features and make sense of them. The most immediate improvement we’re stepping on with the next generation pre trained model is huge gains in image understanding, video understanding, and audio. Right now, the model can hear and see the world just like any of you. And with all the tools and other agents it can talk to, we’re going to see a huge unlock for many different application layers once multimodal agents arrive.” — xAI Team

“ xAI team is currently working heavily on coding models. Right now, the main focus is training a specialized coding model that will be both fast and smart. I believe we’ll share it with you guys in a few weeks. That’s exciting. Second ,after coding, we all see that the main weakness of Grok 4 is its multimodal capabilities. In fact, it was so bad that Grok was effectively looking at the world while squinting through glass trying to see blurry features and make sense of them. The most immediate improvement we’re stepping on with the next generation pre trained model is huge gains in image understanding, video understanding, and audio. Right now, the model can hear and see the world just like any of you. And with all the tools and other agents it can talk to, we’re going to see a huge unlock for many different application layers once multimodal agents arrive.” — xAI Team

Apurv Kochara

88,142 views • 6 months ago

Today we’re taking a big step on the path toward AGI and releasing Gemini 3— our most intelligent model yet. With Gemini 3, you can bring any idea to life. It is state-of-the-art in reasoning, the best model in the world for multimodal understanding, and our best agentic and vibe coding model.

Today we’re taking a big step on the path toward AGI and releasing Gemini 3— our most intelligent model yet. With Gemini 3, you can bring any idea to life. It is state-of-the-art in reasoning, the best model in the world for multimodal understanding, and our best agentic and vibe coding model.

Google AI

492,973 views • 9 months ago

Download UE5 AVATAR METAVANCE for Free! Create your personalized AVATAR with real-time CG movie-quality rendering, all powered by UE5. Modify 3D models, outfits, and appearances instantly—no need for Maya modeling or complex rigging. Future updates will support 3D model import/export and image-to-3D face generation, making 3D model creation accessible to everyone—no professional skills required! 🚀

CYANPUPPETS

28,742 views • 1 year ago

Gemini Omni Flash is now live on fal Any-input video with synchronized audio and conversational scene-preserving editing Improved intuitive understanding of gravity, kinetic energy, and fluid dynamics Produces the visuals and their matching sound together in one pass

Gemini Omni Flash is now live on fal Any-input video with synchronized audio and conversational scene-preserving editing Improved intuitive understanding of gravity, kinetic energy, and fluid dynamics Produces the visuals and their matching sound together in one pass

fal

21,661 views • 1 month ago

💥 Introducing MiniCPM-o 2.6: An 8B size, GPT-4o level Omni Model runs on device ✨ Highlights: ~Match GPT-4o-202405 in vision, audio and multimodal live streaming ~End-to-end real-time bilingual audio conversation ~Voice cloning & emotion control ~Advanced OCR & video understanding ~Offline iPad-compatible multimodal live streaming 🔗 Try it out: GitHub: HF: Demo:

💥 Introducing MiniCPM-o 2.6: An 8B size, GPT-4o level Omni Model runs on device ✨ Highlights: ~Match GPT-4o-202405 in vision, audio and multimodal live streaming ~End-to-end real-time bilingual audio conversation ~Voice cloning & emotion control ~Advanced OCR & video understanding ~Offline iPad-compatible multimodal live streaming 🔗 Try it out: GitHub: HF: Demo:

OpenBMB

97,770 views • 1 year ago

Introducing Video Generation in Omma - Text to video - Image to video Make videos, and add them to any website, app or 3d scene. Available Now for Pro/Max users.

Introducing Video Generation in Omma - Text to video - Image to video Make videos, and add them to any website, app or 3d scene. Available Now for Pro/Max users.

Omma AI

11,709 views • 4 months ago