Загрузка видео...

Не удалось загрузить видео

На главную

Introducing Omni, one unified model can support any-to-any multimodal modeling, including multimodal understanding, image/video generation and editing, world modeling and 3D reconstruction. All in one that adopts standard mixture-of-experts arch with only 3B activations.

CeyuanY's profile picture

Ceyuan Yang

2,195 subscribers

31,625 просмотров • 3 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

We’re open-sourcing HY-World 2.0, a multimodal world model that generates, reconstructs, and simulates interactive *3D worlds* from text, images, and videos. Outputs can be integrated into game engines and embodied simulation pipelines. Key highlights: 🔹 One-click world generation Turn text or image into interactive 3D worlds automatically. 🔹 Pipeline-ready 3D outputs Editable 3D worlds for Unity and Unreal Engine, with standard 3D exports including mesh, 3DGS, and point clouds. 🔹 Unified world model system One model family for world generation and reconstruction across synthetic and real-world scenes. 🔹 Interactive character mode Explore generated 3D worlds in real time with physics-aware movement and collision support. ✨ Apply for access: 🔗 GitHub: 🤗 Hugging Face: 📄 Technical Report:
1:04

We’re open-sourcing HY-World 2.0, a multimodal world model that generates, reconstructs, and simulates interactive *3D worlds* from text, images, and videos. Outputs can be integrated into game engines and embodied simulation pipelines. Key highlights: 🔹 One-click world generation Turn text or image into interactive 3D worlds automatically. 🔹 Pipeline-ready 3D outputs Editable 3D worlds for Unity and Unreal Engine, with standard 3D exports including mesh, 3DGS, and point clouds. 🔹 Unified world model system One model family for world generation and reconstruction across synthetic and real-world scenes. 🔹 Interactive character mode Explore generated 3D worlds in real time with physics-aware movement and collision support. ✨ Apply for access: 🔗 GitHub: 🤗 Hugging Face: 📄 Technical Report:

Tencent Hy

371,581 просмотров • 4 месяцев назад

Rewrite The Odyssey in your own playable game demo! No 3D modeling, no coding, just one image! With HappyOyster World Model, you can turn any image into an interactive game demo in seconds.
0:41

Rewrite The Odyssey in your own playable game demo! No 3D modeling, no coding, just one image! With HappyOyster World Model, you can turn any image into an interactive game demo in seconds.

HappyOyster

1,659,412 просмотров • 12 дней назад

Meet Gemini Omni Flash on SeaArt. A natively multimodal model for video generation and conversational editing. Edit with natural language. Keep scenes and story consistent across edits. Motion follows real-world physics and logic. From prompt to scene — in one flow.
0:20

Meet Gemini Omni Flash on SeaArt. A natively multimodal model for video generation and conversational editing. Edit with natural language. Keep scenes and story consistent across edits. Motion follows real-world physics and logic. From prompt to scene — in one flow.

SeaArt.Ai🐋

30,455 просмотров • 1 месяц назад

🔥 Introducing Genie 1.0, our first step towards building multimodal AI. Genie is a text-to-3d model capable of creating any 3d object you can dream of in under 10 seconds with materials, quad mesh retopology, variable polycount, and in all standard formats! Try it on web and in Luma’s iOS app now → #generativeai #textto3d #multimodalai
0:30

🔥 Introducing Genie 1.0, our first step towards building multimodal AI. Genie is a text-to-3d model capable of creating any 3d object you can dream of in under 10 seconds with materials, quad mesh retopology, variable polycount, and in all standard formats! Try it on web and in Luma’s iOS app now → #generativeai #textto3d #multimodalai

Luma

1,242,101 просмотров • 2 лет назад

Super excited to introduce Gemma 4 12B! 💎 - Multimodal: audio, image, video, and text input - Novel architecture: we removed the multimodal encoders for a unified, streamlined arch - New MacOS desktop app powered by LiteRT - MTP support Excited to see what you build with it!
1:39

Super excited to introduce Gemma 4 12B! 💎 - Multimodal: audio, image, video, and text input - Novel architecture: we removed the multimodal encoders for a unified, streamlined arch - New MacOS desktop app powered by LiteRT - MTP support Excited to see what you build with it!

Omar Sanseviero

125,656 просмотров • 2 месяцев назад

One for all, and all for one 🧧 Introducing Ming-flash-omni-2.0: A specialist in every domain, unified as a capable generalist. A gift from Ling =) - Unified Acoustic Synthesis: Speech, audio, and music combined for unbounded creativity; - "Seeing" to "Knowing": Moving beyond input to true deep semantic understanding; - Native Visual Fusion: Seamless generation, editing, and segmentation;
1:36

One for all, and all for one 🧧 Introducing Ming-flash-omni-2.0: A specialist in every domain, unified as a capable generalist. A gift from Ling =) - Unified Acoustic Synthesis: Speech, audio, and music combined for unbounded creativity; - "Seeing" to "Knowing": Moving beyond input to true deep semantic understanding; - Native Visual Fusion: Seamless generation, editing, and segmentation;

Ant Ling

1,925,484 просмотров • 6 месяцев назад

✨ All in One, Wan for All✨ We are excited to introduce our latest model to our talented community creators: Wan2.1-VACE, All-in-One Video Creation and Editing model. Model size: 1.3B, 14B License: Apache-2.0 📌 Wan2.1-VACE provides solutions for various tasks, including reference-to-video generation (R2V), video-to-video editing (V2V), and masked video-to-video editing (MV2V), allowing creators to freely combine these capabilities to achieve complex tasks. 👉 Multimodal inputs enhancing the controllability of video generation. 👉 Unified single model for consistent solutions across tasks. 👉 Free combination of capabilities unlocking deeper creative potentials. 😄 Wanna try? 1️⃣ Github: 2️⃣Hugging Face: 3️⃣ ModelScope: 4️⃣ API Service: 5️⃣ Coming soon!
1:06

✨ All in One, Wan for All✨ We are excited to introduce our latest model to our talented community creators: Wan2.1-VACE, All-in-One Video Creation and Editing model. Model size: 1.3B, 14B License: Apache-2.0 📌 Wan2.1-VACE provides solutions for various tasks, including reference-to-video generation (R2V), video-to-video editing (V2V), and masked video-to-video editing (MV2V), allowing creators to freely combine these capabilities to achieve complex tasks. 👉 Multimodal inputs enhancing the controllability of video generation. 👉 Unified single model for consistent solutions across tasks. 👉 Free combination of capabilities unlocking deeper creative potentials. 😄 Wanna try? 1️⃣ Github: 2️⃣Hugging Face: 3️⃣ ModelScope: 4️⃣ API Service: 5️⃣ Coming soon!

Wan

198,569 просмотров • 1 год назад

We asked Logan Kilpatrick what stood out most from Google I/O. His answer: Gemini Omni, Google's new multimodal AI model. "The model can take in any input and produce any output. Text, audio, video, image." "You get a bunch of really interesting capability transfer when you bring it all into a single model." Right now the killer use case is video editing. "It's like having a VFX studio on demand."
1:55

We asked Logan Kilpatrick what stood out most from Google I/O. His answer: Gemini Omni, Google's new multimodal AI model. "The model can take in any input and produce any output. Text, audio, video, image." "You get a bunch of really interesting capability transfer when you bring it all into a single model." Right now the killer use case is video editing. "It's like having a VFX studio on demand."

MTS

18,884 просмотров • 2 месяцев назад

(1/10) 🔥Thrilled to introduce OneDiffusion—our latest work in unified diffusion modeling! 🚀 This model bridges the gap between image synthesis and understanding, excelling in a wide range of tasks: T2I, conditional generation, image understanding, identity preservation, multiview generation, and even camera pose estimation. Learn more at: Project: arXiv: Code (on the way):
1:22

(1/10) 🔥Thrilled to introduce OneDiffusion—our latest work in unified diffusion modeling! 🚀 This model bridges the gap between image synthesis and understanding, excelling in a wide range of tasks: T2I, conditional generation, image understanding, identity preservation, multiview generation, and even camera pose estimation. Learn more at: Project: arXiv: Code (on the way):

Jiasen Lu

33,426 просмотров • 1 год назад

Seedance 2.5 is now live on Byteplus Lumina! • Generate native 30s videos in a single generation • Reshape any part of the frame with next-level video editing control • Take full control of your production with up to 50 multimodal references, now with support for 3D white models
1:09

Seedance 2.5 is now live on Byteplus Lumina! • Generate native 30s videos in a single generation • Reshape any part of the frame with next-level video editing control • Take full control of your production with up to 50 multimodal references, now with support for 3D white models

Lumina

895,379 просмотров • 10 дней назад

Introducing DJI Modify, DJI's first 3D model editing software that seamlessly integrates with DJI Terra. With various 3D model retouching features, it caters to various industries and offers solutions for common modeling issues. Try it for FREE 👉
0:59

Introducing DJI Modify, DJI's first 3D model editing software that seamlessly integrates with DJI Terra. With various 3D model retouching features, it caters to various industries and offers solutions for common modeling issues. Try it for FREE 👉

DJI Enterprise

41,636 просмотров • 2 лет назад

🚀 Introducing Emu3.5 — a large-scale multimodal world model that natively predicts the next vision-language state. 🔥 Trained on over 10T interleaved vision-language tokens and enhanced with reinforcement learning, Emu3.5 achieves powerful multimodal reasoning and generation. ⚡ Powered by our new Discrete Diffusion Adaptation (DiDA) for 20× faster inference. 🔥 Emu3.5 outperforms Nano Banana across image generation, editing, interleaved tasks and more. 🌍 Explore Emu3.5: Github: #Emu3 #MultimodalAI #WorldModel #NextTokenPrediction
2:10

🚀 Introducing Emu3.5 — a large-scale multimodal world model that natively predicts the next vision-language state. 🔥 Trained on over 10T interleaved vision-language tokens and enhanced with reinforcement learning, Emu3.5 achieves powerful multimodal reasoning and generation. ⚡ Powered by our new Discrete Diffusion Adaptation (DiDA) for 20× faster inference. 🔥 Emu3.5 outperforms Nano Banana across image generation, editing, interleaved tasks and more. 🌍 Explore Emu3.5: Github: #Emu3 #MultimodalAI #WorldModel #NextTokenPrediction

BAAI

51,880 просмотров • 9 месяцев назад

“ xAI team is currently working heavily on coding models. Right now, the main focus is training a specialized coding model that will be both fast and smart. I believe we’ll share it with you guys in a few weeks. That’s exciting. Second ,after coding, we all see that the main weakness of Grok 4 is its multimodal capabilities. In fact, it was so bad that Grok was effectively looking at the world while squinting through glass trying to see blurry features and make sense of them. The most immediate improvement we’re stepping on with the next generation pre trained model is huge gains in image understanding, video understanding, and audio. Right now, the model can hear and see the world just like any of you. And with all the tools and other agents it can talk to, we’re going to see a huge unlock for many different application layers once multimodal agents arrive.” — xAI Team
2:01

“ xAI team is currently working heavily on coding models. Right now, the main focus is training a specialized coding model that will be both fast and smart. I believe we’ll share it with you guys in a few weeks. That’s exciting. Second ,after coding, we all see that the main weakness of Grok 4 is its multimodal capabilities. In fact, it was so bad that Grok was effectively looking at the world while squinting through glass trying to see blurry features and make sense of them. The most immediate improvement we’re stepping on with the next generation pre trained model is huge gains in image understanding, video understanding, and audio. Right now, the model can hear and see the world just like any of you. And with all the tools and other agents it can talk to, we’re going to see a huge unlock for many different application layers once multimodal agents arrive.” — xAI Team

Apurv Kochara

88,142 просмотров • 5 месяцев назад

Today we’re taking a big step on the path toward AGI and releasing Gemini 3— our most intelligent model yet. With Gemini 3, you can bring any idea to life. It is state-of-the-art in reasoning, the best model in the world for multimodal understanding, and our best agentic and vibe coding model.
0:51

Today we’re taking a big step on the path toward AGI and releasing Gemini 3— our most intelligent model yet. With Gemini 3, you can bring any idea to life. It is state-of-the-art in reasoning, the best model in the world for multimodal understanding, and our best agentic and vibe coding model.

Google AI

492,973 просмотров • 8 месяцев назад

Download UE5 AVATAR METAVANCE for Free! Create your personalized AVATAR with real-time CG movie-quality rendering, all powered by UE5. Modify 3D models, outfits, and appearances instantly—no need for Maya modeling or complex rigging. Future updates will support 3D model import/export and image-to-3D face generation, making 3D model creation accessible to everyone—no professional skills required! 🚀
2:20

Download UE5 AVATAR METAVANCE for Free! Create your personalized AVATAR with real-time CG movie-quality rendering, all powered by UE5. Modify 3D models, outfits, and appearances instantly—no need for Maya modeling or complex rigging. Future updates will support 3D model import/export and image-to-3D face generation, making 3D model creation accessible to everyone—no professional skills required! 🚀

CYANPUPPETS

28,742 просмотров • 1 год назад

💥 Introducing MiniCPM-o 2.6: An 8B size, GPT-4o level Omni Model runs on device ✨ Highlights: ~Match GPT-4o-202405 in vision, audio and multimodal live streaming ~End-to-end real-time bilingual audio conversation ~Voice cloning & emotion control ~Advanced OCR & video understanding ~Offline iPad-compatible multimodal live streaming 🔗 Try it out: GitHub: HF: Demo:
6:40

💥 Introducing MiniCPM-o 2.6: An 8B size, GPT-4o level Omni Model runs on device ✨ Highlights: ~Match GPT-4o-202405 in vision, audio and multimodal live streaming ~End-to-end real-time bilingual audio conversation ~Voice cloning & emotion control ~Advanced OCR & video understanding ~Offline iPad-compatible multimodal live streaming 🔗 Try it out: GitHub: HF: Demo:

OpenBMB

97,770 просмотров • 1 год назад

Gemini Omni Flash is now live on fal Any-input video with synchronized audio and conversational scene-preserving editing Improved intuitive understanding of gravity, kinetic energy, and fluid dynamics Produces the visuals and their matching sound together in one pass
0:32

Gemini Omni Flash is now live on fal Any-input video with synchronized audio and conversational scene-preserving editing Improved intuitive understanding of gravity, kinetic energy, and fluid dynamics Produces the visuals and their matching sound together in one pass

fal

21,661 просмотров • 1 месяц назад

Introducing Video Generation in Omma - Text to video - Image to video Make videos, and add them to any website, app or 3d scene. Available Now for Pro/Max users.
0:23

Introducing Video Generation in Omma - Text to video - Image to video Make videos, and add them to any website, app or 3d scene. Available Now for Pro/Max users.

Omma AI

11,700 просмотров • 4 месяцев назад