Loading video...

Video Failed to Load

Go Home

🔥Introducing VILA: The next-gen VLM for Video and inter-leaved image understanding with Apache-2.0 license! Is VILA the best in-class small VLM for edge-deployment? Keep reading🧵 👀

Gradio's profile picture

Gradio

56,939 subscribers

51,694 views • 2 years ago •via X (Twitter)

EducationArtsScience & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

this is the BEST vision language model I have ever tried! Aria is a new model by Rhymes.AI: a 25.3B multimodal model that can take image/video inputs 🤩 They release the model with Apache-2.0 license and fine-tuning scripts as well 👏 I tested it extensively, keep reading to learn more 🧶
0:10

this is the BEST vision language model I have ever tried! Aria is a new model by Rhymes.AI: a 25.3B multimodal model that can take image/video inputs 🤩 They release the model with Apache-2.0 license and fine-tuning scripts as well 👏 I tested it extensively, keep reading to learn more 🧶

merve

176,121 views • 1 year ago

Trending: Step1X-3D for generating high-fidelity 3D assets with versatile textures! Apache-2.0 with exceptional results in terms of geometry and texture mapping🔥🔥
0:16

Trending: Step1X-3D for generating high-fidelity 3D assets with versatile textures! Apache-2.0 with exceptional results in terms of geometry and texture mapping🔥🔥

Gradio

36,405 views • 1 year ago

Can a VLM see without a vision encoder? We trained one for $100, inspired by Gemma 4 12B. Latency on an M3 Pro MacBook: 112 ms -> 1.1 ms for the image path 30% lower end-to-end image+LLM The architecture is just: patchify the image -> linear projection with pos embeddings -> LLM Writeup:
0:12

Can a VLM see without a vision encoder? We trained one for $100, inspired by Gemma 4 12B. Latency on an M3 Pro MacBook: 112 ms -> 1.1 ms for the image path 30% lower end-to-end image+LLM The architecture is just: patchify the image -> linear projection with pos embeddings -> LLM Writeup:

Andi Marafioti

60,319 views • 1 month ago

We may have a new best image-to-video model 👀 I’ve been testing Kling 2.0 more and am really impressed with the results. Veo 2 was previously best-in-class (IMO), but Kling has more motion and maintains coherence.
0:15

We may have a new best image-to-video model 👀 I’ve been testing Kling 2.0 more and am really impressed with the results. Veo 2 was previously best-in-class (IMO), but Kling has more motion and maintains coherence.

Justine Moore

41,475 views • 1 year ago

Before the week ends, let's acknowledge one of the most INSANE week ever for open AI, with 25+ notable open-weight drops across every modality: 🧠 LLMs → NVIDIA Nemotron 3 Ultra: 550B hybrid Mamba-MoE, only 55B active, 1M context, MMLU 89.1. NVFP4 variant claims ~5x throughput on Blackwell. First openly-weighted 550B hybrid Mamba-Transformer, closing the gap with frontier closed models. → Google Gemma 4 12B: fully open dense any-to-any (text/image/audio/video), 256k context, encoder-free, 140+ languages, AIME 2026 at 77.5. Shipped with a 23-checkpoint QAT wave (mobile ONNX + MLX). Most deployable model of the week. → StepFun Step-3.7-Flash: 198B sparse MoE VLM, ~11B active, SWE-Bench PRO 56.3. Apache 2.0. → Liquid AI LFM2.5-8B-A1B: edge MoE, just 1.5B active, 128k ctx, MATH500 88.8, MLX-ready. Best on-device option this week. → JetBrains Mellum2-12B-A2.5B-Thinking: their first open MoE, near-Qwen3-14B coding at 2.5B active. Apache 2.0. 🎨 Image gen (the surprise of the week) → Ideogram 4: their FIRST-EVER open weights. 9.3B flow-matching DiT trained from scratch. #2 overall behind GPT Image 2, top open-weight model on Design Arena + LMArena. Strongest open checkpoint for text-rich images, full stop. It has taste. Still can't believe this is open weights. 🔊 Audio & Speech (a breakout week for open TTS, 4 labs shipped) → Boson Higgs Audio v3 4B: 102 languages, 21 emotions, singing/whispering/shouting, sub-second TTFA. → RedNote dots.tts: the only fully continuous (no codec) open TTS pipeline, Apache 2.0. → Google Magenta RealTime 2: real-time music gen, <200ms latency, text+audio+MIDI. multimodalart ported it to PyTorch within hours with live ZeroGPU demos. → NVIDIA Nemotron-3.5 ASR: 600M streaming, 17x more concurrent streams vs Parakeet RNNT 1.1B. 👁️ Vision & VLMs → PaddleOCR-VL-1.6: SOTA document parsing at 1B params, Apache 2.0. → Baidu NAVA: 6.3B joint audio-video gen, best-in-class A/V sync, Apache 2.0. 🎬 Video, 3D & World Models → NVIDIA Cosmos3-Super: 64B omnimodal world model coupling action trajectories with video+audio gen, for Physical AI. → JD JoyAI-Echo: up to 5-min multi-shot text-to-video on LTX-2.3. → ByteDance Bernini-R + VAST TripoSplat (single-image-to-3D Gaussian splats, MIT).
0:14

Before the week ends, let's acknowledge one of the most INSANE week ever for open AI, with 25+ notable open-weight drops across every modality: 🧠 LLMs → NVIDIA Nemotron 3 Ultra: 550B hybrid Mamba-MoE, only 55B active, 1M context, MMLU 89.1. NVFP4 variant claims ~5x throughput on Blackwell. First openly-weighted 550B hybrid Mamba-Transformer, closing the gap with frontier closed models. → Google Gemma 4 12B: fully open dense any-to-any (text/image/audio/video), 256k context, encoder-free, 140+ languages, AIME 2026 at 77.5. Shipped with a 23-checkpoint QAT wave (mobile ONNX + MLX). Most deployable model of the week. → StepFun Step-3.7-Flash: 198B sparse MoE VLM, ~11B active, SWE-Bench PRO 56.3. Apache 2.0. → Liquid AI LFM2.5-8B-A1B: edge MoE, just 1.5B active, 128k ctx, MATH500 88.8, MLX-ready. Best on-device option this week. → JetBrains Mellum2-12B-A2.5B-Thinking: their first open MoE, near-Qwen3-14B coding at 2.5B active. Apache 2.0. 🎨 Image gen (the surprise of the week) → Ideogram 4: their FIRST-EVER open weights. 9.3B flow-matching DiT trained from scratch. #2 overall behind GPT Image 2, top open-weight model on Design Arena + LMArena. Strongest open checkpoint for text-rich images, full stop. It has taste. Still can't believe this is open weights. 🔊 Audio & Speech (a breakout week for open TTS, 4 labs shipped) → Boson Higgs Audio v3 4B: 102 languages, 21 emotions, singing/whispering/shouting, sub-second TTFA. → RedNote dots.tts: the only fully continuous (no codec) open TTS pipeline, Apache 2.0. → Google Magenta RealTime 2: real-time music gen, <200ms latency, text+audio+MIDI. multimodalart ported it to PyTorch within hours with live ZeroGPU demos. → NVIDIA Nemotron-3.5 ASR: 600M streaming, 17x more concurrent streams vs Parakeet RNNT 1.1B. 👁️ Vision & VLMs → PaddleOCR-VL-1.6: SOTA document parsing at 1B params, Apache 2.0. → Baidu NAVA: 6.3B joint audio-video gen, best-in-class A/V sync, Apache 2.0. 🎬 Video, 3D & World Models → NVIDIA Cosmos3-Super: 64B omnimodal world model coupling action trajectories with video+audio gen, for Physical AI. → JD JoyAI-Echo: up to 5-min multi-shot text-to-video on LTX-2.3. → ByteDance Bernini-R + VAST TripoSplat (single-image-to-3D Gaussian splats, MIT).

Victor M

540,708 views • 2 months ago

Seedance 2.0 is now officially available on GlobalGPT at 50% OFF! Realistic physics, native audio-video generation, and best-in-class image control for AI video. Now avaiable for all regions. No limits. No restrictions. No invite codes.👇
0:15

Seedance 2.0 is now officially available on GlobalGPT at 50% OFF! Realistic physics, native audio-video generation, and best-in-class image control for AI video. Now avaiable for all regions. No limits. No restrictions. No invite codes.👇

Kylie

65,922 views • 3 months ago

BREAKING: Seedance 2.0 is now officially available on GlobalGPT at 50% OFF! Realistic physics, native audio-video generation, and best-in-class image control for AI video. Now avaiable for all regions. No limits. No restrictions. No invite codes.👇
0:13

BREAKING: Seedance 2.0 is now officially available on GlobalGPT at 50% OFF! Realistic physics, native audio-video generation, and best-in-class image control for AI video. Now avaiable for all regions. No limits. No restrictions. No invite codes.👇

Zohaib Ai

13,913 views • 3 months ago

introducing Seedance 2.0. the world's most powerful video model, supporting text, image, video, and even audio as input, and capable of producing long multi-shot videos with high quality. now available for everyone.
0:14

introducing Seedance 2.0. the world's most powerful video model, supporting text, image, video, and even audio as input, and capable of producing long multi-shot videos with high quality. now available for everyone.

Krea

44,876 views • 4 months ago

💥 Seedance 2.0 is HERE on GlobalGPT. 50% OFF. All regions. No invite codes. Realistic physics + native audio-video + best-in-class image control. This is the one. 👇
0:15

💥 Seedance 2.0 is HERE on GlobalGPT. 50% OFF. All regions. No invite codes. Realistic physics + native audio-video + best-in-class image control. This is the one. 👇

MAPUNDA

69,856 views • 3 months ago

If you're still living under a rock and don't know how to access seedance 2.0 to generate videos like this > spin up a Hongkong VPN > Visit doubao [dot] com > select image gen and make sure seedance 4.5 is selected you won't believe the next step but: > tell the image gen model to make a video and it'll start generating a video using the latest seedance 2.0
0:10

If you're still living under a rock and don't know how to access seedance 2.0 to generate videos like this > spin up a Hongkong VPN > Visit doubao [dot] com > select image gen and make sure seedance 4.5 is selected you won't believe the next step but: > tell the image gen model to make a video and it'll start generating a video using the latest seedance 2.0

Akshit Verma

108,796 views • 5 months ago

Seedance 2.0 got its perfect match on Higgsfield. Grok Imagine and Seedance 2.0 - xAI's image model paired with the category-leading video model, natively inside the platform. Grok Imagine generates your reference image in 9+ styles, fast. Seedance 2.0 - ranked #1 in image-to-video - takes it further than any other model can. The best results out of Seedance 2.0 start here.
0:14

Seedance 2.0 got its perfect match on Higgsfield. Grok Imagine and Seedance 2.0 - xAI's image model paired with the category-leading video model, natively inside the platform. Grok Imagine generates your reference image in 9+ styles, fast. Seedance 2.0 - ranked #1 in image-to-video - takes it further than any other model can. The best results out of Seedance 2.0 start here.

Higgsfield AI 🧩

10,148,537 views • 4 months ago

The ARM has landed. Anoma is live on Ethereum. The next-gen VM at the heart of Anoma’s distributed OS, the ARM brings native intents and best-in-class privacy to any chain, starting with Ethereum. A new era for decentralized applications starts today.
0:14

The ARM has landed. Anoma is live on Ethereum. The next-gen VM at the heart of Anoma’s distributed OS, the ARM brings native intents and best-in-class privacy to any chain, starting with Ethereum. A new era for decentralized applications starts today.

Anoma

211,295 views • 8 months ago

🔥 KEEP - New sota for video face super-resolution
0:13

🔥 KEEP - New sota for video face super-resolution

Gradio

53,631 views • 1 year ago

GPT Image 2.0 + Seedance 2.0 is a powerful combo for game scene creation. Generate the character UI, loading screen, HUD, and cinematic gameplay look with GPT Image 2.0, then use Seedance 2.0 to turn it into a smooth one-shot game demo video.
0:15

GPT Image 2.0 + Seedance 2.0 is a powerful combo for game scene creation. Generate the character UI, loading screen, HUD, and cinematic gameplay look with GPT Image 2.0, then use Seedance 2.0 to turn it into a smooth one-shot game demo video.

BudgetPixel AI

730,287 views • 3 months ago

Seedance 2.0 in native 4K. Best-in-class particle physics, lighting fidelity, depth of scale, and shadow detail. The best model for cinematic storytelling.
0:15

Seedance 2.0 in native 4K. Best-in-class particle physics, lighting fidelity, depth of scale, and shadow detail. The best model for cinematic storytelling.

Higgsfield AI 🧩

47,106 views • 1 month ago

Introducing Top Yapper Opinions For the next 10 days, the most viral opinions from Kaito's Top 20 Emerging Yappers leaderboard will be tokenized daily on opinions.fun During that time Yappers receive 100% of platform trading fees from their opinions. Keep reading 🧵
0:14

Introducing Top Yapper Opinions For the next 10 days, the most viral opinions from Kaito's Top 20 Emerging Yappers leaderboard will be tokenized daily on opinions.fun During that time Yappers receive 100% of platform trading fees from their opinions. Keep reading 🧵

opinions.fun

16,110 views • 1 year ago

GPT Image 2.0 is at the forefront of AI image generation, while Seedance 2.0 is raising the standard for AI video. Neither is tied to a single ecosystem they’re both widely accessible across different platforms. Whether through ChatGPT, the OpenAI API, or various third-party tools, GPT Image 2.0 integrates into existing workflows, and Seedance 2.0 offers the same flexibility.
0:10

GPT Image 2.0 is at the forefront of AI image generation, while Seedance 2.0 is raising the standard for AI video. Neither is tied to a single ecosystem they’re both widely accessible across different platforms. Whether through ChatGPT, the OpenAI API, or various third-party tools, GPT Image 2.0 integrates into existing workflows, and Seedance 2.0 offers the same flexibility.

Lifetime

46,368 views • 3 months ago