正在加载视频...

视频加载失败

返回首页

🔥Introducing VILA: The next-gen VLM for Video and inter-leaved image understanding with Apache-2.0 license! Is VILA the best in-class small VLM for edge-deployment? Keep reading🧵 👀

Gradio's profile picture

Gradio

56,939 subscribers

51,694 次观看 • 2 年前 •via X (Twitter)

教育艺术科学技术
LIVE

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

this is the BEST vision language model I have ever tried! Aria is a new model by Rhymes.AI: a 25.3B multimodal model that can take image/video inputs 🤩 They release the model with Apache-2.0 license and fine-tuning scripts as well 👏 I tested it extensively, keep reading to learn more 🧶
0:10

this is the BEST vision language model I have ever tried! Aria is a new model by Rhymes.AI: a 25.3B multimodal model that can take image/video inputs 🤩 They release the model with Apache-2.0 license and fine-tuning scripts as well 👏 I tested it extensively, keep reading to learn more 🧶

merve

176,125 次观看 • 1 年前

Trending: Step1X-3D for generating high-fidelity 3D assets with versatile textures! Apache-2.0 with exceptional results in terms of geometry and texture mapping🔥🔥
0:16

Trending: Step1X-3D for generating high-fidelity 3D assets with versatile textures! Apache-2.0 with exceptional results in terms of geometry and texture mapping🔥🔥

Gradio

36,405 次观看 • 1 年前

Can a VLM see without a vision encoder? We trained one for $100, inspired by Gemma 4 12B. Latency on an M3 Pro MacBook: 112 ms -> 1.1 ms for the image path 30% lower end-to-end image+LLM The architecture is just: patchify the image -> linear projection with pos embeddings -> LLM Writeup:
0:12

Can a VLM see without a vision encoder? We trained one for $100, inspired by Gemma 4 12B. Latency on an M3 Pro MacBook: 112 ms -> 1.1 ms for the image path 30% lower end-to-end image+LLM The architecture is just: patchify the image -> linear projection with pos embeddings -> LLM Writeup:

Andi Marafioti

60,319 次观看 • 1 个月前

We may have a new best image-to-video model 👀 I’ve been testing Kling 2.0 more and am really impressed with the results. Veo 2 was previously best-in-class (IMO), but Kling has more motion and maintains coherence.
0:15

We may have a new best image-to-video model 👀 I’ve been testing Kling 2.0 more and am really impressed with the results. Veo 2 was previously best-in-class (IMO), but Kling has more motion and maintains coherence.

Justine Moore

41,475 次观看 • 1 年前

Before the week ends, let's acknowledge one of the most INSANE week ever for open AI, with 25+ notable open-weight drops across every modality: 🧠 LLMs → NVIDIA Nemotron 3 Ultra: 550B hybrid Mamba-MoE, only 55B active, 1M context, MMLU 89.1. NVFP4 variant claims ~5x throughput on Blackwell. First openly-weighted 550B hybrid Mamba-Transformer, closing the gap with frontier closed models. → Google Gemma 4 12B: fully open dense any-to-any (text/image/audio/video), 256k context, encoder-free, 140+ languages, AIME 2026 at 77.5. Shipped with a 23-checkpoint QAT wave (mobile ONNX + MLX). Most deployable model of the week. → StepFun Step-3.7-Flash: 198B sparse MoE VLM, ~11B active, SWE-Bench PRO 56.3. Apache 2.0. → Liquid AI LFM2.5-8B-A1B: edge MoE, just 1.5B active, 128k ctx, MATH500 88.8, MLX-ready. Best on-device option this week. → JetBrains Mellum2-12B-A2.5B-Thinking: their first open MoE, near-Qwen3-14B coding at 2.5B active. Apache 2.0. 🎨 Image gen (the surprise of the week) → Ideogram 4: their FIRST-EVER open weights. 9.3B flow-matching DiT trained from scratch. #2 overall behind GPT Image 2, top open-weight model on Design Arena + LMArena. Strongest open checkpoint for text-rich images, full stop. It has taste. Still can't believe this is open weights. 🔊 Audio & Speech (a breakout week for open TTS, 4 labs shipped) → Boson Higgs Audio v3 4B: 102 languages, 21 emotions, singing/whispering/shouting, sub-second TTFA. → RedNote dots.tts: the only fully continuous (no codec) open TTS pipeline, Apache 2.0. → Google Magenta RealTime 2: real-time music gen, <200ms latency, text+audio+MIDI. multimodalart ported it to PyTorch within hours with live ZeroGPU demos. → NVIDIA Nemotron-3.5 ASR: 600M streaming, 17x more concurrent streams vs Parakeet RNNT 1.1B. 👁️ Vision & VLMs → PaddleOCR-VL-1.6: SOTA document parsing at 1B params, Apache 2.0. → Baidu NAVA: 6.3B joint audio-video gen, best-in-class A/V sync, Apache 2.0. 🎬 Video, 3D & World Models → NVIDIA Cosmos3-Super: 64B omnimodal world model coupling action trajectories with video+audio gen, for Physical AI. → JD JoyAI-Echo: up to 5-min multi-shot text-to-video on LTX-2.3. → ByteDance Bernini-R + VAST TripoSplat (single-image-to-3D Gaussian splats, MIT).
0:14

Before the week ends, let's acknowledge one of the most INSANE week ever for open AI, with 25+ notable open-weight drops across every modality: 🧠 LLMs → NVIDIA Nemotron 3 Ultra: 550B hybrid Mamba-MoE, only 55B active, 1M context, MMLU 89.1. NVFP4 variant claims ~5x throughput on Blackwell. First openly-weighted 550B hybrid Mamba-Transformer, closing the gap with frontier closed models. → Google Gemma 4 12B: fully open dense any-to-any (text/image/audio/video), 256k context, encoder-free, 140+ languages, AIME 2026 at 77.5. Shipped with a 23-checkpoint QAT wave (mobile ONNX + MLX). Most deployable model of the week. → StepFun Step-3.7-Flash: 198B sparse MoE VLM, ~11B active, SWE-Bench PRO 56.3. Apache 2.0. → Liquid AI LFM2.5-8B-A1B: edge MoE, just 1.5B active, 128k ctx, MATH500 88.8, MLX-ready. Best on-device option this week. → JetBrains Mellum2-12B-A2.5B-Thinking: their first open MoE, near-Qwen3-14B coding at 2.5B active. Apache 2.0. 🎨 Image gen (the surprise of the week) → Ideogram 4: their FIRST-EVER open weights. 9.3B flow-matching DiT trained from scratch. #2 overall behind GPT Image 2, top open-weight model on Design Arena + LMArena. Strongest open checkpoint for text-rich images, full stop. It has taste. Still can't believe this is open weights. 🔊 Audio & Speech (a breakout week for open TTS, 4 labs shipped) → Boson Higgs Audio v3 4B: 102 languages, 21 emotions, singing/whispering/shouting, sub-second TTFA. → RedNote dots.tts: the only fully continuous (no codec) open TTS pipeline, Apache 2.0. → Google Magenta RealTime 2: real-time music gen, <200ms latency, text+audio+MIDI. multimodalart ported it to PyTorch within hours with live ZeroGPU demos. → NVIDIA Nemotron-3.5 ASR: 600M streaming, 17x more concurrent streams vs Parakeet RNNT 1.1B. 👁️ Vision & VLMs → PaddleOCR-VL-1.6: SOTA document parsing at 1B params, Apache 2.0. → Baidu NAVA: 6.3B joint audio-video gen, best-in-class A/V sync, Apache 2.0. 🎬 Video, 3D & World Models → NVIDIA Cosmos3-Super: 64B omnimodal world model coupling action trajectories with video+audio gen, for Physical AI. → JD JoyAI-Echo: up to 5-min multi-shot text-to-video on LTX-2.3. → ByteDance Bernini-R + VAST TripoSplat (single-image-to-3D Gaussian splats, MIT).

Victor M

540,755 次观看 • 2 个月前

Seedance 2.0 is now officially available on GlobalGPT at 50% OFF! Realistic physics, native audio-video generation, and best-in-class image control for AI video. Now avaiable for all regions. No limits. No restrictions. No invite codes.👇
0:15

Seedance 2.0 is now officially available on GlobalGPT at 50% OFF! Realistic physics, native audio-video generation, and best-in-class image control for AI video. Now avaiable for all regions. No limits. No restrictions. No invite codes.👇

Kylie

65,922 次观看 • 3 个月前

BREAKING: Seedance 2.0 is now officially available on GlobalGPT at 50% OFF! Realistic physics, native audio-video generation, and best-in-class image control for AI video. Now avaiable for all regions. No limits. No restrictions. No invite codes.👇
0:13

BREAKING: Seedance 2.0 is now officially available on GlobalGPT at 50% OFF! Realistic physics, native audio-video generation, and best-in-class image control for AI video. Now avaiable for all regions. No limits. No restrictions. No invite codes.👇

Zohaib Ai

13,913 次观看 • 3 个月前

introducing Seedance 2.0. the world's most powerful video model, supporting text, image, video, and even audio as input, and capable of producing long multi-shot videos with high quality. now available for everyone.
0:14

introducing Seedance 2.0. the world's most powerful video model, supporting text, image, video, and even audio as input, and capable of producing long multi-shot videos with high quality. now available for everyone.

Krea

44,876 次观看 • 4 个月前

💥 Seedance 2.0 is HERE on GlobalGPT. 50% OFF. All regions. No invite codes. Realistic physics + native audio-video + best-in-class image control. This is the one. 👇
0:15

💥 Seedance 2.0 is HERE on GlobalGPT. 50% OFF. All regions. No invite codes. Realistic physics + native audio-video + best-in-class image control. This is the one. 👇

MAPUNDA

69,856 次观看 • 3 个月前

If you're still living under a rock and don't know how to access seedance 2.0 to generate videos like this > spin up a Hongkong VPN > Visit doubao [dot] com > select image gen and make sure seedance 4.5 is selected you won't believe the next step but: > tell the image gen model to make a video and it'll start generating a video using the latest seedance 2.0
0:10

If you're still living under a rock and don't know how to access seedance 2.0 to generate videos like this > spin up a Hongkong VPN > Visit doubao [dot] com > select image gen and make sure seedance 4.5 is selected you won't believe the next step but: > tell the image gen model to make a video and it'll start generating a video using the latest seedance 2.0

Akshit Verma

108,796 次观看 • 5 个月前

Seedance 2.0 got its perfect match on Higgsfield. Grok Imagine and Seedance 2.0 - xAI's image model paired with the category-leading video model, natively inside the platform. Grok Imagine generates your reference image in 9+ styles, fast. Seedance 2.0 - ranked #1 in image-to-video - takes it further than any other model can. The best results out of Seedance 2.0 start here.
0:14

Seedance 2.0 got its perfect match on Higgsfield. Grok Imagine and Seedance 2.0 - xAI's image model paired with the category-leading video model, natively inside the platform. Grok Imagine generates your reference image in 9+ styles, fast. Seedance 2.0 - ranked #1 in image-to-video - takes it further than any other model can. The best results out of Seedance 2.0 start here.

Higgsfield AI 🧩

10,149,031 次观看 • 4 个月前

The ARM has landed. Anoma is live on Ethereum. The next-gen VM at the heart of Anoma’s distributed OS, the ARM brings native intents and best-in-class privacy to any chain, starting with Ethereum. A new era for decentralized applications starts today.
0:14

The ARM has landed. Anoma is live on Ethereum. The next-gen VM at the heart of Anoma’s distributed OS, the ARM brings native intents and best-in-class privacy to any chain, starting with Ethereum. A new era for decentralized applications starts today.

Anoma

211,295 次观看 • 8 个月前

🔥 KEEP - New sota for video face super-resolution
0:13

🔥 KEEP - New sota for video face super-resolution

Gradio

53,631 次观看 • 1 年前

GPT Image 2.0 + Seedance 2.0 is a powerful combo for game scene creation. Generate the character UI, loading screen, HUD, and cinematic gameplay look with GPT Image 2.0, then use Seedance 2.0 to turn it into a smooth one-shot game demo video.
0:15

GPT Image 2.0 + Seedance 2.0 is a powerful combo for game scene creation. Generate the character UI, loading screen, HUD, and cinematic gameplay look with GPT Image 2.0, then use Seedance 2.0 to turn it into a smooth one-shot game demo video.

BudgetPixel AI

730,287 次观看 • 3 个月前

Grok Imagine works wonders. The best tool for creating images and videos quickly, easily, and with high quality. Try Image 2.0 😍🥰
0:10

Grok Imagine works wonders. The best tool for creating images and videos quickly, easily, and with high quality. Try Image 2.0 😍🥰

Eva Fo𝕏 🦊 Claudius Nero's Legion

618,342 次观看 • 1 天前

Seedance 2.0 in native 4K. Best-in-class particle physics, lighting fidelity, depth of scale, and shadow detail. The best model for cinematic storytelling.
0:15

Seedance 2.0 in native 4K. Best-in-class particle physics, lighting fidelity, depth of scale, and shadow detail. The best model for cinematic storytelling.

Higgsfield AI 🧩

47,106 次观看 • 1 个月前

Introducing Top Yapper Opinions For the next 10 days, the most viral opinions from Kaito's Top 20 Emerging Yappers leaderboard will be tokenized daily on opinions.fun During that time Yappers receive 100% of platform trading fees from their opinions. Keep reading 🧵
0:14

Introducing Top Yapper Opinions For the next 10 days, the most viral opinions from Kaito's Top 20 Emerging Yappers leaderboard will be tokenized daily on opinions.fun During that time Yappers receive 100% of platform trading fees from their opinions. Keep reading 🧵

opinions.fun

16,110 次观看 • 1 年前