Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

🔥Introducing VILA: The next-gen VLM for Video and inter-leaved image understanding with Apache-2.0 license! Is VILA the best in-class small VLM for edge-deployment? Keep reading🧵 👀

Gradio's profile picture

Gradio

56,939 subscribers

51,694 Aufrufe • vor 2 Jahren •via X (Twitter)

BildungKunstWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

this is the BEST vision language model I have ever tried! Aria is a new model by Rhymes.AI: a 25.3B multimodal model that can take image/video inputs 🤩 They release the model with Apache-2.0 license and fine-tuning scripts as well 👏 I tested it extensively, keep reading to learn more 🧶
0:10

this is the BEST vision language model I have ever tried! Aria is a new model by Rhymes.AI: a 25.3B multimodal model that can take image/video inputs 🤩 They release the model with Apache-2.0 license and fine-tuning scripts as well 👏 I tested it extensively, keep reading to learn more 🧶

merve

176,047 Aufrufe • vor 1 Jahr

Trending: Step1X-3D for generating high-fidelity 3D assets with versatile textures! Apache-2.0 with exceptional results in terms of geometry and texture mapping🔥🔥
0:16

Trending: Step1X-3D for generating high-fidelity 3D assets with versatile textures! Apache-2.0 with exceptional results in terms of geometry and texture mapping🔥🔥

Gradio

36,405 Aufrufe • vor 1 Jahr

Can a VLM see without a vision encoder? We trained one for $100, inspired by Gemma 4 12B. Latency on an M3 Pro MacBook: 112 ms -> 1.1 ms for the image path 30% lower end-to-end image+LLM The architecture is just: patchify the image -> linear projection with pos embeddings -> LLM Writeup:
0:12

Can a VLM see without a vision encoder? We trained one for $100, inspired by Gemma 4 12B. Latency on an M3 Pro MacBook: 112 ms -> 1.1 ms for the image path 30% lower end-to-end image+LLM The architecture is just: patchify the image -> linear projection with pos embeddings -> LLM Writeup:

Andi Marafioti

60,106 Aufrufe • vor 26 Tagen

We may have a new best image-to-video model 👀 I’ve been testing Kling 2.0 more and am really impressed with the results. Veo 2 was previously best-in-class (IMO), but Kling has more motion and maintains coherence.
0:15

We may have a new best image-to-video model 👀 I’ve been testing Kling 2.0 more and am really impressed with the results. Veo 2 was previously best-in-class (IMO), but Kling has more motion and maintains coherence.

Justine Moore

41,475 Aufrufe • vor 1 Jahr

Before the week ends, let's acknowledge one of the most INSANE week ever for open AI, with 25+ notable open-weight drops across every modality: 🧠 LLMs → NVIDIA Nemotron 3 Ultra: 550B hybrid Mamba-MoE, only 55B active, 1M context, MMLU 89.1. NVFP4 variant claims ~5x throughput on Blackwell. First openly-weighted 550B hybrid Mamba-Transformer, closing the gap with frontier closed models. → Google Gemma 4 12B: fully open dense any-to-any (text/image/audio/video), 256k context, encoder-free, 140+ languages, AIME 2026 at 77.5. Shipped with a 23-checkpoint QAT wave (mobile ONNX + MLX). Most deployable model of the week. → StepFun Step-3.7-Flash: 198B sparse MoE VLM, ~11B active, SWE-Bench PRO 56.3. Apache 2.0. → Liquid AI LFM2.5-8B-A1B: edge MoE, just 1.5B active, 128k ctx, MATH500 88.8, MLX-ready. Best on-device option this week. → JetBrains Mellum2-12B-A2.5B-Thinking: their first open MoE, near-Qwen3-14B coding at 2.5B active. Apache 2.0. 🎨 Image gen (the surprise of the week) → Ideogram 4: their FIRST-EVER open weights. 9.3B flow-matching DiT trained from scratch. #2 overall behind GPT Image 2, top open-weight model on Design Arena + LMArena. Strongest open checkpoint for text-rich images, full stop. It has taste. Still can't believe this is open weights. 🔊 Audio & Speech (a breakout week for open TTS, 4 labs shipped) → Boson Higgs Audio v3 4B: 102 languages, 21 emotions, singing/whispering/shouting, sub-second TTFA. → RedNote dots.tts: the only fully continuous (no codec) open TTS pipeline, Apache 2.0. → Google Magenta RealTime 2: real-time music gen, <200ms latency, text+audio+MIDI. multimodalart ported it to PyTorch within hours with live ZeroGPU demos. → NVIDIA Nemotron-3.5 ASR: 600M streaming, 17x more concurrent streams vs Parakeet RNNT 1.1B. 👁️ Vision & VLMs → PaddleOCR-VL-1.6: SOTA document parsing at 1B params, Apache 2.0. → Baidu NAVA: 6.3B joint audio-video gen, best-in-class A/V sync, Apache 2.0. 🎬 Video, 3D & World Models → NVIDIA Cosmos3-Super: 64B omnimodal world model coupling action trajectories with video+audio gen, for Physical AI. → JD JoyAI-Echo: up to 5-min multi-shot text-to-video on LTX-2.3. → ByteDance Bernini-R + VAST TripoSplat (single-image-to-3D Gaussian splats, MIT).
0:14

Before the week ends, let's acknowledge one of the most INSANE week ever for open AI, with 25+ notable open-weight drops across every modality: 🧠 LLMs → NVIDIA Nemotron 3 Ultra: 550B hybrid Mamba-MoE, only 55B active, 1M context, MMLU 89.1. NVFP4 variant claims ~5x throughput on Blackwell. First openly-weighted 550B hybrid Mamba-Transformer, closing the gap with frontier closed models. → Google Gemma 4 12B: fully open dense any-to-any (text/image/audio/video), 256k context, encoder-free, 140+ languages, AIME 2026 at 77.5. Shipped with a 23-checkpoint QAT wave (mobile ONNX + MLX). Most deployable model of the week. → StepFun Step-3.7-Flash: 198B sparse MoE VLM, ~11B active, SWE-Bench PRO 56.3. Apache 2.0. → Liquid AI LFM2.5-8B-A1B: edge MoE, just 1.5B active, 128k ctx, MATH500 88.8, MLX-ready. Best on-device option this week. → JetBrains Mellum2-12B-A2.5B-Thinking: their first open MoE, near-Qwen3-14B coding at 2.5B active. Apache 2.0. 🎨 Image gen (the surprise of the week) → Ideogram 4: their FIRST-EVER open weights. 9.3B flow-matching DiT trained from scratch. #2 overall behind GPT Image 2, top open-weight model on Design Arena + LMArena. Strongest open checkpoint for text-rich images, full stop. It has taste. Still can't believe this is open weights. 🔊 Audio & Speech (a breakout week for open TTS, 4 labs shipped) → Boson Higgs Audio v3 4B: 102 languages, 21 emotions, singing/whispering/shouting, sub-second TTFA. → RedNote dots.tts: the only fully continuous (no codec) open TTS pipeline, Apache 2.0. → Google Magenta RealTime 2: real-time music gen, <200ms latency, text+audio+MIDI. multimodalart ported it to PyTorch within hours with live ZeroGPU demos. → NVIDIA Nemotron-3.5 ASR: 600M streaming, 17x more concurrent streams vs Parakeet RNNT 1.1B. 👁️ Vision & VLMs → PaddleOCR-VL-1.6: SOTA document parsing at 1B params, Apache 2.0. → Baidu NAVA: 6.3B joint audio-video gen, best-in-class A/V sync, Apache 2.0. 🎬 Video, 3D & World Models → NVIDIA Cosmos3-Super: 64B omnimodal world model coupling action trajectories with video+audio gen, for Physical AI. → JD JoyAI-Echo: up to 5-min multi-shot text-to-video on LTX-2.3. → ByteDance Bernini-R + VAST TripoSplat (single-image-to-3D Gaussian splats, MIT).

Victor M

537,636 Aufrufe • vor 1 Monat

Seedance 2.0 is now officially available on GlobalGPT at 50% OFF! Realistic physics, native audio-video generation, and best-in-class image control for AI video. Now avaiable for all regions. No limits. No restrictions. No invite codes.👇
0:15

Seedance 2.0 is now officially available on GlobalGPT at 50% OFF! Realistic physics, native audio-video generation, and best-in-class image control for AI video. Now avaiable for all regions. No limits. No restrictions. No invite codes.👇

Kylie

62,649 Aufrufe • vor 2 Monaten

BREAKING: Seedance 2.0 is now officially available on GlobalGPT at 50% OFF! Realistic physics, native audio-video generation, and best-in-class image control for AI video. Now avaiable for all regions. No limits. No restrictions. No invite codes.👇
0:13

BREAKING: Seedance 2.0 is now officially available on GlobalGPT at 50% OFF! Realistic physics, native audio-video generation, and best-in-class image control for AI video. Now avaiable for all regions. No limits. No restrictions. No invite codes.👇

Zohaib Ai

13,913 Aufrufe • vor 2 Monaten

introducing Seedance 2.0. the world's most powerful video model, supporting text, image, video, and even audio as input, and capable of producing long multi-shot videos with high quality. now available for everyone.
0:14

introducing Seedance 2.0. the world's most powerful video model, supporting text, image, video, and even audio as input, and capable of producing long multi-shot videos with high quality. now available for everyone.

Krea

44,876 Aufrufe • vor 3 Monaten

💥 Seedance 2.0 is HERE on GlobalGPT. 50% OFF. All regions. No invite codes. Realistic physics + native audio-video + best-in-class image control. This is the one. 👇
0:15

💥 Seedance 2.0 is HERE on GlobalGPT. 50% OFF. All regions. No invite codes. Realistic physics + native audio-video + best-in-class image control. This is the one. 👇

MAPUNDA

69,856 Aufrufe • vor 2 Monaten

If you're still living under a rock and don't know how to access seedance 2.0 to generate videos like this > spin up a Hongkong VPN > Visit doubao [dot] com > select image gen and make sure seedance 4.5 is selected you won't believe the next step but: > tell the image gen model to make a video and it'll start generating a video using the latest seedance 2.0
0:10

If you're still living under a rock and don't know how to access seedance 2.0 to generate videos like this > spin up a Hongkong VPN > Visit doubao [dot] com > select image gen and make sure seedance 4.5 is selected you won't believe the next step but: > tell the image gen model to make a video and it'll start generating a video using the latest seedance 2.0

Akshit Verma

108,796 Aufrufe • vor 5 Monaten

Seedance 2.0 got its perfect match on Higgsfield. Grok Imagine and Seedance 2.0 - xAI's image model paired with the category-leading video model, natively inside the platform. Grok Imagine generates your reference image in 9+ styles, fast. Seedance 2.0 - ranked #1 in image-to-video - takes it further than any other model can. The best results out of Seedance 2.0 start here.
0:14

Seedance 2.0 got its perfect match on Higgsfield. Grok Imagine and Seedance 2.0 - xAI's image model paired with the category-leading video model, natively inside the platform. Grok Imagine generates your reference image in 9+ styles, fast. Seedance 2.0 - ranked #1 in image-to-video - takes it further than any other model can. The best results out of Seedance 2.0 start here.

Higgsfield AI 🧩

10,144,927 Aufrufe • vor 3 Monaten

The ARM has landed. Anoma is live on Ethereum. The next-gen VM at the heart of Anoma’s distributed OS, the ARM brings native intents and best-in-class privacy to any chain, starting with Ethereum. A new era for decentralized applications starts today.
0:14

The ARM has landed. Anoma is live on Ethereum. The next-gen VM at the heart of Anoma’s distributed OS, the ARM brings native intents and best-in-class privacy to any chain, starting with Ethereum. A new era for decentralized applications starts today.

Anoma

211,159 Aufrufe • vor 7 Monaten

🔥 KEEP - New sota for video face super-resolution
0:13

🔥 KEEP - New sota for video face super-resolution

Gradio

53,631 Aufrufe • vor 1 Jahr

GPT Image 2.0 + Seedance 2.0 is a powerful combo for game scene creation. Generate the character UI, loading screen, HUD, and cinematic gameplay look with GPT Image 2.0, then use Seedance 2.0 to turn it into a smooth one-shot game demo video.
0:15

GPT Image 2.0 + Seedance 2.0 is a powerful combo for game scene creation. Generate the character UI, loading screen, HUD, and cinematic gameplay look with GPT Image 2.0, then use Seedance 2.0 to turn it into a smooth one-shot game demo video.

BudgetPixel AI

730,287 Aufrufe • vor 2 Monaten

Seedance 2.0 in native 4K. Best-in-class particle physics, lighting fidelity, depth of scale, and shadow detail. The best model for cinematic storytelling.
0:15

Seedance 2.0 in native 4K. Best-in-class particle physics, lighting fidelity, depth of scale, and shadow detail. The best model for cinematic storytelling.

Higgsfield AI 🧩

44,915 Aufrufe • vor 22 Tagen

GPT Image 2.0 is at the forefront of AI image generation, while Seedance 2.0 is raising the standard for AI video. Neither is tied to a single ecosystem they’re both widely accessible across different platforms. Whether through ChatGPT, the OpenAI API, or various third-party tools, GPT Image 2.0 integrates into existing workflows, and Seedance 2.0 offers the same flexibility.
0:10

GPT Image 2.0 is at the forefront of AI image generation, while Seedance 2.0 is raising the standard for AI video. Neither is tied to a single ecosystem they’re both widely accessible across different platforms. Whether through ChatGPT, the OpenAI API, or various third-party tools, GPT Image 2.0 integrates into existing workflows, and Seedance 2.0 offers the same flexibility.

Lifetime

46,368 Aufrufe • vor 2 Monaten

🚨Epic News: Demos for ExVideo and Diffutoon are out! 🤯 Play with the advanced parameters for greater control -- this might be the best open model and demo for text2video/image2video out there!
0:13

🚨Epic News: Demos for ExVideo and Diffutoon are out! 🤯 Play with the advanced parameters for greater control -- this might be the best open model and demo for text2video/image2video out there!

Gradio

17,447 Aufrufe • vor 2 Jahren