Загрузка видео...

Не удалось загрузить видео

На главную

VideoLLaMA3, latest MLLMs for image and video understanding. 🖐️ 7B models: DocVQA: 94.9, MathVision: 26.2, VideoMME: 66.2/70.3, MLVU: 73.0 🤏 2B models for edge devices: MMMU: 45.3, VideoMME: 59.6/63.4 👊 Frontier-class video model with ONLY 3M video-text pairs

Gradio's profile picture

Gradio

56,759 subscribers

37,154 просмотров • 1 год назад •via X (Twitter)

Наука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 7

Фото профиля Gradio
Gradio1 год назад

VideoLLaMA3 for Video understanding:

Фото профиля Gradio
Gradio1 год назад

VideoLLaMA3 for Image understanding:

Фото профиля Gradio
Gradio1 год назад

Learn more about VideoLLaMA3:

Фото профиля Rainmaker
Rainmaker2 лет назад

Join me as I put several Machine Learning models head-to-head to see which one can beat the market and deliver strong returns. In this free Substack post I share several models that deliver better returns with much lower drawdown compared to Buy-and-Hold approach.

Фото профиля Discord Guys
Discord Guys1 год назад

Wow, VideoLLaMA3 sounds like a beast! Can't wait to try it out.

Фото профиля Sujith Reddy
Sujith Reddy1 год назад

@_akhaliq @Gradio are these models production level models? Scalable?

Фото профиля ヌル
ヌル1 год назад

3M pairs is a small dataset for training.

Похожие видео

🤯DiffIR2VR-Zero: Zero-shot video restoration to high-resolution using pre-trained image restoration diffusion models. - Framework can handle video denoising and up to 8x super-resolution - outperforms trained models in generalizing across diverse datasets and extreme degradations - Compatible with every 2D restoration model
0:38

🤯DiffIR2VR-Zero: Zero-shot video restoration to high-resolution using pre-trained image restoration diffusion models. - Framework can handle video denoising and up to 8x super-resolution - outperforms trained models in generalizing across diverse datasets and extreme degradations - Compatible with every 2D restoration model

Gradio

20,342 просмотров • 2 лет назад

LTX 2.3 is out. Another big milestone for open-source video generation. Lightricks keeps pushing the frontier with faster, higher-quality video models the community can actually build with. Open video models are accelerating fast. Model:
1:17

LTX 2.3 is out. Another big milestone for open-source video generation. Lightricks keeps pushing the frontier with faster, higher-quality video models the community can actually build with. Open video models are accelerating fast. Model:

Hugging Models

35,935 просмотров • 4 месяцев назад

Struggling with slow inference of diffusion and flow models? Check out the video below—I’ve been using our new FastGen library to achieve 7-28x acceleration for text-2-image and {text,image,video}-2-video generation without sacrificing visual fidelity!
2:20

Struggling with slow inference of diffusion and flow models? Check out the video below—I’ve been using our new FastGen library to achieve 7-28x acceleration for text-2-image and {text,image,video}-2-video generation without sacrificing visual fidelity!

Julius Berner

13,643 просмотров • 4 месяцев назад

You’ve used language models, image models, video models, and voice models. Now it’s time for world models, thanks to World Labs.
3:42

You’ve used language models, image models, video models, and voice models. Now it’s time for world models, thanks to World Labs.

Amir Haghighat

838,889 просмотров • 4 месяцев назад

Meet Reka Edge – Our next-generation vision language model for physical AI. Uses 3x fewer input tokens and achieves 65% faster throughput compared to leading 8B models. Image understanding, video analysis, object detection, and tool use. Built for Action. Fast enough for production, deployable anywhere. Read more:
0:24

Meet Reka Edge – Our next-generation vision language model for physical AI. Uses 3x fewer input tokens and achieves 65% faster throughput compared to leading 8B models. Image understanding, video analysis, object detection, and tool use. Built for Action. Fast enough for production, deployable anywhere. Read more:

Reka

53,500 просмотров • 3 месяцев назад

Nano-Banana moment for Video models soon? In an interview two weeks ago, Demis Hassabis talked about the future of image and video models "When Video converges with Language models you will see some interesting combinaton of Capabilites"
0:31

Nano-Banana moment for Video models soon? In an interview two weeks ago, Demis Hassabis talked about the future of image and video models "When Video converges with Language models you will see some interesting combinaton of Capabilites"

AiBattle

47,820 просмотров • 6 месяцев назад

InfinityStar by Bytedance: A unified 8B spacetime autoregressive model for high-res image & video gen; - 5s 720p video ~10x faster than DiT; - scores 83.74 on VBench, topping other AR models and HunyuanVideo; - Flan-T5-XL as text encoder. - 480/720p, ~35Gb model
0:45

InfinityStar by Bytedance: A unified 8B spacetime autoregressive model for high-res image & video gen; - 5s 720p video ~10x faster than DiT; - scores 83.74 on VBench, topping other AR models and HunyuanVideo; - Flan-T5-XL as text encoder. - 480/720p, ~35Gb model

Wildminder

23,255 просмотров • 8 месяцев назад

Hello World, we’re We eval frontier models by putting them in simulations. So what happens when 6 frontier models compete in #Minecraft for GPUs? Video and 🧵
2:16

Hello World, we’re We eval frontier models by putting them in simulations. So what happens when 6 frontier models compete in #Minecraft for GPUs? Video and 🧵

Kradle

94,617 просмотров • 10 месяцев назад

Can a small academic team build a strong text-to-image model using only public datasets? Introducing i1: a simple, fully open recipe for strong text-to-image models
0:29

Can a small academic team build a strong text-to-image model using only public datasets? Introducing i1: a simple, fully open recipe for strong text-to-image models

Zhuang Liu

67,476 просмотров • 16 дней назад

Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models turn the publicly available, state-of-the-art text-to-image LDM Stable Diffusion into an efficient and expressive text-to-video model with resolution up to 1280 x 2048 abs: project page:
1:38

Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models turn the publicly available, state-of-the-art text-to-image LDM Stable Diffusion into an efficient and expressive text-to-video model with resolution up to 1280 x 2048 abs: project page:

AK

718,760 просмотров • 3 лет назад

(1/2) LightIt: Illumination Modeling and Control for Diffusion Models! #CVPR2024 We facilitate lighting control for novel image generation from text prompts. We can also edit lighting for a given input image. Video: Project:
0:31

(1/2) LightIt: Illumination Modeling and Control for Diffusion Models! #CVPR2024 We facilitate lighting control for novel image generation from text prompts. We can also edit lighting for a given input image. Video: Project:

Matthias Niessner

19,849 просмотров • 2 лет назад

Demis Hassabis on the next 12 Months: - Full multimodal convergence: Models like Gemini will seamlessly take in and output text, images, audio, and video, with cross-pollination that boosts reasoning + creativity. - Breakthrough visual intelligence: Image models like Nano Banana Pro will produce highly accurate infographics and show near-human visual understanding. - Language + video fusion: Video models integrated with LLMs unlock richer analysis, storytelling, and step-by-step visual reasoning. - World models go mainstream like Genie 3 - Agents become reliable
1:26

Demis Hassabis on the next 12 Months: - Full multimodal convergence: Models like Gemini will seamlessly take in and output text, images, audio, and video, with cross-pollination that boosts reasoning + creativity. - Breakthrough visual intelligence: Image models like Nano Banana Pro will produce highly accurate infographics and show near-human visual understanding. - Language + video fusion: Video models integrated with LLMs unlock richer analysis, storytelling, and step-by-step visual reasoning. - World models go mainstream like Genie 3 - Agents become reliable

Chubby♨️

89,236 просмотров • 7 месяцев назад

New Kling, Runway, Luma competitor? Open text and image video generation model Pyramidal Flow Matching for Efficient Video Generative Modeling
2:23

New Kling, Runway, Luma competitor? Open text and image video generation model Pyramidal Flow Matching for Efficient Video Generative Modeling

AK

90,965 просмотров • 1 год назад

Apple FastVLM-7B Efficient Vision Encoding for Vision Language Models larger variants using Qwen2-7B LLM outperform recent works like Cambrian-1-8B while using a single image encoder with a 7.9x faster TTFT vibe coding a video captioning app with it in anycoder
0:37

Apple FastVLM-7B Efficient Vision Encoding for Vision Language Models larger variants using Qwen2-7B LLM outperform recent works like Cambrian-1-8B while using a single image encoder with a 7.9x faster TTFT vibe coding a video captioning app with it in anycoder

AK

60,588 просмотров • 10 месяцев назад

𝗔𝗴𝗻𝗲𝘀 𝟮.𝟬: AI models ranked among the world's best. One suite for text, image, and video generation. Top 10 across leading AI benchmarks. Trained in Singapore and available now with no waitlist.
2:19

𝗔𝗴𝗻𝗲𝘀 𝟮.𝟬: AI models ranked among the world's best. One suite for text, image, and video generation. Top 10 across leading AI benchmarks. Trained in Singapore and available now with no waitlist.

Tech in Asia

4,765,968 просмотров • 1 месяц назад

Ex-DeepMind Danijar Hafner: The debate about whether LLMs can reach AGI is outdated because we are already past that stage Frontier models are no longer just text engines; they now master image understanding, video processing, and generation "there's no debate even about that anymore"
0:58

Ex-DeepMind Danijar Hafner: The debate about whether LLMs can reach AGI is outdated because we are already past that stage Frontier models are no longer just text engines; they now master image understanding, video processing, and generation "there's no debate even about that anymore"

Haider.

22,431 просмотров • 5 месяцев назад

- if SAM3 is so good, do we still need other models? - yes. SAM3 is too large for low compute edge devices and too slow for real-time use. we still need light and fast models for edge workloads. distill SAM3 into smaller model and deploy it in seconds with Roboflow rapid
0:36

- if SAM3 is so good, do we still need other models? - yes. SAM3 is too large for low compute edge devices and too slow for real-time use. we still need light and fast models for edge workloads. distill SAM3 into smaller model and deploy it in seconds with Roboflow rapid

SkalskiP

93,025 просмотров • 7 месяцев назад