Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

VideoLLaMA3, latest MLLMs for image and video understanding. 🖐️ 7B models: DocVQA: 94.9, MathVision: 26.2, VideoMME: 66.2/70.3, MLVU: 73.0 🤏 2B models for edge devices: MMMU: 45.3, VideoMME: 59.6/63.4 👊 Frontier-class video model with ONLY 3M video-text pairs

Gradio's profile picture

Gradio

56,759 subscribers

37,154 görüntüleme • 1 yıl önce •via X (Twitter)

Bilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

7 Yorum

Gradio profil fotoğrafı
Gradio1 yıl önce

VideoLLaMA3 for Video understanding:

Gradio profil fotoğrafı
Gradio1 yıl önce

VideoLLaMA3 for Image understanding:

Gradio profil fotoğrafı
Gradio1 yıl önce

Learn more about VideoLLaMA3:

Rainmaker profil fotoğrafı
Rainmaker2 yıl önce

Join me as I put several Machine Learning models head-to-head to see which one can beat the market and deliver strong returns. In this free Substack post I share several models that deliver better returns with much lower drawdown compared to Buy-and-Hold approach.

Discord Guys profil fotoğrafı
Discord Guys1 yıl önce

Wow, VideoLLaMA3 sounds like a beast! Can't wait to try it out.

Sujith Reddy profil fotoğrafı
Sujith Reddy1 yıl önce

@_akhaliq @Gradio are these models production level models? Scalable?

ヌル profil fotoğrafı
ヌル1 yıl önce

3M pairs is a small dataset for training.

Benzer Videolar

🤯DiffIR2VR-Zero: Zero-shot video restoration to high-resolution using pre-trained image restoration diffusion models. - Framework can handle video denoising and up to 8x super-resolution - outperforms trained models in generalizing across diverse datasets and extreme degradations - Compatible with every 2D restoration model
0:38

🤯DiffIR2VR-Zero: Zero-shot video restoration to high-resolution using pre-trained image restoration diffusion models. - Framework can handle video denoising and up to 8x super-resolution - outperforms trained models in generalizing across diverse datasets and extreme degradations - Compatible with every 2D restoration model

Gradio

20,342 görüntüleme • 2 yıl önce

LTX 2.3 is out. Another big milestone for open-source video generation. Lightricks keeps pushing the frontier with faster, higher-quality video models the community can actually build with. Open video models are accelerating fast. Model:
1:17

LTX 2.3 is out. Another big milestone for open-source video generation. Lightricks keeps pushing the frontier with faster, higher-quality video models the community can actually build with. Open video models are accelerating fast. Model:

Hugging Models

35,935 görüntüleme • 4 ay önce

Struggling with slow inference of diffusion and flow models? Check out the video below—I’ve been using our new FastGen library to achieve 7-28x acceleration for text-2-image and {text,image,video}-2-video generation without sacrificing visual fidelity!
2:20

Struggling with slow inference of diffusion and flow models? Check out the video below—I’ve been using our new FastGen library to achieve 7-28x acceleration for text-2-image and {text,image,video}-2-video generation without sacrificing visual fidelity!

Julius Berner

13,643 görüntüleme • 4 ay önce

You’ve used language models, image models, video models, and voice models. Now it’s time for world models, thanks to World Labs.
3:42

You’ve used language models, image models, video models, and voice models. Now it’s time for world models, thanks to World Labs.

Amir Haghighat

838,889 görüntüleme • 4 ay önce

Meet Reka Edge – Our next-generation vision language model for physical AI. Uses 3x fewer input tokens and achieves 65% faster throughput compared to leading 8B models. Image understanding, video analysis, object detection, and tool use. Built for Action. Fast enough for production, deployable anywhere. Read more:
0:24

Meet Reka Edge – Our next-generation vision language model for physical AI. Uses 3x fewer input tokens and achieves 65% faster throughput compared to leading 8B models. Image understanding, video analysis, object detection, and tool use. Built for Action. Fast enough for production, deployable anywhere. Read more:

Reka

53,500 görüntüleme • 4 ay önce

Nano-Banana moment for Video models soon? In an interview two weeks ago, Demis Hassabis talked about the future of image and video models "When Video converges with Language models you will see some interesting combinaton of Capabilites"
0:31

Nano-Banana moment for Video models soon? In an interview two weeks ago, Demis Hassabis talked about the future of image and video models "When Video converges with Language models you will see some interesting combinaton of Capabilites"

AiBattle

47,820 görüntüleme • 6 ay önce

InfinityStar by Bytedance: A unified 8B spacetime autoregressive model for high-res image & video gen; - 5s 720p video ~10x faster than DiT; - scores 83.74 on VBench, topping other AR models and HunyuanVideo; - Flan-T5-XL as text encoder. - 480/720p, ~35Gb model
0:45

InfinityStar by Bytedance: A unified 8B spacetime autoregressive model for high-res image & video gen; - 5s 720p video ~10x faster than DiT; - scores 83.74 on VBench, topping other AR models and HunyuanVideo; - Flan-T5-XL as text encoder. - 480/720p, ~35Gb model

Wildminder

23,255 görüntüleme • 8 ay önce

Hello World, we’re We eval frontier models by putting them in simulations. So what happens when 6 frontier models compete in #Minecraft for GPUs? Video and 🧵
2:16

Hello World, we’re We eval frontier models by putting them in simulations. So what happens when 6 frontier models compete in #Minecraft for GPUs? Video and 🧵

Kradle

94,625 görüntüleme • 10 ay önce

Can a small academic team build a strong text-to-image model using only public datasets? Introducing i1: a simple, fully open recipe for strong text-to-image models
0:29

Can a small academic team build a strong text-to-image model using only public datasets? Introducing i1: a simple, fully open recipe for strong text-to-image models

Zhuang Liu

67,476 görüntüleme • 17 gün önce

Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models turn the publicly available, state-of-the-art text-to-image LDM Stable Diffusion into an efficient and expressive text-to-video model with resolution up to 1280 x 2048 abs: project page:
1:38

Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models turn the publicly available, state-of-the-art text-to-image LDM Stable Diffusion into an efficient and expressive text-to-video model with resolution up to 1280 x 2048 abs: project page:

AK

718,760 görüntüleme • 3 yıl önce

(1/2) LightIt: Illumination Modeling and Control for Diffusion Models! #CVPR2024 We facilitate lighting control for novel image generation from text prompts. We can also edit lighting for a given input image. Video: Project:
0:31

(1/2) LightIt: Illumination Modeling and Control for Diffusion Models! #CVPR2024 We facilitate lighting control for novel image generation from text prompts. We can also edit lighting for a given input image. Video: Project:

Matthias Niessner

19,849 görüntüleme • 2 yıl önce

New Kling, Runway, Luma competitor? Open text and image video generation model Pyramidal Flow Matching for Efficient Video Generative Modeling
2:23

New Kling, Runway, Luma competitor? Open text and image video generation model Pyramidal Flow Matching for Efficient Video Generative Modeling

AK

90,965 görüntüleme • 1 yıl önce

Demis Hassabis on the next 12 Months: - Full multimodal convergence: Models like Gemini will seamlessly take in and output text, images, audio, and video, with cross-pollination that boosts reasoning + creativity. - Breakthrough visual intelligence: Image models like Nano Banana Pro will produce highly accurate infographics and show near-human visual understanding. - Language + video fusion: Video models integrated with LLMs unlock richer analysis, storytelling, and step-by-step visual reasoning. - World models go mainstream like Genie 3 - Agents become reliable
1:26

Demis Hassabis on the next 12 Months: - Full multimodal convergence: Models like Gemini will seamlessly take in and output text, images, audio, and video, with cross-pollination that boosts reasoning + creativity. - Breakthrough visual intelligence: Image models like Nano Banana Pro will produce highly accurate infographics and show near-human visual understanding. - Language + video fusion: Video models integrated with LLMs unlock richer analysis, storytelling, and step-by-step visual reasoning. - World models go mainstream like Genie 3 - Agents become reliable

Chubby♨️

89,236 görüntüleme • 7 ay önce

Apple FastVLM-7B Efficient Vision Encoding for Vision Language Models larger variants using Qwen2-7B LLM outperform recent works like Cambrian-1-8B while using a single image encoder with a 7.9x faster TTFT vibe coding a video captioning app with it in anycoder
0:37

Apple FastVLM-7B Efficient Vision Encoding for Vision Language Models larger variants using Qwen2-7B LLM outperform recent works like Cambrian-1-8B while using a single image encoder with a 7.9x faster TTFT vibe coding a video captioning app with it in anycoder

AK

60,588 görüntüleme • 10 ay önce

𝗔𝗴𝗻𝗲𝘀 𝟮.𝟬: AI models ranked among the world's best. One suite for text, image, and video generation. Top 10 across leading AI benchmarks. Trained in Singapore and available now with no waitlist.
2:19

𝗔𝗴𝗻𝗲𝘀 𝟮.𝟬: AI models ranked among the world's best. One suite for text, image, and video generation. Top 10 across leading AI benchmarks. Trained in Singapore and available now with no waitlist.

Tech in Asia

4,765,968 görüntüleme • 1 ay önce

Ex-DeepMind Danijar Hafner: The debate about whether LLMs can reach AGI is outdated because we are already past that stage Frontier models are no longer just text engines; they now master image understanding, video processing, and generation "there's no debate even about that anymore"
0:58

Ex-DeepMind Danijar Hafner: The debate about whether LLMs can reach AGI is outdated because we are already past that stage Frontier models are no longer just text engines; they now master image understanding, video processing, and generation "there's no debate even about that anymore"

Haider.

22,431 görüntüleme • 5 ay önce

- if SAM3 is so good, do we still need other models? - yes. SAM3 is too large for low compute edge devices and too slow for real-time use. we still need light and fast models for edge workloads. distill SAM3 into smaller model and deploy it in seconds with Roboflow rapid
0:36

- if SAM3 is so good, do we still need other models? - yes. SAM3 is too large for low compute edge devices and too slow for real-time use. we still need light and fast models for edge workloads. distill SAM3 into smaller model and deploy it in seconds with Roboflow rapid

SkalskiP

93,025 görüntüleme • 7 ay önce