Loading video...

Video Failed to Load

Go Home

📢📢📢Introducing xGen-MM-Vid (BLIP-3-Video)! This highly efficient multimodal language model is laser-focused on video understanding. Compared to other models, xGen-MM-Vid represents a video with a fraction of the visual tokens (e.g., 32 vs. 4608 tokens). Paper: Website: Researcher’s 🧵:👇

SFResearch's profile picture

Salesforce AI Research

19,737 subscribers

12,550 views • 1 year ago •via X (Twitter)

Science & TechnologyNews & PoliticsEducation
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

📢Introducing Generated Reality📢 A world model for XR that turns your tracked hand and head poses into an interactive, generative video experience. Take world models to the next level by interacting with the world using your own body! 🔗 1/4
0:15

📢Introducing Generated Reality📢 A world model for XR that turns your tracked hand and head poses into an interactive, generative video experience. Take world models to the next level by interacting with the world using your own body! 🔗 1/4

Gordon Wetzstein

20,045 views • 4 months ago

📢📢📢 Check out XCube, a generative model for very-high resolution 3D shapes and scenes! Project Page: Project Video: Props to Xuanchi Ren for leading this project!!!! [1/N]
0:14

📢📢📢 Check out XCube, a generative model for very-high resolution 3D shapes and scenes! Project Page: Project Video: Props to Xuanchi Ren for leading this project!!!! [1/N]

Francis Williams

42,417 views • 2 years ago

Apparently SeeDance 2 is down for the time being on BytePlus but here's a young wizard with his dragon companion. It's a very cool video model. This video cost $0.72 USD to generate which seems reasonable. (300,000 tokens for a 15 secs at $0.0024 USD per 1000 tokens.)
0:15

Apparently SeeDance 2 is down for the time being on BytePlus but here's a young wizard with his dragon companion. It's a very cool video model. This video cost $0.72 USD to generate which seems reasonable. (300,000 tokens for a 15 secs at $0.0024 USD per 1000 tokens.)

TomLikesRobots🤖

50,451 views • 5 months ago

With today’s 25 mm of rain, #Bengaluru has received a total of 270 mm this May — putting the city on track to potentially record its highest May rainfall ever. #BengaluruRains #BengaluruTraffic Video - Khaja
0:10

With today’s 25 mm of rain, #Bengaluru has received a total of 270 mm this May — putting the city on track to potentially record its highest May rainfall ever. #BengaluruRains #BengaluruTraffic Video - Khaja

Naveen Reddy

38,765 views • 1 year ago

VID SOLD! Stretched 14 mm septum extreme play video 🔥 Check it out! #MVSales @manyvids
0:10

VID SOLD! Stretched 14 mm septum extreme play video 🔥 Check it out! #MVSales @manyvids

Marta Klinta Steel

16,324 views • 3 months ago

We took a 30B model and split it in two to write tokens in parallel instead of one at a time. Introducing Nemotron-Labs-TwoTower: a diffusion language model from NVIDIA Research adapted from Nemotron-3-Nano-30B-A3B. Here’s how it works: one half holds the context, the other writes the tokens, with both reusing the pretrained model instead of training a new one from scratch. We found it kept 98.7% of the original model’s quality at 2.42× faster generation.
0:13

We took a 30B model and split it in two to write tokens in parallel instead of one at a time. Introducing Nemotron-Labs-TwoTower: a diffusion language model from NVIDIA Research adapted from Nemotron-3-Nano-30B-A3B. Here’s how it works: one half holds the context, the other writes the tokens, with both reusing the pretrained model instead of training a new one from scratch. We found it kept 98.7% of the original model’s quality at 2.42× faster generation.

NVIDIA AI

755,314 views • 12 days ago

NVIDIA just released a very impressive text-to-video paper. Video Latent Diffusion Models (Video LDMs) use a diffusion model in a compressed latent space to generate high-resolution videos. Here's a brief overview of how it works: 1. Pre-train image LDM on a dataset of images. 2. Turn the image LDM into a Video LDM by adding temporal layers to model video frames. 3. Fine-tune the Video LDM on encoded video sequences to create a video generator. 4. Temporally align diffusion model upsamplers to generate high-resolution videos. 5. Validate Video LDM on real driving videos of 512x1024 resolution, achieving state-of-the-art performance. 6. Apply the approach in creative content creation with text-to-video modeling. Paper: Project:
0:14

NVIDIA just released a very impressive text-to-video paper. Video Latent Diffusion Models (Video LDMs) use a diffusion model in a compressed latent space to generate high-resolution videos. Here's a brief overview of how it works: 1. Pre-train image LDM on a dataset of images. 2. Turn the image LDM into a Video LDM by adding temporal layers to model video frames. 3. Fine-tune the Video LDM on encoded video sequences to create a video generator. 4. Temporally align diffusion model upsamplers to generate high-resolution videos. 5. Validate Video LDM on real driving videos of 512x1024 resolution, achieving state-of-the-art performance. 6. Apply the approach in creative content creation with text-to-video modeling. Paper: Project:

Lior Alexander

158,558 views • 3 years ago

📢 New Listing Alert! 🐱 $HAPPY lands on Uphold in 2 Days. The internet’s favorite “Happy Happy Happy” cat is coming to the #blockchain! With a fair launch and 3.33B tokens in circulation, this #Solana-based #memecoin is 100% community driven. 👇 Check our blog to learn more.
0:16

📢 New Listing Alert! 🐱 $HAPPY lands on Uphold in 2 Days. The internet’s favorite “Happy Happy Happy” cat is coming to the #blockchain! With a fair launch and 3.33B tokens in circulation, this #Solana-based #memecoin is 100% community driven. 👇 Check our blog to learn more.

Uphold

36,993 views • 1 year ago

Today at #GoogleIO we've announced: 🤖 Project Astra: our vision for AI assistants 🎨 Imagen 3 & Veo: our new image and video gen models ♊ Gemini 1.5 Flash: a light-weight multimodal model with long context & 1.5 Pro with 2M tokens... "Tuesday" as we call it Google DeepMind
0:00

Today at #GoogleIO we've announced: 🤖 Project Astra: our vision for AI assistants 🎨 Imagen 3 & Veo: our new image and video gen models ♊ Gemini 1.5 Flash: a light-weight multimodal model with long context & 1.5 Pro with 2M tokens... "Tuesday" as we call it Google DeepMind

Alexandre Moufarek

111,187 views • 2 years ago

BREAKING: Grok set a new record on OpenRouter this year with over 16 trillion tokens of usage. 16,060,000,000,000 tokens. That is about 64% more usage than the next closest model.
0:11

BREAKING: Grok set a new record on OpenRouter this year with over 16 trillion tokens of usage. 16,060,000,000,000 tokens. That is about 64% more usage than the next closest model.

DogeDesigner

27,783 views • 6 months ago

China is literally on 🔥 Baidu from China has launched ERNIE 4.5 and ERNIE X1 and it’s freaking cheap . Here is everything you need to know. ERNIE 4.5 - Native multimodal and Outperforms GPT 4.5 in multiple benchmarks at just 1% of GPT 4.5 price - OpenAI GPT 4.5 – Input: $75 / 1M tokens, Output: $150 / 1M tokens; - ERNIE 4.5 – Input: $0.55 / 1M tokens, Output: $2.20 / 1M tokens ERNIE X1 - A deep thinking reasoning model with multimodal capabilities on par with DeepSeek R1 at only half the price See it in action and check out the pricing details👇 📹 source : yiyan[.]baidu[.]com 1/6 ERNIE 4.5 is a multimodal which can take Audio files as well.
0:13

China is literally on 🔥 Baidu from China has launched ERNIE 4.5 and ERNIE X1 and it’s freaking cheap . Here is everything you need to know. ERNIE 4.5 - Native multimodal and Outperforms GPT 4.5 in multiple benchmarks at just 1% of GPT 4.5 price - OpenAI GPT 4.5 – Input: $75 / 1M tokens, Output: $150 / 1M tokens; - ERNIE 4.5 – Input: $0.55 / 1M tokens, Output: $2.20 / 1M tokens ERNIE X1 - A deep thinking reasoning model with multimodal capabilities on par with DeepSeek R1 at only half the price See it in action and check out the pricing details👇 📹 source : yiyan[.]baidu[.]com 1/6 ERNIE 4.5 is a multimodal which can take Audio files as well.

AshutoshShrivastava

324,324 views • 1 year ago

📢||◤3 Days◢|| Until the #Squadra Half-Year Anniversary! The #GekishinSquadra Half-Year Anniversary is on 3/18 (PT)!🎉 We've released a countdown video!🎦 #DragonBall
0:14

📢||◤3 Days◢|| Until the #Squadra Half-Year Anniversary! The #GekishinSquadra Half-Year Anniversary is on 3/18 (PT)!🎉 We've released a countdown video!🎦 #DragonBall

DRAGON BALL GEKISHIN SQUADRA

27,080 views • 4 months ago

The Hidden Language of Diffusion Models paper page: tackle the challenge of understanding concept representations in text-to-image models by decomposing an input text prompt into a small set of interpretable elements. This is achieved by learning a pseudo-token that is a sparse weighted combination of tokens from the model's vocabulary, with the objective of reconstructing the images generated for the given concept. Applied over the state-of-the-art Stable Diffusion model, this decomposition reveals non-trivial and surprising structures in the representations of concepts. For example, we find that some concepts such as "a president" or "a composer" are dominated by specific instances (e.g., "Obama", "Biden") and their interpolations. Other concepts, such as "happiness" combine associated terms that can be concrete ("family", "laughter") or abstract ("friendship", "emotion"). In addition to peering into the inner workings of Stable Diffusion, our method also enables applications such as single-image decomposition to tokens, bias detection and mitigation, and semantic image manipulation
0:19

The Hidden Language of Diffusion Models paper page: tackle the challenge of understanding concept representations in text-to-image models by decomposing an input text prompt into a small set of interpretable elements. This is achieved by learning a pseudo-token that is a sparse weighted combination of tokens from the model's vocabulary, with the objective of reconstructing the images generated for the given concept. Applied over the state-of-the-art Stable Diffusion model, this decomposition reveals non-trivial and surprising structures in the representations of concepts. For example, we find that some concepts such as "a president" or "a composer" are dominated by specific instances (e.g., "Obama", "Biden") and their interpolations. Other concepts, such as "happiness" combine associated terms that can be concrete ("family", "laughter") or abstract ("friendship", "emotion"). In addition to peering into the inner workings of Stable Diffusion, our method also enables applications such as single-image decomposition to tokens, bias detection and mitigation, and semantic image manipulation

AK

41,746 views • 3 years ago

📢: 🎧⚠️ 📢: Only when you click each video you would be able to appreciate the depth of hidden beauty 😍
0:20

Sensitive content

📢: 🎧⚠️ 📢: Only when you click each video you would be able to appreciate the depth of hidden beauty 😍

Indian Gay

22,321 views • 1 year ago

Introducing INFINIT Launcher Launch tokens with an AI agent in minutes 🧵
0:15

Introducing INFINIT Launcher Launch tokens with an AI agent in minutes 🧵

INFINIT

85,435 views • 1 year ago

this is the BEST vision language model I have ever tried! Aria is a new model by Rhymes.AI: a 25.3B multimodal model that can take image/video inputs 🤩 They release the model with Apache-2.0 license and fine-tuning scripts as well 👏 I tested it extensively, keep reading to learn more 🧶
0:10

this is the BEST vision language model I have ever tried! Aria is a new model by Rhymes.AI: a 25.3B multimodal model that can take image/video inputs 🤩 They release the model with Apache-2.0 license and fine-tuning scripts as well 👏 I tested it extensively, keep reading to learn more 🧶

merve

176,047 views • 1 year ago

🚀New paper out - We present Video-MSG (Multimodal Sketch Guidance), a novel planning-based training-free guidance method for T2V models, improving control of spatial layout and object trajectories. 🔧 Key idea: • Generate a Video Sketch — a spatio-temporal plan with background, foreground, and motion in the pixel space. • Encode this structure directly into the latent space of the diffusion model during generation, which does not require fine-tuning or additional memory during inference. 🧵
0:12

🚀New paper out - We present Video-MSG (Multimodal Sketch Guidance), a novel planning-based training-free guidance method for T2V models, improving control of spatial layout and object trajectories. 🔧 Key idea: • Generate a Video Sketch — a spatio-temporal plan with background, foreground, and motion in the pixel space. • Encode this structure directly into the latent space of the diffusion model during generation, which does not require fine-tuning or additional memory during inference. 🧵

Jialu Li

35,060 views • 1 year ago