Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

📊 VBench: Comprehensive Benchmark Suite for Video Generative Models 🎞️ 🏛️ Hierarchical and Disentangled Dimensions 👁️ Human-Alignment in Each Dimension 🌟 Valuable and Multi-Perspective Insights Website: Code:

ziqi_huang_'s profile picture

Ziqi Huang

2,857 subscribers

19,008 Aufrufe • vor 2 Jahren •via X (Twitter)

BildungWissenschaft & TechnologieKunst
LIVE

Anya Rossi• Live Now

Private livecam show

1 Kommentare

Profilbild von Tica Lin
Tica Linvor 2 Jahren

Hi Ziqi, great work! Since I couldn't find details in your paper, I am curious how did you recruit annotators, and how many annotators and tasks each complete? Thanks!

Ähnliche Videos

Dimension-Reduction Attack! Video Generative Models are Experts on Controllable Image Synthesis
1:07

Dimension-Reduction Attack! Video Generative Models are Experts on Controllable Image Synthesis

AK

28,101 Aufrufe • vor 1 Jahr

Stable Virtual Camera: Generative View Synthesis with Diffusion Models Hint: Check the project website. It is awesome! Contributions: 1. A training strategy for jointly modeling large viewpoint changes and temporal smoothness. 2. A two-pass procedural sampling method for smooth video generation along arbitrarily long camera trajectories. 3. A comprehensive benchmark that evaluates NVS methods across different datasets and settings. 4. An open-source release of model weights to support future research.
0:24

Stable Virtual Camera: Generative View Synthesis with Diffusion Models Hint: Check the project website. It is awesome! Contributions: 1. A training strategy for jointly modeling large viewpoint changes and temporal smoothness. 2. A two-pass procedural sampling method for smooth video generation along arbitrarily long camera trajectories. 3. A comprehensive benchmark that evaluates NVS methods across different datasets and settings. 4. An open-source release of model weights to support future research.

MrNeRF

38,619 Aufrufe • vor 1 Jahr

Meta PARTNR is a benchmark for planning and reasoning in embodied multi-agent tasks. This large-scale human and robot collaboration benchmark was core to our recent demos and also informs our work as scientists and engineers pushing this field of study forward.
1:21

Meta PARTNR is a benchmark for planning and reasoning in embodied multi-agent tasks. This large-scale human and robot collaboration benchmark was core to our recent demos and also informs our work as scientists and engineers pushing this field of study forward.

AI at Meta

33,607 Aufrufe • vor 1 Jahr

New paper: Multi-Faceted Interactivity Alignment in Full-Duplex Speech Models We use RL to post-train speech models (Moshi and PersonaPlex) to talk more like a human: to know when to respond, when to wait, and when to nod along with “yeah”s and “okay”s when listening.
0:40

New paper: Multi-Faceted Interactivity Alignment in Full-Duplex Speech Models We use RL to post-train speech models (Moshi and PersonaPlex) to talk more like a human: to know when to respond, when to wait, and when to nod along with “yeah”s and “okay”s when listening.

kyutai

32,055 Aufrufe • vor 1 Monat

Introducing Scalable Option Learning (SOL☀️), a blazingly fast hierarchical RL algorithm that makes progress on long-horizon tasks and demonstrates positive scaling trends on the largely unsolved NetHack benchmark, when trained for 30 billion samples. Details, paper and code in >
2:29

Introducing Scalable Option Learning (SOL☀️), a blazingly fast hierarchical RL algorithm that makes progress on long-horizon tasks and demonstrates positive scaling trends on the largely unsolved NetHack benchmark, when trained for 30 billion samples. Details, paper and code in >

Mikael Henaff

21,043 Aufrufe • vor 9 Monaten

Together with the Ego4D consortium, we recently released Ego-Exo4D: A diverse, large-scale multi-modal, multi-view, video dataset and benchmark. Learn more about the work ➡️ Access the dataset ➡️ This work could help to advance AI models' understanding of complex human skills & enable new applications for AR systems, robotics & more.
0:49

Together with the Ego4D consortium, we recently released Ego-Exo4D: A diverse, large-scale multi-modal, multi-view, video dataset and benchmark. Learn more about the work ➡️ Access the dataset ➡️ This work could help to advance AI models' understanding of complex human skills & enable new applications for AR systems, robotics & more.

AI at Meta

78,070 Aufrufe • vor 2 Jahren

This clip offers valuable insights for both men and women.
3:42

This clip offers valuable insights for both men and women.

Aji Bussu Onye Mpiawa azụ 🇨🇮

110,371 Aufrufe • vor 1 Jahr

Additionally, looking towards the future, we’re releasing PARTNR: a benchmark for Planning And Reasoning Tasks in humaN-Robot collaboration. Built on Habitat 3.0, it’s the largest benchmark of its kind to study and evaluate human-robot collaboration in household activities By providing a standardized benchmark and dataset we hope to enable new research on robots that can not only operate in isolation, but in collaboration with people. Details and code ➡️
1:01

Additionally, looking towards the future, we’re releasing PARTNR: a benchmark for Planning And Reasoning Tasks in humaN-Robot collaboration. Built on Habitat 3.0, it’s the largest benchmark of its kind to study and evaluate human-robot collaboration in household activities By providing a standardized benchmark and dataset we hope to enable new research on robots that can not only operate in isolation, but in collaboration with people. Details and code ➡️

AI at Meta

20,244 Aufrufe • vor 1 Jahr

Today we’re announcing two new updates in our computer vision work — a new, expanded license for our DINOv2 model and the release of FACET, a comprehensive new benchmark dataset to help evaluate and improve fairness in vision models. More details ➡️ 🧵
0:27

Today we’re announcing two new updates in our computer vision work — a new, expanded license for our DINOv2 model and the release of FACET, a comprehensive new benchmark dataset to help evaluate and improve fairness in vision models. More details ➡️ 🧵

AI at Meta

453,971 Aufrufe • vor 2 Jahren

Exciting News from Open-Sora! 🚀 They've just made the ENTIRE suite of their video-generation model open source! Dive into the world of cutting-edge AI with access to model weights, comprehensive training source code, and detailed architecture insights. Start building your dream video-generation model today! Check it out 👉
0:28

Exciting News from Open-Sora! 🚀 They've just made the ENTIRE suite of their video-generation model open source! Dive into the world of cutting-edge AI with access to model weights, comprehensive training source code, and detailed architecture insights. Start building your dream video-generation model today! Check it out 👉

Yang You

245,742 Aufrufe • vor 2 Jahren

In this benchmark deep-dive, Sapient’s founders William and Guan are joined by research team members Changling and Yasin to unpack HRM-Text’s performance across MATH, DROP, ARC-Challenge, and MMLU. 📊 Beyond the scores, they discuss what each benchmark measures, how HRM-Text compares with larger models, and why efficiency matters. Watch the full discussion to learn more about HRM-Text and Sapient’s leaner path toward general intelligence.
12:43

In this benchmark deep-dive, Sapient’s founders William and Guan are joined by research team members Changling and Yasin to unpack HRM-Text’s performance across MATH, DROP, ARC-Challenge, and MMLU. 📊 Beyond the scores, they discuss what each benchmark measures, how HRM-Text compares with larger models, and why efficiency matters. Watch the full discussion to learn more about HRM-Text and Sapient’s leaner path toward general intelligence.

Sapient Intelligence

241,067 Aufrufe • vor 1 Monat

🔥🔥We are excited to announce #Vchitect, an open-source project for video generative models Hugging Face 📽️LaVie (Text2Video Model) - Code: - 📽️SEINE (Image2Video Model) - Code: -
0:47

🔥🔥We are excited to announce #Vchitect, an open-source project for video generative models Hugging Face 📽️LaVie (Text2Video Model) - Code: - 📽️SEINE (Image2Video Model) - Code: -

Ziwei Liu

356,643 Aufrufe • vor 2 Jahren

the new benchmark for video models is getting into a car. grok imagine is one of the best video models rn and cant really get it right
0:26

the new benchmark for video models is getting into a car. grok imagine is one of the best video models rn and cant really get it right

Flowers ☾

25,024 Aufrufe • vor 5 Monaten

We’re ushering in a new era of mobility, energy, delivery, and insights that will transform how business is done! With a suite of advanced business solutions that are comprehensive and connected, we are GM Envolve. #OutSmartChange​
1:24

We’re ushering in a new era of mobility, energy, delivery, and insights that will transform how business is done! With a suite of advanced business solutions that are comprehensive and connected, we are GM Envolve. #OutSmartChange​

GM Fleet

20,642 Aufrufe • vor 3 Jahren

We asked Dr. Alissa Walsh to share her perspective on long-term remission and comprehensive disease control in UC. Watch the video to learn more and follow us for more updates.
0:55

We asked Dr. Alissa Walsh to share her perspective on long-term remission and comprehensive disease control in UC. Watch the video to learn more and follow us for more updates.

Lilly Gastroenterology

33,816 Aufrufe • vor 1 Jahr

🤨 Are Multimodal Large Language Models really as 𝐠𝐨𝐨𝐝 at 𝐜𝐡𝐚𝐫𝐭 𝐮𝐧𝐝𝐞𝐫𝐬𝐭𝐚𝐧𝐝𝐢𝐧𝐠 as existing benchmarks such as ChartQA suggest? 🚫 Our ℂ𝕙𝕒𝕣𝕏𝕚𝕧 benchmark suggests NO! 🥇Humans achieve ✨𝟖𝟎+% correctness. 🥈Sonnet 3.5 outperforms GPT-4o by 10+ points, reaching 🌟𝟔𝟎% correctness. 🥉Open-weight models are capped at ⭐𝟑𝟐% correctness. 🪜 Leaderboard: 📜 Preprint: 📊 Charxiv is ✨𝟏𝟎𝟎% handcrafted with rigorous human validation, and it reveals substantial gaps among Multimodal Large Language Models and humans in chart understanding. 🎥👇 80 second video (🎶sound on!). 🧶 1/6
1:17

🤨 Are Multimodal Large Language Models really as 𝐠𝐨𝐨𝐝 at 𝐜𝐡𝐚𝐫𝐭 𝐮𝐧𝐝𝐞𝐫𝐬𝐭𝐚𝐧𝐝𝐢𝐧𝐠 as existing benchmarks such as ChartQA suggest? 🚫 Our ℂ𝕙𝕒𝕣𝕏𝕚𝕧 benchmark suggests NO! 🥇Humans achieve ✨𝟖𝟎+% correctness. 🥈Sonnet 3.5 outperforms GPT-4o by 10+ points, reaching 🌟𝟔𝟎% correctness. 🥉Open-weight models are capped at ⭐𝟑𝟐% correctness. 🪜 Leaderboard: 📜 Preprint: 📊 Charxiv is ✨𝟏𝟎𝟎% handcrafted with rigorous human validation, and it reveals substantial gaps among Multimodal Large Language Models and humans in chart understanding. 🎥👇 80 second video (🎶sound on!). 🧶 1/6

Zirui "Colin" Wang

48,197 Aufrufe • vor 2 Jahren

Missing the classic stages? Log in and receive the remastered Forest and Between Dimensions stages for free! 🌟 #Shadowverse10th #ShadowverseWB
0:25

Missing the classic stages? Log in and receive the remastered Forest and Between Dimensions stages for free! 🌟 #Shadowverse10th #ShadowverseWB

Shadowverse: Worlds Beyond

11,905 Aufrufe • vor 25 Tagen

Want to quickly craft and iterate on prompts? Check out Prompt builder in the AI Toolkit for VS Code ( Experiment with local or remote models, generate prompts using AI, and test multi-turn conversations. Plus, view the code to start building right away! 💡
1:17

Want to quickly craft and iterate on prompts? Check out Prompt builder in the AI Toolkit for VS Code ( Experiment with local or remote models, generate prompts using AI, and test multi-turn conversations. Plus, view the code to start building right away! 💡

Visual Studio Code

52,745 Aufrufe • vor 1 Jahr

📺 HunyuanVideo: A Systematic Framework For Large Video Generative Models is now available on Tost AI and 🥳 Thanks to toad Team ❤ 🌐page: 🧬code: 🍇runpod: 🥪tost: please try it 🐣
1:07

📺 HunyuanVideo: A Systematic Framework For Large Video Generative Models is now available on Tost AI and 🥳 Thanks to toad Team ❤ 🌐page: 🧬code: 🍇runpod: 🥪tost: please try it 🐣

camenduru

18,635 Aufrufe • vor 1 Jahr

Introducing Adjoint Sampling, a new learning algorithm that trains generative models based on scalar rewards. Based on theoretical foundations developed by FAIR, Adjoint Sampling leads to a highly scalable practical algorithm, and can become the foundation for further research into highly scalable sampling methods. Read our research paper on Adjoint Sampling and download the model, code, and benchmark ➡️
0:28

Introducing Adjoint Sampling, a new learning algorithm that trains generative models based on scalar rewards. Based on theoretical foundations developed by FAIR, Adjoint Sampling leads to a highly scalable practical algorithm, and can become the foundation for further research into highly scalable sampling methods. Read our research paper on Adjoint Sampling and download the model, code, and benchmark ➡️

AI at Meta

36,987 Aufrufe • vor 1 Jahr