Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

We just released 3 million samples of high quality vision language model training dataset for use cases such as: 📄 optical character recognition (OCR) 📊 visual question answering (VQA) 📝 captioning 🤗 Learn more: 📥 Download:

NVIDIA AI Developer

111,550 subscribers

95,858 görüntüleme • 1 yıl önce •via X (Twitter)

Bilim & Teknoloji Eğitim

Anya Rossi• Live Now

Private livecam show

23 Yorum

Energy Pulse profil fotoğrafı

Energy Pulse1 yıl önce

This is gold for anyone building multimodal models, Bravo NVIDIA!👏

Furkan Gözükara profil fotoğrafı

Furkan Gözükara1 yıl önce

Just stop selling low vram from ridiculous prices I paid 32 gb vram 5090, 4000 usd

Vaibhav (VB) Srivastav profil fotoğrafı

Vaibhav (VB) Srivastav1 yıl önce

brilliant release!

PageIndex profil fotoğrafı

PageIndex1 yıl önce

Most OCR tools only extract each page independently, losing the broader document context and hierarchy. PageIndex OCR is the first long-context OCR model that preserves the document’s global hierarchical structure—outperforming Mistral OCR.

Cyril Zakka, MD profil fotoğrafı

Cyril Zakka, MD1 yıl önce

Amazing!

Quentin Lhoest 🤗 profil fotoğrafı

Quentin Lhoest 🤗1 yıl önce

So cool ! It would be amazing to improve the structure to show the images in the Dataset Viewer, happy to help :)

Bo profil fotoğrafı

Bo1 yıl önce

cc @michael_g_u please fwd to G & A 😅

Alex Veremeyenko profil fotoğrafı

Alex Veremeyenko1 yıl önce

this dataset drop is a game changer for multimodal projects, excited to see what the community builds with it

Breakpoint profil fotoğrafı

Breakpoint1 yıl önce

🔥🔥🔥

Nathan profil fotoğrafı

Nathan1 yıl önce

nice !

無限 💀 acc/acc profil fotoğrafı

無限 💀 acc/acc1 yıl önce

🤤 Data.

Aero - AI & Crypto profil fotoğrafı

Aero - AI & Crypto1 yıl önce

Data will fuel open-source. @Alibaba_Qwen your turn. @AIatMeta @Zai_org

Hardy Chen 🏃 COLM2026 profil fotoğrafı

Hardy Chen 🏃 COLM20261 yıl önce

Thanks for the great sharing! But it seems that the ocr annotations and images are not paired. Did I miss anything?

Ammar Fahmy profil fotoğrafı

Ammar Fahmy1 yıl önce

@huggingface Awsm 👌

jr profil fotoğrafı

jr1 yıl önce

thank you for your work!! Do all the images uploaded to HF yet? I see some of the folders missing.

Robert Youssef profil fotoğrafı

Robert Youssef1 yıl önce

that's a serious dataset drop. gonna make some waves in multimodal projects. nice to see real value for the community

ZIAISTAN profil fotoğrafı

ZIAISTAN1 yıl önce

Excellent can it be used to train from scratch?

Numan profil fotoğrafı

Numan1 yıl önce

@huggingface wowowow

Iqra Saifi profil fotoğrafı

Iqra Saifi1 yıl önce

Wowww

seekgpt profil fotoğrafı

seekgpt1 yıl önce

Great 👍

Caleb profil fotoğrafı

Caleb1 yıl önce

Amazing! 🤩

Himanshu Kumar profil fotoğrafı

Himanshu Kumar1 yıl önce

Large datasets are key for robust AI. This opens exciting new avenues for computer vision research. What innovative applications will this unlock?

Moon 🎑 profil fotoğrafı

Moon 🎑1 yıl önce

Really helpful for vision based model architecture.

Benzer Videolar

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:

AI at Meta

94,534 görüntüleme • 1 yıl önce

From recognizing text to understanding documents. 📄 Meet Xiaomi-OCR-0, an open-source document understanding model with just 0.8B parameters. It brings document parsing, key information extraction, and OCR-oriented visual question answering into one lightweight model. It scores 95.24 on Real5-OmniDocBench and 83.2 on average across five OCR-oriented VQA benchmarks. On OmniDocBench v1.6, Xiaomi-OCR-0 ranks first in document parsing performance among models with fewer than 1B parameters. Model weights, inference code, an interactive demo, MCP service, and Agent Skill are now open source. 👇 🤗 Huggingface: 🔗 GitHub: 📄 Demo: #XiaomiAI #OCR #OpenSource

From recognizing text to understanding documents. 📄 Meet Xiaomi-OCR-0, an open-source document understanding model with just 0.8B parameters. It brings document parsing, key information extraction, and OCR-oriented visual question answering into one lightweight model. It scores 95.24 on Real5-OmniDocBench and 83.2 on average across five OCR-oriented VQA benchmarks. On OmniDocBench v1.6, Xiaomi-OCR-0 ranks first in document parsing performance among models with fewer than 1B parameters. Model weights, inference code, an interactive demo, MCP service, and Agent Skill are now open source. 👇 🤗 Huggingface: 🔗 GitHub: 📄 Demo: #XiaomiAI #OCR #OpenSource

Xiaomi Tech

154,433 görüntüleme • 14 gün önce

Florence-2, the new vision foundation model by Microsoft, can now run 100% locally in your browser on WebGPU, thanks to Transformers.js! 🤗🤯 It supports tasks like image captioning, optical character recognition, object detection, and many more! 😍 WOW! Demo (+ source code) 👇

Florence-2, the new vision foundation model by Microsoft, can now run 100% locally in your browser on WebGPU, thanks to Transformers.js! 🤗🤯 It supports tasks like image captioning, optical character recognition, object detection, and many more! 😍 WOW! Demo (+ source code) 👇

Xenova

88,782 görüntüleme • 2 yıl önce

NVIDIA drop a 3B vision-language model for fast, high-quality visual grounding in real time accurately. - Parallel box decoding - 10× faster than Qwen3-VL - Trained on 138M queries/785M boxes - GUI, OCR, and document layout, dense detection - Open source Useful for computer-use agents and Physical AI,

NVIDIA drop a 3B vision-language model for fast, high-quality visual grounding in real time accurately. - Parallel box decoding - 10× faster than Qwen3-VL - Trained on 138M queries/785M boxes - GUI, OCR, and document layout, dense detection - Open source Useful for computer-use agents and Physical AI,

Md Ismail Šojal 🕷️

134,048 görüntüleme • 1 ay önce

📣 Microsoft Research releases Florence-VL, a new family of MLLMs powered by the generative vision foundation model Florence-2. Achieves significant improvements in general VQA, perception, hallucination, OCR, Chart, knowledge-intensive understanding, and more🔥Learn more👇

📣 Microsoft Research releases Florence-VL, a new family of MLLMs powered by the generative vision foundation model Florence-2. Achieves significant improvements in general VQA, perception, hallucination, OCR, Chart, knowledge-intensive understanding, and more🔥Learn more👇

Gradio

14,454 görüntüleme • 1 yıl önce

Meta FAIR recently released the Seamless Interaction Dataset, the largest known high-quality video dataset of its kind, with: 4,000+ diverse participants 4,000+ hours of footage 65k+ interactions 5,000+ annotated samples This dataset of full-body, in-person, face-to-face interaction videos represents a crucial stepping stone to understanding and modeling how people communicate and behave when they’re together—advancing AI's ability to generate more natural conversations and human-like gestures. Download the dataset on Hugging Face: Learn more about the dataset:

Meta FAIR recently released the Seamless Interaction Dataset, the largest known high-quality video dataset of its kind, with: 4,000+ diverse participants 4,000+ hours of footage 65k+ interactions 5,000+ annotated samples This dataset of full-body, in-person, face-to-face interaction videos represents a crucial stepping stone to understanding and modeling how people communicate and behave when they’re together—advancing AI's ability to generate more natural conversations and human-like gestures. Download the dataset on Hugging Face: Learn more about the dataset:

AI at Meta

24,133 görüntüleme • 1 yıl önce

LP-MusicCaps: LLM-Based Pseudo Music Captioning paper page: Automatic music captioning, which generates natural language descriptions for given music tracks, holds significant potential for enhancing the understanding and organization of large volumes of musical data. Despite its importance, researchers face challenges due to the costly and time-consuming collection process of existing music-language datasets, which are limited in size. To address this data scarcity issue, we propose the use of large language models (LLMs) to artificially generate the description sentences from large-scale tag datasets. This results in approximately 2.2M captions paired with 0.5M audio clips. We term it Large Language Model based Pseudo music caption dataset, shortly, LP-MusicCaps. We conduct a systemic evaluation of the large-scale music captioning dataset with various quantitative evaluation metrics used in the field of natural language processing as well as human evaluation. In addition, we trained a transformer-based music captioning model with the dataset and evaluated it under zero-shot and transfer-learning settings. The results demonstrate that our proposed approach outperforms the supervised baseline model.

LP-MusicCaps: LLM-Based Pseudo Music Captioning paper page: Automatic music captioning, which generates natural language descriptions for given music tracks, holds significant potential for enhancing the understanding and organization of large volumes of musical data. Despite its importance, researchers face challenges due to the costly and time-consuming collection process of existing music-language datasets, which are limited in size. To address this data scarcity issue, we propose the use of large language models (LLMs) to artificially generate the description sentences from large-scale tag datasets. This results in approximately 2.2M captions paired with 0.5M audio clips. We term it Large Language Model based Pseudo music caption dataset, shortly, LP-MusicCaps. We conduct a systemic evaluation of the large-scale music captioning dataset with various quantitative evaluation metrics used in the field of natural language processing as well as human evaluation. In addition, we trained a transformer-based music captioning model with the dataset and evaluated it under zero-shot and transfer-learning settings. The results demonstrate that our proposed approach outperforms the supervised baseline model.

AK

78,794 görüntüleme • 3 yıl önce

Blender Studio released Project Storm, a high-quality, animation-ready character rig designed for Blender 5.0. Learn how it was made and download here:

Blender Studio released Project Storm, a high-quality, animation-ready character rig designed for Blender 5.0. Learn how it was made and download here:

80 LEVEL

50,593 görüntüleme • 11 ay önce

🚨 Just released: MIRIAD, a million-scale medical QA dataset to ground LLMs in reliable medical knowledge. 5.8M question-answer pairs, each distilled from peer-reviewed literature! 🔥 That's structured, high-quality data built for medical AI. 🧵 ↓

🚨 Just released: MIRIAD, a million-scale medical QA dataset to ground LLMs in reliable medical knowledge. 5.8M question-answer pairs, each distilled from peer-reviewed literature! 🔥 That's structured, high-quality data built for medical AI. 🧵 ↓

Charly Wargnier

48,127 görüntüleme • 1 yıl önce

In case you missed it, we recently launched "Post-training of LLMs," a short course where you'll: ✅ Understand when and why to use post-training methods like Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning. ✅ Learn the concepts underlying the three post-training methods of SFT, DPO, and Online RL, their common use-cases, and how to curate high-quality data to effectively train a model using each method. ✅ Download a pre-trained model and implement post-training pipelines to turn a base model into an instruct model, change the identity of a chat assistant, and improve a model’s math capabilities. Learn more and enroll for free:

In case you missed it, we recently launched "Post-training of LLMs," a short course where you'll: ✅ Understand when and why to use post-training methods like Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Online Reinforcement Learning. ✅ Learn the concepts underlying the three post-training methods of SFT, DPO, and Online RL, their common use-cases, and how to curate high-quality data to effectively train a model using each method. ✅ Download a pre-trained model and implement post-training pipelines to turn a base model into an instruct model, change the identity of a chat assistant, and improve a model’s math capabilities. Learn more and enroll for free:

DeepLearning.AI

16,779 görüntüleme • 1 yıl önce

Today we presented our work on Action Recognition with 3D pose and tracking at #CVPR. We also released our code, models, and dataset of 1.5 million human trajectories. Code: Project Page:

Today we presented our work on Action Recognition with 3D pose and tracking at #CVPR. We also released our code, models, and dataset of 1.5 million human trajectories. Code: Project Page:

Jathushan Rajasegaran

132,016 görüntüleme • 3 yıl önce

Very excited to introduce Paperclip Datasets! Curate your own datasets from millions of papers in minutes. Just describe the dataset you want to build! As example, we release the largest dataset of 20k half-life human measurements curated from 2400+ drugs💊 🖇️ Try it: 📝 Blog: 📊 Half-life dataset:

Very excited to introduce Paperclip Datasets! Curate your own datasets from millions of papers in minutes. Just describe the dataset you want to build! As example, we release the largest dataset of 20k half-life human measurements curated from 2400+ drugs💊 🖇️ Try it: 📝 Blog: 📊 Half-life dataset:

James Zou

71,480 görüntüleme • 10 gün önce

Bengaluru-based startup Sarvam AI is drawing global attention with its latest AI models, Sarvam Vision and Bulbul V3. The company claims its technology has outperformed global giants like Google Gemini and ChatGPT in key optical character recognition (OCR) benchmarks. If verified, the breakthrough could mark a major moment for India’s growing AI ecosystem. What makes Sarvam Vision different? And how does Bulbul V3 push the boundaries of OCR performance? #SarvamAI

Bengaluru-based startup Sarvam AI is drawing global attention with its latest AI models, Sarvam Vision and Bulbul V3. The company claims its technology has outperformed global giants like Google Gemini and ChatGPT in key optical character recognition (OCR) benchmarks. If verified, the breakthrough could mark a major moment for India’s growing AI ecosystem. What makes Sarvam Vision different? And how does Bulbul V3 push the boundaries of OCR performance? #SarvamAI

NDTV

51,372 görüntüleme • 9 ay önce

Introducing Objaverse-XL, an open dataset of over 10 million 3D objects! With it, we train Zero123-XL, a foundation model for 3D, observing incredible 3D generalization abilities: 🧵👇 📝 Paper:

Introducing Objaverse-XL, an open dataset of over 10 million 3D objects! With it, we train Zero123-XL, a foundation model for 3D, observing incredible 3D generalization abilities: 🧵👇 📝 Paper:

Matt Deitke

368,934 görüntüleme • 3 yıl önce

Today we’re introducing Scribe v2: the most accurate transcription model ever released. While Scribe v2 Realtime is optimized for ultra low latency and agents use cases, Scribe v2 is built for batch transcription, subtitling, and captioning at scale.

Today we’re introducing Scribe v2: the most accurate transcription model ever released. While Scribe v2 Realtime is optimized for ultra low latency and agents use cases, Scribe v2 is built for batch transcription, subtitling, and captioning at scale.

ElevenLabs

558,355 görüntüleme • 10 ay önce

🚀 Meta FAIR is releasing several new research artifacts on our road to advanced machine intelligence (AMI). These latest advancements are transforming our understanding of perception. 1️⃣ Meta Perception Encoder: A large-scale vision encoder that excels across several image & video tasks. 2️⃣ Meta Perception Language Model: A fully open & reproducible vision-language model designed to tackle visual recognition tasks. 3️⃣ Meta Locate 3D: An end-to-end model for accurate object localization in 3D environments. 4️⃣ Releasing model weights for our 8B-parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability. 5️⃣Collaborative Reasoner: A framework for evaluating & improving collaborative reasoning skills in language models. Download the code, datasets, and research papers and learn more about how these artifacts are paving the way for more efficient and accurate AI systems.➡️

🚀 Meta FAIR is releasing several new research artifacts on our road to advanced machine intelligence (AMI). These latest advancements are transforming our understanding of perception. 1️⃣ Meta Perception Encoder: A large-scale vision encoder that excels across several image & video tasks. 2️⃣ Meta Perception Language Model: A fully open & reproducible vision-language model designed to tackle visual recognition tasks. 3️⃣ Meta Locate 3D: An end-to-end model for accurate object localization in 3D environments. 4️⃣ Releasing model weights for our 8B-parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability. 5️⃣Collaborative Reasoner: A framework for evaluating & improving collaborative reasoning skills in language models. Download the code, datasets, and research papers and learn more about how these artifacts are paving the way for more efficient and accurate AI systems.➡️

AI at Meta

163,663 görüntüleme • 1 yıl önce

Let's talk parsing charts 📊📈. Last week we released ParseBench, the first document OCR benchmark for AI agents. New in ParseBench: ChartDataPointMatch. Most document look at a chart and OCR the caption. Agents need the actual numbers. That's the gap between "OCR'd the text around the chart" and "actually read the chart." More about ParseBench, the GitHub code, Hugging Face dataset, and scientific paper→

Let's talk parsing charts 📊📈. Last week we released ParseBench, the first document OCR benchmark for AI agents. New in ParseBench: ChartDataPointMatch. Most document look at a chart and OCR the caption. Agents need the actual numbers. That's the gap between "OCR'd the text around the chart" and "actually read the chart." More about ParseBench, the GitHub code, Hugging Face dataset, and scientific paper→

LlamaIndex 🦙

13,987 görüntüleme • 6 ay önce

What happens when we train the largest vision-language model and add in robot experiences? The result is PaLM-E 🌴🤖, a 562-billion parameter, general-purpose, embodied visual-language generalist - across robotics, vision, and language. Website:

What happens when we train the largest vision-language model and add in robot experiences? The result is PaLM-E 🌴🤖, a 562-billion parameter, general-purpose, embodied visual-language generalist - across robotics, vision, and language. Website:

Danny Driess

1,272,956 görüntüleme • 3 yıl önce

3D-LLM: Injecting the 3D World into Large Language Models paper page: Large language models (LLMs) and Vision-Language Models (VLMs) have been proven to excel at multiple tasks, such as commonsense reasoning. Powerful as these models can be, they are not grounded in the 3D physical world, which involves richer concepts such as spatial relationships, affordances, physics, layout, and so on. In this work, we propose to inject the 3D world into large language models and introduce a whole new family of 3D-LLMs. Specifically, 3D-LLMs can take 3D point clouds and their features as input and perform a diverse set of 3D-related tasks, including captioning, dense captioning, 3D question answering, task decomposition, 3D grounding, 3D-assisted dialog, navigation, and so on. Using three types of prompting mechanisms that we design, we are able to collect over 300k 3D-language data covering these tasks. To efficiently train 3D-LLMs, we first utilize a 3D feature extractor that obtains 3D features from rendered multi- view images. Then, we use 2D VLMs as our backbones to train our 3D-LLMs. By introducing a 3D localization mechanism, 3D-LLMs can better capture 3D spatial information. Experiments on ScanQA show that our model outperforms state-of-the-art baselines by a large margin (e.g., the BLEU-1 score surpasses state-of-the-art score by 9%). Furthermore, experiments on our held-in datasets for 3D captioning, task composition, and 3D-assisted dialogue show that our model outperforms 2D VLMs. Qualitative examples also show that our model could perform more tasks beyond the scope of existing LLMs and VLMs.

3D-LLM: Injecting the 3D World into Large Language Models paper page: Large language models (LLMs) and Vision-Language Models (VLMs) have been proven to excel at multiple tasks, such as commonsense reasoning. Powerful as these models can be, they are not grounded in the 3D physical world, which involves richer concepts such as spatial relationships, affordances, physics, layout, and so on. In this work, we propose to inject the 3D world into large language models and introduce a whole new family of 3D-LLMs. Specifically, 3D-LLMs can take 3D point clouds and their features as input and perform a diverse set of 3D-related tasks, including captioning, dense captioning, 3D question answering, task decomposition, 3D grounding, 3D-assisted dialog, navigation, and so on. Using three types of prompting mechanisms that we design, we are able to collect over 300k 3D-language data covering these tasks. To efficiently train 3D-LLMs, we first utilize a 3D feature extractor that obtains 3D features from rendered multi- view images. Then, we use 2D VLMs as our backbones to train our 3D-LLMs. By introducing a 3D localization mechanism, 3D-LLMs can better capture 3D spatial information. Experiments on ScanQA show that our model outperforms state-of-the-art baselines by a large margin (e.g., the BLEU-1 score surpasses state-of-the-art score by 9%). Furthermore, experiments on our held-in datasets for 3D captioning, task composition, and 3D-assisted dialogue show that our model outperforms 2D VLMs. Qualitative examples also show that our model could perform more tasks beyond the scope of existing LLMs and VLMs.

AK

250,159 görüntüleme • 3 yıl önce