Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Everyone is sleeping on this new OCR model! dots-ocr is a new 1.7B vision-language model that achieves SOTA performance on multilingual document parsing. - Supports 100+ languages - Works with both images and PDFs - Handles text, tables, formulas seamlessly 100% open-source.

Akshay 🚀

283,877 subscribers

252,205 views • 1 year ago •via X (Twitter)

Science & Technology Education

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Everyone is sleeping on this new OCR model! - 85.9% (sota) on olmocr bench - 90+ language support w/benchmarks - 4B model (down from 9B) - Full layout information - Extracts + captions images and diagrams - Strong handwriting, math, form, table support 100% open-source.

Everyone is sleeping on this new OCR model! - 85.9% (sota) on olmocr bench - 90+ language support w/benchmarks - 4B model (down from 9B) - Full layout information - Extracts + captions images and diagrams - Strong handwriting, math, form, table support 100% open-source.

Akshay 🚀

168,340 views • 4 months ago

- <1B params - supports 91 languages - 5 pages/s on RTX 5090 - runs on CPU, GPU, MPS - 83.3% olmocr bench score (top under 3B) Surya OCR is a state-of-the-art model for document intelligence. 100% open-source.

- <1B params - supports 91 languages - 5 pages/s on RTX 5090 - runs on CPU, GPU, MPS - 83.3% olmocr bench score (top under 3B) Surya OCR is a state-of-the-art model for document intelligence. 100% open-source.

Akshay 🚀

63,645 views • 2 months ago

Apple just released and open-sourced FastVLM! FastVLM is a lightning-fast vision-language model that combines rapid image and text understanding with efficient on-device performance. 100% Open Source

Apple just released and open-sourced FastVLM! FastVLM is a lightning-fast vision-language model that combines rapid image and text understanding with efficient on-device performance. 100% Open Source

Sumanth

43,704 views • 11 months ago

Baidu Inc. just dropped PaddleOCR-VL-1.5, and it’s not just another OCR model. This is a fully open-source OCR model with just 0.9B parameters, built specifically for production-grade document understanding. And the results speak loudly 👇 On OmniDocBench V1.5, the most authoritative global document parsing benchmark, PaddleOCR-VL-1.5 ranks #1 overall, hitting 94.5% overall accuracy, outperforming models like DeepSeek-OCR2. As the first OCR model natively supporting irregular document layout positioning, it perfectly solves OCR pain points in production for complex structured business documents such as financial reports and insurance forms. While a lot of the industry is racing toward bigger models, PaddleOCR is betting on something smarter: small parameters + high performance + open source + real usability. That combination is exactly what scalable document intelligence needs right now. Demo / API → Open source → Model → Curious to see how teams start building on top of this.

Baidu Inc. just dropped PaddleOCR-VL-1.5, and it’s not just another OCR model. This is a fully open-source OCR model with just 0.9B parameters, built specifically for production-grade document understanding. And the results speak loudly 👇 On OmniDocBench V1.5, the most authoritative global document parsing benchmark, PaddleOCR-VL-1.5 ranks #1 overall, hitting 94.5% overall accuracy, outperforming models like DeepSeek-OCR2. As the first OCR model natively supporting irregular document layout positioning, it perfectly solves OCR pain points in production for complex structured business documents such as financial reports and insurance forms. While a lot of the industry is racing toward bigger models, PaddleOCR is betting on something smarter: small parameters + high performance + open source + real usability. That combination is exactly what scalable document intelligence needs right now. Demo / API → Open source → Model → Curious to see how teams start building on top of this.

Bishal Nandi

35,318 views • 6 months ago

I needed an app to export markdown from images and PDFs, so I built one using the best model on the market: Mistral OCR. It can convert images, PDFs, and even extract tables and images, keeping them contextually within the markdown. All you need is a Mistral AI API.

I needed an app to export markdown from images and PDFs, so I built one using the best model on the market: Mistral OCR. It can convert images, PDFs, and even extract tables and images, keeping them contextually within the markdown. All you need is a Mistral AI API.

Pietro Schirano

48,786 views • 1 year ago

MinerU-Diffusion A 2.5B diffusion-based OCR model that replaces slow autoregressive decoding with parallel block-wise diffusion, achieving up to 3.2x faster inference while improving robustness on complex documents with tables, formulas, and layouts.

MinerU-Diffusion A 2.5B diffusion-based OCR model that replaces slow autoregressive decoding with parallel block-wise diffusion, achieving up to 3.2x faster inference while improving robustness on complex documents with tables, formulas, and layouts.

DailyPapers

15,304 views • 4 months ago

The new open-source Text to Speech model: Fish Speech 1.4 is brilliant! Trained on a massive 700K hours of multilingual speech data in 8 languages - Instant voice cloning 🗣️ - Ultra-low latency ⚡ - Compact model (~1GB weights) 🏋️‍♂️

The new open-source Text to Speech model: Fish Speech 1.4 is brilliant! Trained on a massive 700K hours of multilingual speech data in 8 languages - Instant voice cloning 🗣️ - Ultra-low latency ⚡ - Compact model (~1GB weights) 🏋️‍♂️

Rohan Paul

228,890 views • 1 year ago

Multimodal AI is here 🤯 GPT-4 can now turn your images into a text file in a snap with the new code interpreter model. Witness the OCR magic in action 🔥

Multimodal AI is here 🤯 GPT-4 can now turn your images into a text file in a snap with the new code interpreter model. Witness the OCR magic in action 🔥

Shubham Saboo

727,673 views • 3 years ago

NVIDIA's LocateAnything is a new vision model for grounding and detection. Very performant and accurate! > 10x faster than Qwen3-VL > 138M queries + 785M boxes > GUI, OCR, docs, dense detection > Free & open source

NVIDIA's LocateAnything is a new vision model for grounding and detection. Very performant and accurate! > 10x faster than Qwen3-VL > 138M queries + 785M boxes > GUI, OCR, docs, dense detection > Free & open source

⚡AI Search⚡

121,708 views • 2 months ago

India is accelerating its sovereign AI mission with homegrown models built for local languages and governance needs. Bengaluru-based Sarvam AI has launched Sarvam Vision, an OCR system for complex paper records, and Bulbul, a text-to-speech model spanning 11 Indian languages. Sarvam claims its OCR beat Google Gemini on a benchmark. Backed by government funding, the programme aims to cut dependence on foreign AI systems. Watch this report. 🔽

India is accelerating its sovereign AI mission with homegrown models built for local languages and governance needs. Bengaluru-based Sarvam AI has launched Sarvam Vision, an OCR system for complex paper records, and Bulbul, a text-to-speech model spanning 11 Indian languages. Sarvam claims its OCR beat Google Gemini on a benchmark. Backed by government funding, the programme aims to cut dependence on foreign AI systems. Watch this report. 🔽

BJP

34,446 views • 6 months ago

PDF parsing is still painful because LLMs reorder text in complex layouts, break tables across pages, and fail on graphs or images. 💡Testing the new open-source OCRFlux model, and here the results are really good for a change. So OCRFlux is a multimodal, LLM based toolkit for converting PDFs and images into clean, readable, plain Markdown text. Because the underlying VLM is only 3B param, it runs even on a 3090 GPU. The model is available on Hugging Face . The engine that powers the OCRFlux, teaches the model to rebuild every page and then stitch fragments across pages into one clean Markdown file. It bundles one vision language model with 3B parameters that was fine-tuned from Qwen 2.5-VL-3B-Instruct for both page parsing and cross-page merging. OCRFlux reads raw page images and, guided by task prompts, outputs Markdown for each page and merges split elements across pages. The evaluation shows Edit Distance Similarity (EDS) 0.967 and cross‑page table Tree Edit Distance 0.950, so the parser is both accurate and layout aware. How it works while parsing each page - Convert into text with a natural reading order, even in the presence of multi-column layouts, figures, and insets - Support for complicated tables and equations - Automatically removes headers and footers Cross-page table/paragraph merging - Cross-page table merging - Cross-page paragraph merging A compact vision‑language models can beat bigger models once cross‑page context is added. 🧵 1/n Read on 👇

PDF parsing is still painful because LLMs reorder text in complex layouts, break tables across pages, and fail on graphs or images. 💡Testing the new open-source OCRFlux model, and here the results are really good for a change. So OCRFlux is a multimodal, LLM based toolkit for converting PDFs and images into clean, readable, plain Markdown text. Because the underlying VLM is only 3B param, it runs even on a 3090 GPU. The model is available on Hugging Face . The engine that powers the OCRFlux, teaches the model to rebuild every page and then stitch fragments across pages into one clean Markdown file. It bundles one vision language model with 3B parameters that was fine-tuned from Qwen 2.5-VL-3B-Instruct for both page parsing and cross-page merging. OCRFlux reads raw page images and, guided by task prompts, outputs Markdown for each page and merges split elements across pages. The evaluation shows Edit Distance Similarity (EDS) 0.967 and cross‑page table Tree Edit Distance 0.950, so the parser is both accurate and layout aware. How it works while parsing each page - Convert into text with a natural reading order, even in the presence of multi-column layouts, figures, and insets - Support for complicated tables and equations - Automatically removes headers and footers Cross-page table/paragraph merging - Cross-page table merging - Cross-page paragraph merging A compact vision‑language models can beat bigger models once cross‑page context is added. 🧵 1/n Read on 👇

Rohan Paul

149,292 views • 1 year ago

Announcing the open-source release of Qwen3-VL! A powerful vision-language model that can operate GUIs, code charts from mockups, and recognize "everything" from daily life to specialized fields. Highlights: 🔹 Precise event location in videos up to 2 hours long. 🔹 OCR language support boosted from 19 to 32, with major gains on rare characters and tilted text. 🔹 Supports a native 256K context length, expandable to 1M tokens. 🔹 Achieves leading accuracy in risk detection in real-world scenarios. Available on ModelScope, HuggingFace, GitHub, and integrated into Alibaba Cloud Model Studio. Try it today!

Announcing the open-source release of Qwen3-VL! A powerful vision-language model that can operate GUIs, code charts from mockups, and recognize "everything" from daily life to specialized fields. Highlights: 🔹 Precise event location in videos up to 2 hours long. 🔹 OCR language support boosted from 19 to 32, with major gains on rare characters and tilted text. 🔹 Supports a native 256K context length, expandable to 1M tokens. 🔹 Achieves leading accuracy in risk detection in real-world scenarios. Available on ModelScope, HuggingFace, GitHub, and integrated into Alibaba Cloud Model Studio. Try it today!

Tongyi Lab

59,944 views • 10 months ago

You can now automate any task on your phone by letting AI control it AutoGLM from Zai is a 100% open source vision-language model that: - Understands what's on your screen - Acts autonomously from a prompt - Totally private (works LOCALLY) Tutorial ↓

You can now automate any task on your phone by letting AI control it AutoGLM from Zai is a 100% open source vision-language model that: - Understands what's on your screen - Acts autonomously from a prompt - Totally private (works LOCALLY) Tutorial ↓

Paul Couvert

169,881 views • 8 months ago

LiteParse Samples 📄🧑‍🏫 LiteParse is our free and fast document parser that can parse text with bounding boxes from any document. I’ve created a new repository that contains some demos on how you can make use of its outputs! ✅ Comparison against PyPDF and PyMuPDF ✅ Visual Citations: search for any keyword and see joined bounding boxes pop up in the source images It should be a default tool to help AI agents OCR any document type (supports PDF, Word, Powerpoint + dozens of other formats), before heavier-weight VLM-based document parsing solutions (like our own LlamaParse). LiteParse Samples repo: LiteParse:

LiteParse Samples 📄🧑‍🏫 LiteParse is our free and fast document parser that can parse text with bounding boxes from any document. I’ve created a new repository that contains some demos on how you can make use of its outputs! ✅ Comparison against PyPDF and PyMuPDF ✅ Visual Citations: search for any keyword and see joined bounding boxes pop up in the source images It should be a default tool to help AI agents OCR any document type (supports PDF, Word, Powerpoint + dozens of other formats), before heavier-weight VLM-based document parsing solutions (like our own LlamaParse). LiteParse Samples repo: LiteParse:

Jerry Liu

13,196 views • 4 months ago

We've spent years building LlamaParse into the most accurate document parser for production AI. Along the way, we learned a lot about what fast, lightweight parsing actually looks like under the hood. Today, we're open-sourcing a light-weight core of that tech as LiteParse 🦙 It's a CLI + TS-native library for layout-aware text parsing from PDFs, Office docs, and images. Local, zero Python dependencies, and built specifically for agents and LLM pipelines. Think of it as our way of giving the community a solid starting point for document parsing: npm i -g @llamaindex/liteparse lit parse anything.pdf - preserves spatial layout (columns, tables, alignment) - built-in local OCR, or bring your own server - screenshots for multimodal LLMs - handles PDFs, office docs, images Blog: Repo:

We've spent years building LlamaParse into the most accurate document parser for production AI. Along the way, we learned a lot about what fast, lightweight parsing actually looks like under the hood. Today, we're open-sourcing a light-weight core of that tech as LiteParse 🦙 It's a CLI + TS-native library for layout-aware text parsing from PDFs, Office docs, and images. Local, zero Python dependencies, and built specifically for agents and LLM pipelines. Think of it as our way of giving the community a solid starting point for document parsing: npm i -g @llamaindex/liteparse lit parse anything.pdf - preserves spatial layout (columns, tables, alignment) - built-in local OCR, or bring your own server - screenshots for multimodal LLMs - handles PDFs, office docs, images Blog: Repo:

LlamaIndex 🦙

581,608 views • 5 months ago

I just built my own OCR app powered by Google's Gemma 3. It runs 100% locally on my computer using Ollama and extracts text from images as structured markdown. The code is open-source, and you can find it in the next tweet.

I just built my own OCR app powered by Google's Gemma 3. It runs 100% locally on my computer using Ollama and extracts text from images as structured markdown. The code is open-source, and you can find it in the next tweet.

Akshay 🚀

477,685 views • 1 year ago

Inspired by Brian Roemmele, I set up DeepSeek-OCR on colab. Even with a T4 GPU and 4-bit quantization, it scans a page in about 45 seconds. In this video, you can see that it compressed 527 text tokens to 249 image tokens. DeepSeek-OCR is trained on nearly 100 languages, they say in their paper. So, I'm going to try using it on some old manuscripts written in indic languages soon.

Inspired by Brian Roemmele, I set up DeepSeek-OCR on colab. Even with a T4 GPU and 4-bit quantization, it scans a page in about 45 seconds. In this video, you can see that it compressed 527 text tokens to 249 image tokens. DeepSeek-OCR is trained on nearly 100 languages, they say in their paper. So, I'm going to try using it on some old manuscripts written in indic languages soon.

Ashraff Hathibelagal

226,767 views • 9 months ago

Finally! A Text-to-SQL tool that actually works! Vanna is an open-source RAG framework for complex Text-to-SQL generation. It manages dynamic data and allows custom RAG model training for greater accuracy. 100% open-source.

Finally! A Text-to-SQL tool that actually works! Vanna is an open-source RAG framework for complex Text-to-SQL generation. It manages dynamic data and allows custom RAG model training for greater accuracy. 100% open-source.

Akshay 🚀

168,649 views • 1 year ago

Introducing Veo 2, our new, state-of-the-art video model (with better understanding of real-world physics & movement, up to 4K resolution). You can join the waitlist on VideoFX. Our new and improved Imagen 3 model also achieves SOTA results, and is coming today to 100+ countries in ImageFX.

Introducing Veo 2, our new, state-of-the-art video model (with better understanding of real-world physics & movement, up to 4K resolution). You can join the waitlist on VideoFX. Our new and improved Imagen 3 model also achieves SOTA results, and is coming today to 100+ countries in ImageFX.

Sundar Pichai

4,573,526 views • 1 year ago