Loading video...

Video Failed to Load

Go Home

This peanut-sized chinese model just dethroned Gemini at reading documents. It’s called glm-ocr. it’s a tiny 0.9b parameter vision-language model that is about to replace every expensive ocr api you use. → Handles text, tables, formulas, handwriting → Scored 94.62 on OmniDocBench V1.5 → 8 languages → vLLM, SGLang,...

dr_cintas's profile picture

Alvaro Cintas

130,982 subscribers

37,577 views • 3 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Fine-tune DeepSeek-OCR on your own language! (100% local) DeepSeek-OCR is a 3B-parameter vision model that achieves 97% precision while using 10× fewer vision tokens than text-based LLMs. It handles tables, papers, and handwriting without killing your GPU or budget. Why it matters: Most vision models treat documents as massive sequences of tokens, making long-context processing expensive and slow. DeepSeek-OCR uses context optical compression to convert 2D layouts into vision tokens, enabling efficient processing of complex documents. The best part? You can easily fine-tune it for your specific use case on a single GPU. I used Unsloth to run this experiment on Persian text and saw an 88.26% improvement in character error rate. ↳ Base model: 149% character error rate (CER) ↳ Fine-tuned model: 60% CER (57% more accurate) ↳ Training time: 60 steps on a single GPU Persian was just the test case. You can swap in your own dataset for any language, document type, or specific domain you're working with. I've shared the complete guide in the next tweet - all the code, notebooks, and environment setup ready to run with a single click. Everything is 100% open-source!
0:14

Fine-tune DeepSeek-OCR on your own language! (100% local) DeepSeek-OCR is a 3B-parameter vision model that achieves 97% precision while using 10× fewer vision tokens than text-based LLMs. It handles tables, papers, and handwriting without killing your GPU or budget. Why it matters: Most vision models treat documents as massive sequences of tokens, making long-context processing expensive and slow. DeepSeek-OCR uses context optical compression to convert 2D layouts into vision tokens, enabling efficient processing of complex documents. The best part? You can easily fine-tune it for your specific use case on a single GPU. I used Unsloth to run this experiment on Persian text and saw an 88.26% improvement in character error rate. ↳ Base model: 149% character error rate (CER) ↳ Fine-tuned model: 60% CER (57% more accurate) ↳ Training time: 60 steps on a single GPU Persian was just the test case. You can swap in your own dataset for any language, document type, or specific domain you're working with. I've shared the complete guide in the next tweet - all the code, notebooks, and environment setup ready to run with a single click. Everything is 100% open-source!

Akshay 🚀

126,122 views • 8 months ago

China open-sourced a peanut-sized OCR that parses entire 100-page PDFs in one shot.. It's called Unlimited-OCR. Only 3B params. Runs locally. Every other OCR tool chops your doc into pages and loses the thread. this one reads the whole thing in a single pass. → One-shot "long-horizon" parsing (32K context window) → Multilingual, out of the box → 93% on the standard parsing benchmark (+6 over baseline) → <0.11 error rate past 40 pages → Runs 100% locally on your own hardware → Works with Transformers, vLLM, SGLang, Docker, Ollama, llama.cpp Traditional cloud OCR (Textract, Google Vision, Azure Doc Intelligence) costs $1.50–$15 per 1,000 pages. This runs on your machine. For free. Forever. Baidu built it explicitly to push DeepSeek-OCR one step further. Already at 1.9M downloads on Hugging Face and most people have no idea it exists yet. 100% open source.
0:13

China open-sourced a peanut-sized OCR that parses entire 100-page PDFs in one shot.. It's called Unlimited-OCR. Only 3B params. Runs locally. Every other OCR tool chops your doc into pages and loses the thread. this one reads the whole thing in a single pass. → One-shot "long-horizon" parsing (32K context window) → Multilingual, out of the box → 93% on the standard parsing benchmark (+6 over baseline) → <0.11 error rate past 40 pages → Runs 100% locally on your own hardware → Works with Transformers, vLLM, SGLang, Docker, Ollama, llama.cpp Traditional cloud OCR (Textract, Google Vision, Azure Doc Intelligence) costs $1.50–$15 per 1,000 pages. This runs on your machine. For free. Forever. Baidu built it explicitly to push DeepSeek-OCR one step further. Already at 1.9M downloads on Hugging Face and most people have no idea it exists yet. 100% open source.

Superman

1,086,522 views • 10 days ago

Baidu just open-sourced an OCR model that reads entire 40-page documents in one shot. It's called Unlimited-OCR. 3 billion parameters but only 500 million active during inference. Runs 100% locally on your machine. Why this matters: traditional OCR tools chop documents page by page. Tables that span two pages break. Reading order gets lost. Cross-page context disappears. Unlimited-OCR processes the whole document at once. 32K context window. Text, formulas, tables, reading order all preserved across pages. Output comes out as clean structured Markdown. → 93% accuracy on the standard benchmark. +6 points over the baseline. → Error rate stays below 0.11 even past 40 pages. → Multilingual out of the box. → 2.12 million downloads on Hugging Face last month. 14,600 GitHub stars. For context: Amazon Textract, Google Cloud Vision, and Azure Document Intelligence all charge per page. This runs locally for free.
0:13

Baidu just open-sourced an OCR model that reads entire 40-page documents in one shot. It's called Unlimited-OCR. 3 billion parameters but only 500 million active during inference. Runs 100% locally on your machine. Why this matters: traditional OCR tools chop documents page by page. Tables that span two pages break. Reading order gets lost. Cross-page context disappears. Unlimited-OCR processes the whole document at once. 32K context window. Text, formulas, tables, reading order all preserved across pages. Output comes out as clean structured Markdown. → 93% accuracy on the standard benchmark. +6 points over the baseline. → Error rate stays below 0.11 even past 40 pages. → Multilingual out of the box. → 2.12 million downloads on Hugging Face last month. 14,600 GitHub stars. For context: Amazon Textract, Google Cloud Vision, and Azure Document Intelligence all charge per page. This runs locally for free.

Vaibhav Sisinty

410,602 views • 10 days ago

NVIDIA just made AI detect objects 10x faster by deleting one step. It's called LocateAnything, and it removes the biggest bottleneck no one else was fixing in vision-language models. Normally a model builds each bounding box one coordinate token at a time. 100 objects means thousands of tokens before an answer. NVIDIA scrapped that: their Parallel Box Decoding predicts the whole box in a single forward pass, as one atomic unit. → 12.7 boxes/sec on one H100 → 10x faster than Qwen3-VL → +3.8% F1 on LVIS, accuracy up, not down → 3B params, runs on one consumer GPU Treating the box as one unit keeps its coordinates tied together, which is why accuracy climbed instead of falling. One model handles detection, GUI grounding, OCR, and document understanding, ready for computer-use agents, robotics, and document pipelines. 100% open source, weights, code, demo, and paper all live.
0:16

NVIDIA just made AI detect objects 10x faster by deleting one step. It's called LocateAnything, and it removes the biggest bottleneck no one else was fixing in vision-language models. Normally a model builds each bounding box one coordinate token at a time. 100 objects means thousands of tokens before an answer. NVIDIA scrapped that: their Parallel Box Decoding predicts the whole box in a single forward pass, as one atomic unit. → 12.7 boxes/sec on one H100 → 10x faster than Qwen3-VL → +3.8% F1 on LVIS, accuracy up, not down → 3B params, runs on one consumer GPU Treating the box as one unit keeps its coordinates tied together, which is why accuracy climbed instead of falling. One model handles detection, GUI grounding, OCR, and document understanding, ready for computer-use agents, robotics, and document pipelines. 100% open source, weights, code, demo, and paper all live.

Alvaro Cintas

201,135 views • 1 month ago

A 17-year-old student replaced $850 in monthly AI bills with 1 tiny NVIDIA box and never looked at cloud invoices the same way again. The machine cost $4,699. That sounded expensive until the math started winning. Cloud GPUs charge every experiment. Every failed prompt. Every forgotten instance. Every late-night demo. A local AI box flips the model. Private documents stay on your desk. Coding agents run without API anxiety. RAG, embeddings and model testing stop burning money by the hour. One $3K to $10K client project can cover most of the hardware. After that, every new workflow becomes cheaper to build. The next AI advantage isn’t finding a better model. It’s owning the computer that runs it.
0:11

A 17-year-old student replaced $850 in monthly AI bills with 1 tiny NVIDIA box and never looked at cloud invoices the same way again. The machine cost $4,699. That sounded expensive until the math started winning. Cloud GPUs charge every experiment. Every failed prompt. Every forgotten instance. Every late-night demo. A local AI box flips the model. Private documents stay on your desk. Coding agents run without API anxiety. RAG, embeddings and model testing stop burning money by the hour. One $3K to $10K client project can cover most of the hardware. After that, every new workflow becomes cheaper to build. The next AI advantage isn’t finding a better model. It’s owning the computer that runs it.

Lummox

321,288 views • 11 days ago

Google Translate is cooked after this. A developer built a local AI translation engine that runs 40 languages entirely on your own laptop. It's called LibreTranslate. No API key. No usage limits. No sending your documents to Google's servers. You install it once. It runs forever. Here's what it handles: → Paste text. Translated instantly. → Drop in a file. Outputs the translated version. → Point it at a URL. Returns the page in your language. → Build it into your own app via its local REST API. The speed is not the story. The privacy is. Google Translate reads every sentence you paste into it. Legal contracts. Medical records. Internal emails. Client documents. Every word goes to their servers and stays there. LibreTranslate runs entirely offline. Nothing leaves your machine. Ever. The numbers: → 40 languages supported → Runs on CPU -- no GPU needed → Self-hosted in under 5 minutes → REST API built in for developers → 10K+ stars on GitHub 100% open source. MIT licensed. Price: $0. Google charges nothing for Translate either but it charges you something else. GitHub:
0:17

Google Translate is cooked after this. A developer built a local AI translation engine that runs 40 languages entirely on your own laptop. It's called LibreTranslate. No API key. No usage limits. No sending your documents to Google's servers. You install it once. It runs forever. Here's what it handles: → Paste text. Translated instantly. → Drop in a file. Outputs the translated version. → Point it at a URL. Returns the page in your language. → Build it into your own app via its local REST API. The speed is not the story. The privacy is. Google Translate reads every sentence you paste into it. Legal contracts. Medical records. Internal emails. Client documents. Every word goes to their servers and stays there. LibreTranslate runs entirely offline. Nothing leaves your machine. Ever. The numbers: → 40 languages supported → Runs on CPU -- no GPU needed → Self-hosted in under 5 minutes → REST API built in for developers → 10K+ stars on GitHub 100% open source. MIT licensed. Price: $0. Google charges nothing for Translate either but it charges you something else. GitHub:

Rimsha Bhardwaj

89,280 views • 1 month ago

Every website you’ve ever used is broken in a way you never noticed and it’s been this way for 30 years... A Midjourney engineer finally just fixed it. It’s called Pretext: A tiny library that lets websites lay out text the way magazines and newspapers do, with text flowing around images, wrapping into columns, and fitting perfectly into any shape, all at 120fps. This has been basically impossible on the web for 30 years. Every website you’ve ever used relies on the same clunky system from the 90s to figure out where text goes on screen. Pretext bypasses it entirely. 500x faster. The demos look like they shouldn’t be possible in a browser. Go look.
0:12

Every website you’ve ever used is broken in a way you never noticed and it’s been this way for 30 years... A Midjourney engineer finally just fixed it. It’s called Pretext: A tiny library that lets websites lay out text the way magazines and newspapers do, with text flowing around images, wrapping into columns, and fitting perfectly into any shape, all at 120fps. This has been basically impossible on the web for 30 years. Every website you’ve ever used relies on the same clunky system from the 90s to figure out where text goes on screen. Pretext bypasses it entirely. 500x faster. The demos look like they shouldn’t be possible in a browser. Go look.

Josh Kale

1,020,590 views • 4 months ago

A lot of people think Zach will expose a CEX But you don’t need this investigation to know that if you use those CEXs, your funds are at risk Instead of worrying every time about withdrawals or whether your funds are safe… Just use deBridge • Use any token • Buy what you want • Pay ~$1 in fees • Wait 10 seconds • No KYC • Move millions without limits • Built on Zero-TVL model Once you try this, it’s hard to go back
0:19

A lot of people think Zach will expose a CEX But you don’t need this investigation to know that if you use those CEXs, your funds are at risk Instead of worrying every time about withdrawals or whether your funds are safe… Just use deBridge • Use any token • Buy what you want • Pay ~$1 in fees • Wait 10 seconds • No KYC • Move millions without limits • Built on Zero-TVL model Once you try this, it’s hard to go back

jussy

21,098 views • 5 months ago

Grok-4.20 just claimed the number one spot worldwide in Medicine and Healthcare on the Text Arena leaderboard. It’s already making a real difference by catching critical conditions that human doctors sometimes miss. There have been multiple documented cases where Grok helped save lives. Right now Grok is outperforming every other major model, including Claude Opus 4.6 and Gemini 3.1 Pro, in this crucial field. Healthcare is one area where the stakes couldn’t be higher, and Grok is currently leading the pack. Source: X Freeze
0:19

Grok-4.20 just claimed the number one spot worldwide in Medicine and Healthcare on the Text Arena leaderboard. It’s already making a real difference by catching critical conditions that human doctors sometimes miss. There have been multiple documented cases where Grok helped save lives. Right now Grok is outperforming every other major model, including Claude Opus 4.6 and Gemini 3.1 Pro, in this crucial field. Healthcare is one area where the stakes couldn’t be higher, and Grok is currently leading the pack. Source: X Freeze

Mario Nawfal

25,212 views • 3 months ago

I'm deleting every paid document extraction tool because of this. Zipstack built Unstract and it turns any PDF, scan, or image into clean structured JSON using LLMs you already pay for. You point it at a document (an invoice, a bank statement, a KYC form, a tax return, a claims form) and it automatically pulls the fields you asked for and hands back a JSON object ready to drop straight into your database. The difference from every other document extraction tool is the setup. Most tools want a model per vendor or regex per template. This works from a single natural language prompt that handles every variation. → Extracts structured JSON from PDFs, scans, and images → Lets you write extraction schemas in plain English through Prompt Studio → Deploys as a REST API or ETL pipeline in minutes → Ships an MCP server so Claude and other agents can extract documents directly → Connects to S3, GCS, Snowflake, BigQuery, Postgres, and every major destination → LLM-agnostic: bring OpenAI, Anthropic, Bedrock, Gemini, Mistral, Ollama, or any provider you already use Basically: you have thousands of documents nobody has time to read. Unstract turns your documents into clean, structured JSON that you can run in production. This is what document extraction should have been all along.
0:11

I'm deleting every paid document extraction tool because of this. Zipstack built Unstract and it turns any PDF, scan, or image into clean structured JSON using LLMs you already pay for. You point it at a document (an invoice, a bank statement, a KYC form, a tax return, a claims form) and it automatically pulls the fields you asked for and hands back a JSON object ready to drop straight into your database. The difference from every other document extraction tool is the setup. Most tools want a model per vendor or regex per template. This works from a single natural language prompt that handles every variation. → Extracts structured JSON from PDFs, scans, and images → Lets you write extraction schemas in plain English through Prompt Studio → Deploys as a REST API or ETL pipeline in minutes → Ships an MCP server so Claude and other agents can extract documents directly → Connects to S3, GCS, Snowflake, BigQuery, Postgres, and every major destination → LLM-agnostic: bring OpenAI, Anthropic, Bedrock, Gemini, Mistral, Ollama, or any provider you already use Basically: you have thousands of documents nobody has time to read. Unstract turns your documents into clean, structured JSON that you can run in production. This is what document extraction should have been all along.

Hasan Toor

37,531 views • 6 days ago

Big moment for text-to-speech. Qwen just open-sourced a text-to-speech model that lets you clone voices, design new ones, and control speech using natural language. Let me explain what I mean: You can literally tell it "speak in a cheerful tone with slight nervousness," and it actually does that. No complex audio engineering needed. What makes this special: - 3-second voice cloning - Covers 10 languages: English, German, French, and more - Latency as low as 97ms for real-time applications - Supports both streaming and non-streaming generation The model comes in two sizes (0.6B and 1.7B parameters), so you can pick based on your hardware and quality needs. Three modes to work with: 1. Custom Voice: Use pre-built premium voices with instruction-based style control 2. Voice Design: Describe the voice you want in plain English (or Chinese), and the model creates it 3. Voice Clone: Provide a 3-second reference audio and clone that voice The best part? It integrates with vLLM for production deployment and has a simple Python package you can pip install. I've shared a link to the GitHub repo in the next tweet.
0:17

Big moment for text-to-speech. Qwen just open-sourced a text-to-speech model that lets you clone voices, design new ones, and control speech using natural language. Let me explain what I mean: You can literally tell it "speak in a cheerful tone with slight nervousness," and it actually does that. No complex audio engineering needed. What makes this special: - 3-second voice cloning - Covers 10 languages: English, German, French, and more - Latency as low as 97ms for real-time applications - Supports both streaming and non-streaming generation The model comes in two sizes (0.6B and 1.7B parameters), so you can pick based on your hardware and quality needs. Three modes to work with: 1. Custom Voice: Use pre-built premium voices with instruction-based style control 2. Voice Design: Describe the voice you want in plain English (or Chinese), and the model creates it 3. Voice Clone: Provide a 3-second reference audio and clone that voice The best part? It integrates with vLLM for production deployment and has a simple Python package you can pip install. I've shared a link to the GitHub repo in the next tweet.

Akshay 🚀

31,249 views • 6 months ago

let me explain what Anthropic just did they built an AI model so good at finding security vulnerabilities that they have refused to release it meet Claude Mythos → it’s Anthropic’s newest frontier model and it’s not available to the public. not because it’s not ready. because it’s too dangerous → Mythos found tens of thousands of zero day vulnerabilities across every major operating system and web browser… many of them 1 to 2 decades old. for context… Opus 4.6 found about 500. Mythos found tens of thousands → it found vulnerabilities in the Linux kernel. a 27 year old vulnerability in OpenBSD. a 16 year old vulnerability in FFmpeg → it doesn’t just find bugs. it writes the exploits too. that’s the part that scared them → so instead of releasing it… Anthropic has created Project Glasswing. a cybersecurity initiative where they hand picked 40+ companies to use Mythos for defense only → the partner list reads like a who’s who of tech… Amazon, Apple, Microsoft, Google, Nvidia, Broadcom, Cisco, CrowdStrike, Palo Alto Networks, JPMorgan, the Linux Foundation → Anthropic is giving up to $100 million in usage credits to these partners and $4 million to open source security organizations → they’re briefing CISA and the Commerce Department on how to handle this → the benchmarks are truly insane… Mythos hit 77.8% on SWE-bench Pro where Opus 4.6 scored 53.4%. hit 93.9% on SWE-bench Verified where Opus 4.6 scored 80.8% → Anthropic’s head of frontier red team said this is “the first time a model is this good that we decided to approach release in a very different way” this is the first time an AI company has held back a model because it was too capable not too expensive. not too slow. too dangerous and instead of locking it in a vault they weaponized it for defense and gave it to the companies that run the internet that’s either the most responsible thing an AI company has ever done… or the scariest only time will tell
0:11

let me explain what Anthropic just did they built an AI model so good at finding security vulnerabilities that they have refused to release it meet Claude Mythos → it’s Anthropic’s newest frontier model and it’s not available to the public. not because it’s not ready. because it’s too dangerous → Mythos found tens of thousands of zero day vulnerabilities across every major operating system and web browser… many of them 1 to 2 decades old. for context… Opus 4.6 found about 500. Mythos found tens of thousands → it found vulnerabilities in the Linux kernel. a 27 year old vulnerability in OpenBSD. a 16 year old vulnerability in FFmpeg → it doesn’t just find bugs. it writes the exploits too. that’s the part that scared them → so instead of releasing it… Anthropic has created Project Glasswing. a cybersecurity initiative where they hand picked 40+ companies to use Mythos for defense only → the partner list reads like a who’s who of tech… Amazon, Apple, Microsoft, Google, Nvidia, Broadcom, Cisco, CrowdStrike, Palo Alto Networks, JPMorgan, the Linux Foundation → Anthropic is giving up to $100 million in usage credits to these partners and $4 million to open source security organizations → they’re briefing CISA and the Commerce Department on how to handle this → the benchmarks are truly insane… Mythos hit 77.8% on SWE-bench Pro where Opus 4.6 scored 53.4%. hit 93.9% on SWE-bench Verified where Opus 4.6 scored 80.8% → Anthropic’s head of frontier red team said this is “the first time a model is this good that we decided to approach release in a very different way” this is the first time an AI company has held back a model because it was too capable not too expensive. not too slow. too dangerous and instead of locking it in a vault they weaponized it for defense and gave it to the companies that run the internet that’s either the most responsible thing an AI company has ever done… or the scariest only time will tell

klöss

21,270 views • 3 months ago

🚨 NVIDIA just flipped the entire AI game… and this is NOT about gaming. DeepSeek-V4-Pro is now live on their build platform. 1.6 TRILLION parameters. Yes… the largest open-source model on the planet right now. And here’s the crazy part: They’re letting you run it FREE On Blackwell GPUs in the cloud. This is the same level of hardware companies like Google, Meta, and Microsoft fight billions to access. Now it’s just… available. No waitlist. No insane setup. Just raw power. We’re watching the shift happen in real time: → From closed AI → open domination → From GPU scarcity → free access → From Big Tech control → builders winning This isn’t an update. It’s a warning shot. Who’s already testing this? Link👇
0:18

🚨 NVIDIA just flipped the entire AI game… and this is NOT about gaming. DeepSeek-V4-Pro is now live on their build platform. 1.6 TRILLION parameters. Yes… the largest open-source model on the planet right now. And here’s the crazy part: They’re letting you run it FREE On Blackwell GPUs in the cloud. This is the same level of hardware companies like Google, Meta, and Microsoft fight billions to access. Now it’s just… available. No waitlist. No insane setup. Just raw power. We’re watching the shift happen in real time: → From closed AI → open domination → From GPU scarcity → free access → From Big Tech control → builders winning This isn’t an update. It’s a warning shot. Who’s already testing this? Link👇

divyansh tiwari

29,941 views • 3 months ago

🚨 Alibaba just open sourced a GUI agent that lives inside your webpage and controls it with natural language. It's called Page Agent and it's not a browser extension. It's pure JavaScript no Python, no Puppeteer, no headless browser, no screenshots. Just one script tag and your web app understands natural language. Here's what it actually does: → Embed it with a single tag or npm install → Control any web interface with plain English commands → Text-based DOM manipulation no OCR, no vision models needed → Bring your own LLM (GPT, Claude, Qwen, anything) → Ships a built-in UI with human-in-the-loop support → Turn 20-click ERP/CRM workflows into one sentence → Optional Chrome extension for multi-tab agent tasks → Works on any web app SaaS, admin panels, internal tools Companies are charging $30/month for AI copilots built on this exact idea. This is 3 lines of code. Your users. Your interface. The AI copilot layer for every web app just got open sourced. 1.6K stars. 100% Open Source. (Link in the comments)
0:18

🚨 Alibaba just open sourced a GUI agent that lives inside your webpage and controls it with natural language. It's called Page Agent and it's not a browser extension. It's pure JavaScript no Python, no Puppeteer, no headless browser, no screenshots. Just one script tag and your web app understands natural language. Here's what it actually does: → Embed it with a single tag or npm install → Control any web interface with plain English commands → Text-based DOM manipulation no OCR, no vision models needed → Bring your own LLM (GPT, Claude, Qwen, anything) → Ships a built-in UI with human-in-the-loop support → Turn 20-click ERP/CRM workflows into one sentence → Optional Chrome extension for multi-tab agent tasks → Works on any web app SaaS, admin panels, internal tools Companies are charging $30/month for AI copilots built on this exact idea. This is 3 lines of code. Your users. Your interface. The AI copilot layer for every web app just got open sourced. 1.6K stars. 100% Open Source. (Link in the comments)

Ihtesham Ali

135,384 views • 4 months ago

Holy shit... Microsoft open sourced an inference framework that runs a 100B parameter LLM on a single CPU. It's called BitNet. And it does what was supposed to be impossible. No GPU. No cloud. No $10K hardware setup. Just your laptop running a 100-billion parameter model at human reading speed. Here's how it works: Every other LLM stores weights in 32-bit or 16-bit floats. BitNet uses 1.58 bits. Weights are ternary just -1, 0, or +1. That's it. No floats. No expensive matrix math. Pure integer operations your CPU was already built for. The result: - 100B model runs on a single CPU at 5-7 tokens/second - 2.37x to 6.17x faster than llama.cpp on x86 - 82% lower energy consumption on x86 CPUs - 1.37x to 5.07x speedup on ARM (your MacBook) - Memory drops by 16-32x vs full-precision models The wildest part: Accuracy barely moves. BitNet b1.58 2B4T their flagship model was trained on 4 trillion tokens and benchmarks competitively against full-precision models of the same size. The quantization isn't destroying quality. It's just removing the bloat. What this actually means: - Run AI completely offline. Your data never leaves your machine - Deploy LLMs on phones, IoT devices, edge hardware - No more cloud API bills for inference - AI in regions with no reliable internet The model supports ARM and x86. Works on your MacBook, your Linux box, your Windows machine. 27.4K GitHub stars. 2.2K forks. Built by Microsoft Research. 100% Open Source. MIT License.
0:13

Holy shit... Microsoft open sourced an inference framework that runs a 100B parameter LLM on a single CPU. It's called BitNet. And it does what was supposed to be impossible. No GPU. No cloud. No $10K hardware setup. Just your laptop running a 100-billion parameter model at human reading speed. Here's how it works: Every other LLM stores weights in 32-bit or 16-bit floats. BitNet uses 1.58 bits. Weights are ternary just -1, 0, or +1. That's it. No floats. No expensive matrix math. Pure integer operations your CPU was already built for. The result: - 100B model runs on a single CPU at 5-7 tokens/second - 2.37x to 6.17x faster than llama.cpp on x86 - 82% lower energy consumption on x86 CPUs - 1.37x to 5.07x speedup on ARM (your MacBook) - Memory drops by 16-32x vs full-precision models The wildest part: Accuracy barely moves. BitNet b1.58 2B4T their flagship model was trained on 4 trillion tokens and benchmarks competitively against full-precision models of the same size. The quantization isn't destroying quality. It's just removing the bloat. What this actually means: - Run AI completely offline. Your data never leaves your machine - Deploy LLMs on phones, IoT devices, edge hardware - No more cloud API bills for inference - AI in regions with no reliable internet The model supports ARM and x86. Works on your MacBook, your Linux box, your Windows machine. 27.4K GitHub stars. 2.2K forks. Built by Microsoft Research. 100% Open Source. MIT License.

Guri Singh

2,180,357 views • 4 months ago

Baby talk vs “parentese” - what’s the difference? Often in my replies I see parents explaining why - as a method of promoting language acquisition - they never use “baby talk.” I generally agree with this sentiment, but there are some important distinctions to be made here. If by “baby talk” you mean using cutesy nonsense words (like wa-wa for water or ba-ba for bottle) you’re on the right track. There’s no need for you to make up incorrect or overly simplified vocabulary on your child’s behalf. Use real words, even if your child isn’t quite ready to do so themself. It’s how they learn. But sometimes I see confusion between “baby talk” and what is known as “motherese” or “parentese” - which isn’t nonsensical, but simply slower and more varied in intonation. (Think of Ms. Rachel’s sing-songy voice.) And this isn’t something you need to shy away from at all. In fact, research suggests that parentese - with its prolonged vowel sounds and expressive facial expressions - can be a social hook that attracts children’s attention, encouraging them to attune not only to the language to which they are being exposed but how it is produced. Importantly, it’s complete and grammatically correct… just a little more performative than you might use elsewhere. This lovely video, shared to IG by tommypadula, is a nice example. Everything mom says is 100% correct… it’s simply exaggerated in ways that are clearly capturing her daughter’s rapt attention. Just look at the smiles and eye contact it’s attracting. This isn’t baby talk. It’s parentese. And it’s fantastic.
0:11

Baby talk vs “parentese” - what’s the difference? Often in my replies I see parents explaining why - as a method of promoting language acquisition - they never use “baby talk.” I generally agree with this sentiment, but there are some important distinctions to be made here. If by “baby talk” you mean using cutesy nonsense words (like wa-wa for water or ba-ba for bottle) you’re on the right track. There’s no need for you to make up incorrect or overly simplified vocabulary on your child’s behalf. Use real words, even if your child isn’t quite ready to do so themself. It’s how they learn. But sometimes I see confusion between “baby talk” and what is known as “motherese” or “parentese” - which isn’t nonsensical, but simply slower and more varied in intonation. (Think of Ms. Rachel’s sing-songy voice.) And this isn’t something you need to shy away from at all. In fact, research suggests that parentese - with its prolonged vowel sounds and expressive facial expressions - can be a social hook that attracts children’s attention, encouraging them to attune not only to the language to which they are being exposed but how it is produced. Importantly, it’s complete and grammatically correct… just a little more performative than you might use elsewhere. This lovely video, shared to IG by tommypadula, is a nice example. Everything mom says is 100% correct… it’s simply exaggerated in ways that are clearly capturing her daughter’s rapt attention. Just look at the smiles and eye contact it’s attracting. This isn’t baby talk. It’s parentese. And it’s fantastic.

Dan Wuori

28,726 views • 11 months ago

🚨BREAKING: Google just merged Gemini and NotebookLM into one unified workspace and it changes everything about how you use AI for deep work. It's called Notebooks in Gemini and it's the personal knowledge base that power users have been begging for. You create a notebook for a project, drop in your files, PDFs, and documents, give Gemini custom instructions, and every chat you have stays organized in one place. No more hunting through old conversations. No more re-uploading the same files every session. The wildest part is the sync. Anything you add in Gemini automatically appears in NotebookLM. Anything you add in NotebookLM automatically appears in Gemini. One source of truth. Two powerful apps. Zero friction switching between them. So you can start a research notebook in Gemini, ask it questions all week, then flip to NotebookLM to generate a Cinematic Video Overview from the same material. Next morning, open Gemini and ask it to write a full report on exactly what you just watched. That workflow used to take three apps and a lot of copy-pasting. Now it's one notebook. Rolling out this week to Google AI Ultra, Pro, and Plus subscribers on web. Mobile and free users coming soon. What do you think?
0:19

🚨BREAKING: Google just merged Gemini and NotebookLM into one unified workspace and it changes everything about how you use AI for deep work. It's called Notebooks in Gemini and it's the personal knowledge base that power users have been begging for. You create a notebook for a project, drop in your files, PDFs, and documents, give Gemini custom instructions, and every chat you have stays organized in one place. No more hunting through old conversations. No more re-uploading the same files every session. The wildest part is the sync. Anything you add in Gemini automatically appears in NotebookLM. Anything you add in NotebookLM automatically appears in Gemini. One source of truth. Two powerful apps. Zero friction switching between them. So you can start a research notebook in Gemini, ask it questions all week, then flip to NotebookLM to generate a Cinematic Video Overview from the same material. Next morning, open Gemini and ask it to write a full report on exactly what you just watched. That workflow used to take three apps and a lot of copy-pasting. Now it's one notebook. Rolling out this week to Google AI Ultra, Pro, and Plus subscribers on web. Mobile and free users coming soon. What do you think?

Mayank Vora

136,639 views • 3 months ago

Yes, Gen Z, we get it—you don’t care about data privacy. But that’s just a tiny part of the story. The real issue here is control. The Chinese Communist Party is using TikTok to build a blueprint of influence over you and our society. They’re not just tracking what you do; they’re deciding what you see, and therefore *how you think*. There is plenty of evidence this is already happening. Now imagine how much more powerful it would be as an information warfare weapon when the proverbial shit hits the fan in a potential conflict over Taiwan. Yeah, the Chinese will take control of all advanced semi-conductor chips in Taiwan (the ones that power your precious smartphone), and then use your addiction to TikTok to convince you it’s all a good idea. TikTok, as an entertainment platform, is an incredible product. It’s fun, it’s creative, and millions of Americans love using it. But we also need to recognize that it’s a Trojan horse. And right now, that horse is carrying Chinese Communist Party influence into our backyard and sending American’s data back to Beijing. That’s the problem we need to solve. The goal here is not about trying to stop American small businesses who use TikTok to promote themselves, the latest dances, or end “brain rot” trends—though maybe fixing that wouldn’t hurt either. It’s about making sure that enjoyment doesn’t come at the cost of our privacy, our freedom, or our national security. There’s a way to fix this. We don’t need to kill TikTok; we need to kick the Chinese Communist Party out of it. Ownership by someone who shares—or at least respects—our democratic values is the solution. People like Kevin O’Leary from Shark Tank and Dodgers owner Frank McCourt are already exploring a potential acquisition. But the fact that TikTok seems unwilling to even consider this solution tells us all we need to know about its true purpose.
0:18

Yes, Gen Z, we get it—you don’t care about data privacy. But that’s just a tiny part of the story. The real issue here is control. The Chinese Communist Party is using TikTok to build a blueprint of influence over you and our society. They’re not just tracking what you do; they’re deciding what you see, and therefore *how you think*. There is plenty of evidence this is already happening. Now imagine how much more powerful it would be as an information warfare weapon when the proverbial shit hits the fan in a potential conflict over Taiwan. Yeah, the Chinese will take control of all advanced semi-conductor chips in Taiwan (the ones that power your precious smartphone), and then use your addiction to TikTok to convince you it’s all a good idea. TikTok, as an entertainment platform, is an incredible product. It’s fun, it’s creative, and millions of Americans love using it. But we also need to recognize that it’s a Trojan horse. And right now, that horse is carrying Chinese Communist Party influence into our backyard and sending American’s data back to Beijing. That’s the problem we need to solve. The goal here is not about trying to stop American small businesses who use TikTok to promote themselves, the latest dances, or end “brain rot” trends—though maybe fixing that wouldn’t hurt either. It’s about making sure that enjoyment doesn’t come at the cost of our privacy, our freedom, or our national security. There’s a way to fix this. We don’t need to kill TikTok; we need to kick the Chinese Communist Party out of it. Ownership by someone who shares—or at least respects—our democratic values is the solution. People like Kevin O’Leary from Shark Tank and Dodgers owner Frank McCourt are already exploring a potential acquisition. But the fact that TikTok seems unwilling to even consider this solution tells us all we need to know about its true purpose.

Dan Crenshaw

139,497 views • 1 year ago

Moonshot AI is casually giving developers free daily access to Kimi K3 😳 no subscription no upfront payment just sign in and start using one of the largest open AI models available what you get for $0: - Kimi K3 with 2.8T parameters - 1M token context window - strong coding and reasoning performance - native vision capabilities - free daily credits that refresh automatically why this is worth checking: > access a frontier model without paying API fees > long context for large codebases and documents > works on web, desktop, mobile, and CLI getting started takes less than 2 minutes: 1. go to 2. create a free account 3. Kimi K3 is available as the default model 4. start chatting or coding with your daily free credits bonus: Moonshot Together lets you invite friends for a chance to earn 3, 7, 15, 30, or even 365 days of Kimi Membership through its rewards program benchmark highlights: > 2.8T parameter MoE model > 1M context window > strong performance across coding, browsing, and reasoning benchmarks important: free credits reset daily, rate limits apply on the free tier, and the open-weight release is expected on July 27 A simple way to try one of the latest frontier AI models without paying for API access
0:17

Moonshot AI is casually giving developers free daily access to Kimi K3 😳 no subscription no upfront payment just sign in and start using one of the largest open AI models available what you get for $0: - Kimi K3 with 2.8T parameters - 1M token context window - strong coding and reasoning performance - native vision capabilities - free daily credits that refresh automatically why this is worth checking: > access a frontier model without paying API fees > long context for large codebases and documents > works on web, desktop, mobile, and CLI getting started takes less than 2 minutes: 1. go to 2. create a free account 3. Kimi K3 is available as the default model 4. start chatting or coding with your daily free credits bonus: Moonshot Together lets you invite friends for a chance to earn 3, 7, 15, 30, or even 365 days of Kimi Membership through its rewards program benchmark highlights: > 2.8T parameter MoE model > 1M context window > strong performance across coding, browsing, and reasoning benchmarks important: free credits reset daily, rate limits apply on the free tier, and the open-weight release is expected on July 27 A simple way to try one of the latest frontier AI models without paying for API access

K2S

22,890 views • 11 days ago

Every agent. Every user. Every contribution. That’s how the Sentient GRID grows not by scale from a single model, but by compounding intelligence across an open network. The GRID isn’t a product. It’s an ecosystem of intelligence. Each new integration adds new capabilities reasoning, retrieval, data, and alignment making the whole network smarter. Closed labs build vertically (one model trying to do everything). Sentient builds horizontally thousands of agents learning, sharing, and evolving together. Today there are 100+ active partners building on the GRID from AI researchers to tool developers all feeding value back into a shared intelligence layer. It’s a living system that improves itself, powered by collaboration instead of control. The more people build on it, the more capable it becomes. Just like Linux became the invisible layer running the internet, the GRID is becoming the invisible layer powering intelligence. Open-source always wins. And the GRID is where that victory starts All apps built on the Grid will be accessible to $SENT holders. The full open release of Sentient Chat is coming soon (confirmed from the yesterday community call) gsenti
0:11

Every agent. Every user. Every contribution. That’s how the Sentient GRID grows not by scale from a single model, but by compounding intelligence across an open network. The GRID isn’t a product. It’s an ecosystem of intelligence. Each new integration adds new capabilities reasoning, retrieval, data, and alignment making the whole network smarter. Closed labs build vertically (one model trying to do everything). Sentient builds horizontally thousands of agents learning, sharing, and evolving together. Today there are 100+ active partners building on the GRID from AI researchers to tool developers all feeding value back into a shared intelligence layer. It’s a living system that improves itself, powered by collaboration instead of control. The more people build on it, the more capable it becomes. Just like Linux became the invisible layer running the internet, the GRID is becoming the invisible layer powering intelligence. Open-source always wins. And the GRID is where that victory starts All apps built on the Grid will be accessible to $SENT holders. The full open release of Sentient Chat is coming soon (confirmed from the yesterday community call) gsenti

OHJAY ⭕️ || 🇬🇧

16,178 views • 9 months ago