Building RAG is easy. Parsing real, unstructured data is... the hard part. Most tools fail when documents get complicated. RAGFlow by InfiniFlow makes the entire process visual and flawless 🔥 It is an (open-source!) engine built specifically to find the exact needle in a data haystack, even across literally unlimited tokens. The platform comes packed with: → "Quality in, quality out" parsing for highly complex formats → Multiple recall paired with fused re-ranking → A built-in Python and JavaScript code executor for agents → An orchestrable ingestion pipeline Here's why it stands out: 1️⃣ Structural Understanding Instead of just scraping text, it handles tables across pages, scanned copies, slides, and Excel sheets natively using deep document understanding. 2️⃣ Grounded Citations Every answer is verifiable. The UI highlights the exact chunks used, allowing you to trace any response directly back to the source material. 3️⃣ Enterprise Synchronization Keep your context constantly updated with native data sync from Google Drive, Notion, Discord, and Confluence. Stop letting bad document parsing ruin your RAG systems. Best part? It's 100% Free and open-source. Link to the repo in 🧵↓show more

Turn complex docs into clean, LLM-ready data! Every AI... company I've talked to is solving the same problem: how do you build systems that don't hallucinate and back up every answer with proper citations? Tensorlake is a tool that extracts custom-defined structured data from any unstructured document in 3 steps: ↳ Define your schema ↳ Enable citations ↳ Extract You get RAG-ready data with precise citations and bounding boxes. Feed this to your LLM, and you'll generate responses that are citation-backed and fully auditable. This is the difference between a demo and a production system. When your AI can show exactly where it got its information, you move from proof-of-concept to something people can actually trust and deploy. I've shared the Tensorlake GitHub repo in the replies!show more

Building AI agents is finally simple — and Airia... is leading the way. I’ve been testing Airia AI , enterprise AI orchestration platform that unifies every model, workflow, and data source into one secure environment. Whether you’re a developer, analyst, creator, or enterprise leader, Airia makes it incredibly easy to build powerful AI agents — without wrestling with multiple tools or complex integrations. Using the no-code builder, you can drag-and-drop actions, connect data, choose your LLM, and launch an agent in minutes. Then run it live, publish it, and even share it with the Airia Community, home to 2,500+ pre-built agents you can use or remix. If you want to automate workflows, prototype faster, or explore real enterprise AI use cases, Airia is the place to start. 👉 Build your first agent today: 👉 Explore the community: #Airia #AgenticAI #AIOrchestration #AIAgents #AIWorkflow #DigitalTransformationshow more

Google just wired DeepMind and Earth Engine directly into... the biggest geospatial dataset on the planet. For two decades, millions of people used Google Earth to scale the Himalayas or zoom in on their childhood neighbourhoods. In 2026, Google is basically trying to shift the entire platform toward professional execution. They turned a massive digital twin of the world into an agentic AI engine for global infrastructure. The technical foundation is (obviously) all about data. Google integrated 20-metre and 40-metre elevation contours globally. Engineers and urban planners now have instant access to the exact topographic context required for site planning anywhere on Earth. The data catalogue updates continuously to maintain the freshest imagery possible. Collaboration used to kill geospatial projects. Teams would lose momentum through stale materials or bad handoffs. Google fixed this by building frictionless data import systems. You can now drop KML, KMZ, and GeoJSON files directly onto the global map. Entire departments can align on a single source of truth, moving from a raw question to a definitive answer instantly. The biggest upgrade is the introduction of agentic geospatial intelligence. Users can open 'Ask Google Earth' and search massive satellite and Street View databases using natural language. You type a command, and the AI handles the manual data wrangling. It identifies new site locations and analyses infrastructure before you even open a spreadsheet.show more

A peanut-sized Chinese model just dethroned Gemini at reading... documents. GLM-OCR is a 0.9B parameter vision-language model. It scores 94.62 on OmniDocBench V1.5, ranking #1 overall. For context, it outperforms models 100x its size. 100% open-source. It works in two stages. 1. A layout engine detects every region in a document. 2. Each region gets read in parallel. The model predicts multiple tokens per step instead of one. That's what makes it so fast at small size. It handles things most OCR tools struggle with: > Complex tables and nested layouts > Handwritten text and stamps > Math formulas and code blocks > Mixed image-and-text documents You can run it locally through Ollama. It fits on edge devices with limited compute. Every expensive OCR API just got a free competitor.show more

A peanut-sized Chinese model just dethroned Gemini at reading... documents. GLM-OCR is a 0.9B parameter vision-language model. It scores 94.62 on OmniDocBench V1.5, ranking #1 overall. For context, it outperforms models 100x its size. 100% open-source. It works in two stages. 1. A layout engine detects every region in a document. 2. Each region gets read in parallel. The model predicts multiple tokens per step instead of one. That's what makes it so fast at small size. It handles things most OCR tools struggle with: > Complex tables and nested layouts > Handwritten text and stamps > Math formulas and code blocks > Mixed image-and-text documents You can run it locally through Ollama. It fits on edge devices with limited compute. Every expensive OCR API just got a free competitor.show more

OpenClaw, but built for normal people. Sim is an... open-source platform that lets you build AI agent workflows on a drag-and-drop canvas. Connect them to channels like Telegram and WhatsApp and deploy without writing a single line of code. They also have a built-in Copilot that generates entire workflows from plain English, which you can then tweak and customize in the UI. Key features: - Free and open-source (Apache 2.0) - Vector store integration for RAG-grounded agents - Self-host with one command (`npx simstudio`) - Run fully local with Ollama, no API keys needed - Supports vLLM for production-grade self-hosted inference The thing I really like about Sim is the level of control you get. You can add conditional branching, parallel execution, human-in-the-loop approval gates, and even nest workflows inside other workflows. Everything is visible on the canvas, so you know exactly what your agent is doing at every step. And you can build a workflow in Sim, deploy it as an MCP server, and plug it into any agent, including OpenClaw. I've shared the link to Sim's GitHub repo in the next tweet.show more

🧵 Understanding Zama; the future of privacy tech &... homomorphic encryption 1️⃣ Zama is pioneering fully homomorphic encryption (FHE). A breakthrough that lets you compute on encrypted data without decrypting it. 🔐 That means total privacy, even the system running your data can’t see it. 2️⃣ Why it matters: Right now, cloud apps, AI models, and databases must access your raw data to work. FHE changes that. your data stays private while still usable. 3️⃣ Zama builds open-source FHE tools for developers, turning advanced cryptography into practical products for AI, blockchain, and Web3. 4️⃣ Imagine: •AI that learns without reading your secrets 🤖 •Blockchain transactions with zero data leaks •Cloud apps that never see your info 5️⃣ Zama’s mission: Privacy should be the default, not an option. They’re making privacy-preserving tech simple, scalable, and open for everyone. 🔚 In a world obsessed with data, Zama might just be building the encryption layer of the future internet. 🌐show more

Fine-tune DeepSeek-OCR on your own language! (100% local) DeepSeek-OCR... is a 3B-parameter vision model that achieves 97% precision while using 10× fewer vision tokens than text-based LLMs. It handles tables, papers, and handwriting without killing your GPU or budget. Why it matters: Most vision models treat documents as massive sequences of tokens, making long-context processing expensive and slow. DeepSeek-OCR uses context optical compression to convert 2D layouts into vision tokens, enabling efficient processing of complex documents. The best part? You can easily fine-tune it for your specific use case on a single GPU. I used Unsloth to run this experiment on Persian text and saw an 88.26% improvement in character error rate. ↳ Base model: 149% character error rate (CER) ↳ Fine-tuned model: 60% CER (57% more accurate) ↳ Training time: 60 steps on a single GPU Persian was just the test case. You can swap in your own dataset for any language, document type, or specific domain you're working with. I've shared the complete guide in the next tweet - all the code, notebooks, and environment setup ready to run with a single click. Everything is 100% open-source!show more

There’s been two papers released in the past couple... months, one by Google and one by NVIDIA, that argue that ordering the documents retrieved by RAG systems can enhance performance. However, they both give two different strategies on HOW these documents should be ordered 🤔 Both papers agree on two main points: 1️⃣ There’s a fundamental issue in RAG - as more documents are retrieved, more irrelevant context (e.g., hard negatives) are introduced, which leads to confusion for the LLM and eventually degrades the quality of the generated output. This is called an inverted-U performance curve. 2️⃣ Ordering the retrieved documents is a key lever for optimizing RAG performance. Google Cloud researchers proposed ordering results based on relevance scores: The authors in this paper argue for relevance-based reordering, or ordering the retrieved chunks based on their similarity scores, so the most relevant documents are at the beginning and the end of the inputs to counter the “lost in the middle” effect. NVIDIA researchers proposed ordering results based on the original sequence of document chunks: The authors of this paper argue for Order-Preserving Reordering, or Order-Preserve RAG (OP-RAG), to maintain the logically coherent content flow of the document. So they preserved the original order of retrieved document chunks in the source text, instead of ranking them by relevance scores. So which one is right? It probably depends on the specific use case and dataset - relevance-based reordering could perform better in tasks where you need fast access to the most critical information (e.g., fact retrieval, QA systems), while order-preserving RAG might be better where you need to understand the sequential structure of information (e.g., narrative or legal documents). There are still so many uncertainties in AI - we don’t actually know what we’re doing, and it takes awhile to figure out the best strategies for most things! Excited to see more research about this.show more

Unpopular opinion: Most agent evals are theatre. You run... them once before the deployment. It'll take 800ms+ as another LLM would be judging your LLM. Most annoying part - no one tells where in the chain things went wrong. I wasted a lot of time in this loop. And then I came across Future AGI bringing 5 different tools under one umbrella, best part - the platform is completely open source. They open sourced their entire platform and the eval layer is noticeably different. It is multimodal - works on everything text, image, audio, pdf. Not an LLM-as-judge adding latency but an agent with memory and tools. The biggest win are learned classifiers trained on actual production failure patterns to run evals at low cost. It also runs across the full reasoning chain, not just the final response. Check out → Try it here →show more

New open-source agent harness just landed! I got early... access to TrueForge by TrueFoundry and have been running it locally for the past few days. The harness layer deserves as much attention as the model, and open source matters here because you can inspect the loop, run it on your own infrastructure, and swap to the latest or cheaper models. TrueForge handles the runtime work that makes an agent reliable. It drives the tool-calling loop, manages context, coordinates subagents, and executes code in a sandbox, with any model you choose. Every tool call re-sends the growing context to the model, so in practice the harness controls most of what an agent costs to run. A few things stood out from my testing and their published benchmarks. Vendor-Neutral by design. It runs OpenAI, Anthropic, and Google models alongside open-weight models like Kimi, GLM, and DeepSeek. Model routing is a setting, and you can send each task to the model that fits it. On a 14-task enterprise agent benchmark, it matched the accuracy of Claude Managed Agents running the same Opus 4.8 model at roughly 30% lower cost per run (3.8M tokens vs 10M for the same answers). Routing the same tasks to GLM-5.2 held accuracy and brought cost down by about 75%, around $3 per run instead of $12. Fully self-hosted and Open Source (MIT License). I had it running locally with one command, with sandboxed code execution working out of the box. It's time to own your agent harness. Thanks to TrueFoundry for partnering on this post.show more

Big moment for Postgres! Search has always been Postgres'... weak spot, and everyone just accepted it. If you needed a real relevance-ranked keyword search, the default answer was to spin up Elasticsearch or add Algolia and deal with the data sync headaches forever. The problem isn't that Postgres can't do text search. It can. But the built-in `ts_rank` function uses a basic term frequency algorithm that doesn't come close to what modern search engines deliver. So teams end up: - Running a separate Elasticsearch cluster just for search - Building sync pipelines that inevitably drift out of consistency - Paying for managed search services that charge per query - Accepting mediocre search relevance because "good enough" ships faster But this is actually a solvable problem. You can realistically bring industry-standard search ranking directly into Postgres, which eliminates the need for external infra entirely. This exact solution is now available with the newly open-sourced pg_textsearch by Tiger Data - Creators of TimescaleDB, a Postgres extension that brings true BM25 relevance ranking into the database. BM25 is the algorithm behind Elasticsearch, Lucene, and most modern search engines. Now it runs natively in Postgres. Here's what pg_textsearch enables: - True BM25 ranking with configurable parameters (the same algorithm powering production search systems) - Simple SQL syntax: `ORDER BY content 'search terms'` - Works with Postgres text search configurations for multiple languages - Pairs naturally with pgvector for hybrid keyword + semantic search That last point matters a lot for RAG apps. The video below shows this in action, and I worked with the team to put this together. You can now do hybrid retrieval (combining keyword matching with vector similarity) in a single database, without stitching together multiple systems. The syntax is clean enough that you can add relevance-ranked search to existing queries in minutes. pg_textsearch is fully open-source under the PostgreSQL license. You can find a link to their GitHub repo in the next tweet.show more

You're still scraping Google Flights like it's 2022. Meanwhile,... people are finding business class seats for economy prices and $200 round-trips on dates nobody thinks to check. Someone just reverse-engineered the actual Google Flights API and turned it into an MCP server for Claude. It's called Fli. No scraping. No HTML parsing. No Playwright scripts that break every time Google ships a UI change. Drop it in your Claude Desktop config and ask in plain English: >> "Non-stop business JFK to NRT next month" >> "Cheapest Fridays NYC to London in January" >> "SFO to LAX under 6 hours, United or Delta only" Two tools do the work: → search_flights: filter by cabin, airlines, stops, time windows → search_dates: scan a date range for the cheapest days to fly Wildest part: it's also a Python library and a CLI. Build price trackers, pipe results into pandas, or just run `fli flights JFK LHR 2026-10-25` from your terminal. Everyone's been waiting for someone to crack Google Flights without the scraping tax. 100% open source. MIT licensed. (Link in the comments)show more

Goldman pays $27,000 per seat for a Bloomberg Terminal.... I found 10 open source tools on GitHub that replicate almost all of it for free. Retail investors have never had this much firepower. Bookmark & Repost this one: 1. OpenBB Stocks, options, crypto, forex, and macro data in one research platform. Build your own dashboards, reports, and AI analysts on top of it. The OG of open source finance. 50K+ stars. 2. FinceptTerminal A full financial terminal: global market data, advanced charts, economic indicators, portfolio analysis, and AI research tools. Windows, Mac, and Linux. 3. Neuberg 516 drag-and-drop panels covering equities, bonds, commodities, currencies, credit, and macro. Even connects to Alpaca, Hyperliquid, and Polymarket so you can trade from the terminal itself. 4. Qlib (by Microsoft) An open source AI platform for quant investing. Train ML models, discover signals, backtest strategies, and build portfolios with the same workflow a quant desk uses. 5. FinRobot An AI equity research team on your laptop. Its agents read financial statements, build DCF valuations, debate bull vs bear cases, and generate full investment reports. 6. EdgarTools Turns the SEC database into something humans can actually use. Pull 10-Ks, 10-Qs, insider trades, executive pay, and hedge fund holdings going back to 1994. 7. LEAN (by QuantConnect) An institutional-grade engine for trading algorithms. Write strategies in Python or C#, backtest on decades of data, then connect to real brokers and go live. 8. FinanceToolkit 200+ financial ratios, valuation models, risk metrics, and economic indicators. Works on stocks, ETFs, options, currencies, commodities, and crypto from Python. 9. Ghostfolio A private wealth dashboard for stocks, ETFs, and crypto across all your accounts. Performance, allocation, diversification. Your data never leaves your machine. 10. OpenTerminalUI A self-hosted trading terminal: pro charts, screeners, options chains with live Greeks, portfolio optimization, backtesting, and an AI research agent. Runs entirely on your own hardware. Bloomberg spent 40 years building a $27,000/year moat. Open source is draining it one repo at a time. The software is free. Some live data feeds need your own API keys, but the barrier is now effort, not money. If you want the exact workflows we use to stack these tools with AI, join the AIBullss Discord:show more

Its not every day you wake up to find... that the Pope has made your lifes work the central focus of his papacy: “Disarming AI means freeing it from the mentality of “armed” competition [..] This entails a race for ever more powerful algorithms and larger datasets, driven by the desire to secure geopolitical or commercial dominance." - POPE LEO XIV, May 2026 Here, “disarmed” means “neutralised” in the sense that this should not be a differentiator The Innovation Game (TIG) was created to keep data and algorithms open, in order to prevent monopolistic control It's not just an aspiration, it's an economic mechanism that makes open data and open algorithms the rational economic choice • All algorithms are published openly by TIG • If you are willing to make the data you process with an algorithm open, you can use it free-of-charge • Alternatively, if you would like to keep this data private, there is a fee to pay for using the algorithm • All fees are used to fund more open innovation Its an elegant, global, self-reinforcing engine The logical end point of monopoly is that innovation stops We cannot allow that to happen Pope Leo XIV I would be grateful for your thoughts on The Innovation Gameshow more

China open-sourced a peanut-sized OCR that parses entire 100-page... PDFs in one shot.. It's called Unlimited-OCR. Only 3B params. Runs locally. Every other OCR tool chops your doc into pages and loses the thread. this one reads the whole thing in a single pass. → One-shot "long-horizon" parsing (32K context window) → Multilingual, out of the box → 93% on the standard parsing benchmark (+6 over baseline) → <0.11 error rate past 40 pages → Runs 100% locally on your own hardware → Works with Transformers, vLLM, SGLang, Docker, Ollama, llama.cpp Traditional cloud OCR (Textract, Google Vision, Azure Doc Intelligence) costs $1.50–$15 per 1,000 pages. This runs on your machine. For free. Forever. Baidu built it explicitly to push DeepSeek-OCR one step further. Already at 1.9M downloads on Hugging Face and most people have no idea it exists yet. 100% open source.show more

This new skill for Hermes Agent wipes your personal... data off hundreds of broker sites for free, hands-off. It's called Unbroker. I’ve been testing it this week and it's incredible. Here is the full setup: 1. Install it by typing: hermes skills install official/security/unbroker 2. Connect browser automation: Wire up Browserbase so the agent can drive real broker opt-out forms. 3. Do the intake: Give consent, then feed it your info. 4. Fire one prompt: "Use the unbroker skill to remove my data from data brokers. Here is my consent. Run it hands-off." Hundreds of data brokers publish your name, addresses, phone, email, even your relatives. Anyone can find where you live in about ten seconds. The law says brokers have to delete your data if you ask. There's just no easy bulk button for it. Services charge $100’s a year to file the exact requests you could submit yourself for free. Unbroker does the same thing locally, and it's free. It fans out sub-agents, scans every broker site, drafts or sends opt-out emails, and only comes back to you for the ones that need a human. The best part is it loops. Brokers re-list you over time, so it schedules rechecks and re-files on its own. Set it once, it keeps working. One skill, one prompt, dozens of broker sites handled.show more

🚨 NOW YOU RUN A COMPANY WITH ZERO EMPLOYEES... Paperclip is a 100% open-source framework (70k+ stars) that makes this possible. Rather than just prompting a model, you hire a CEO, engineers, and a QA reviewer. Every worker is an AI agent, and Paperclip is the Node.js and React control plane that keeps them aligned. Stop chaining messy scripts together and build a living organization: → Stand up a CEO agent to set strategy → Hire engineers and designers via Claude or Codex → Build in an automated QA loop before any ticket closes → Manage the entire portfolio from your phone When an agent slips, you do not rewrite your whole pipeline: you just correct its persona prompt, exactly like coaching a junior hire. It is exactly the kind of tooling the space needs right now. Free, open-source, and self-hosted. Repo link in 🧵↓show more