Loading video...

Video Failed to Load

Go Home

introducing XERJ Corpus Hub, reference memory for AI agents. give your agent a corpus for your task. watch it become superintelligent. > finds the answers in indexed expert knowledge > applies them to your code, research, and projects > works with any model. free and OSS forever/Apache 2 install...

70,444 views • 1 day ago •via X (Twitter)

66 Comments

Ivan Novikov's profile picture
Ivan Novikov1 day ago

we believe the future belongs to specialized models. XERJ now allows any LLM to be specialized with public reference memory Corpus Hub, without retraining. Now even small models can compete with frontiers having cloned repos and external memory as a cheat-sheets.

Ivan Novikov's profile picture
Ivan Novikov1 day ago

your agent shouldn’t have to rediscover the same knowledge on every task. you can see how it works in the video. today, when an agent needs information, it uses legacy search based on grep, released back in 1974. it reads through files, spending time and tokens looking for answers. along the way, it may also encounter confidential information in files it can access. Xerj is an open-source search engine built for agents. it indexes the files in advance and returns the relevant passages when your agent needs them. the same model becomes: • 10× faster • 20× cheaper • more accurate

Ivan Novikov's profile picture
Ivan Novikov1 day ago

agentic search is everywhere. coding: find the exact definition in a codebase the model has never seen. law: find the right clause across 418 UK acts. the challenge: navigating thousands of files and 21,000 sections. this demo shows how indexed knowledge gets your agent to the exact answer while it would otherwise still be searching.

Ivan Novikov's profile picture
Ivan Novikov1 day ago

we love how this demo shows what the right knowledge reference adds to product development. 2× faster. 3× cheaper for the same or even better quality, especially for non tier-1 models

Ivan Novikov's profile picture
Ivan Novikov1 day ago

give your agent the knowledge it needs. pick a ready-made corpus or build one from your own projects. free. open source. works with any model. get started →

Santiago's profile picture
Santiago1 day ago

Does this work with anything other than codex and Claude? Can I use it with any agent?

Ivan Novikov's profile picture
Ivan Novikov1 day ago

yes, it’s model-agnostic. any agent that can call Xerj’s search tools can use the same corpora, not just Codex or Claude. your data stays with you, and you can keep using the same corpora when you switch models or agents.

elvis's profile picture
elvis1 day ago

Context engineering is mostly a retrieval problem now. Tools that help agents quickly find the right knowledge will matter a lot.

Ivan Novikov's profile picture
Ivan Novikov1 day ago

agreed. getting the right passage into context matters more than dumping another thousand pages into it

AI StackLab's profile picture
AI StackLab1 day ago

Honestly, better retrieval can solve more problems than people think.

Ivan Novikov's profile picture
Ivan Novikov1 day ago

I can NOT agree MORE! And this is not only about retrieval itself, and how much tokens you burn for that. This is also about raw data->AI data transformation where complex structures like code/AST or relations knowledge like legal case->law became structural for AI, not plain text, not vectors.

Z-Coder's profile picture
Z-Coder1 day ago

This looks like a tool worth exploring for my own projects. Excited to see what people build with it, and congratulations on the launch!

Ivan Novikov's profile picture
Ivan Novikov1 day ago

thank you! curious what you'd try it on first

Farlane's profile picture
Farlane1 day ago

The interesting part is giving agents access to the right knowledge, not just a more capable model. Better context means less time searching through sources and more time actually solving the problem.

Ivan Novikov's profile picture
Ivan Novikov1 day ago

you nailed it. a lot of “thinking” is really just figuring out where to look.

RAVI KUMAR SAHU's profile picture
RAVI KUMAR SAHU1 day ago

Giving AI agents access to indexed expert knowledge could make them far more capable and useful.

Ivan Novikov's profile picture
Ivan Novikov1 day ago

working examples make a huge difference. give it something good to learn from

Elise Tech Ai's profile picture
Elise Tech Ai1 day ago

Nice launch, reference memory for agents is a powerful idea

Rony's profile picture
Rony1 day ago

making expert knowledge accessible to any model is a big plus

Ivan Novikov's profile picture
Ivan Novikov1 day ago

and you can keep the knowledge when you switch models

Jaynit Makwana's profile picture
Jaynit Makwana1 day ago

how often does the index update when the codebase changes?

Ivan Novikov's profile picture
Ivan Novikov1 day ago

incrementally, check this --watch flag we did it right

Juan's profile picture
Juan1 day ago

Memory for AI agents? I’m in man

Ivan Novikov's profile picture
Ivan Novikov1 day ago

that what we do

Boardy's profile picture
Boardy1 day ago

half of this is just pointing your agent at docs

Ivan Novikov's profile picture
Ivan Novikov1 day ago

yes, the questions is how much tokens you will waste for 1000 docs :) and how much time

Boardy's profile picture
Boardy1 day ago

nah that part is actually your problem to solve

Ivan Novikov's profile picture
Ivan Novikov1 day ago

not only, imagine you have structured data like legal docs with relations to laws. Or code with cross-references where you need to parse it to AST. XERJ autoindex it and agents knows HOW it's possible to search for such things. All with no tokens at all

Boardy's profile picture
Boardy1 day ago

no no i'll give you that one tokens are the only part of the brain anyone uses rn

Dipti Sharma's profile picture
Dipti Sharma1 day ago

You’ve got a solid idea here, especially for teams building agents around their own data.

Ivan Novikov's profile picture
Ivan Novikov1 day ago

which is every team in fact

Markandey Sharma's profile picture
Markandey Sharma1 day ago

Open source makes this even more interesting.

Ivan Novikov's profile picture
Ivan Novikov1 day ago

yes

fleyta's profile picture
fleyta1 day ago

beats my rag setups, connecting any model is pure win

Ivan Novikov's profile picture
Ivan Novikov1 day ago

curious what you tested it on — what was your previous setup?

Noam Naumovsky's profile picture
Noam Naumovsky1 day ago

small model + good reference memory is how I'd want to run cheap agents. one question before I index my logs: does anything from my local corpus go up to or does the hub only send knowledge down?

Ivan Novikov's profile picture
Ivan Novikov1 day ago

no Indexing and search run locally - nothing from it is uploaded to Corpus Hub.

Parul Gautam's profile picture
Parul Gautam1 day ago

Specialized knowledge without retraining. XERJ is onto something!

Ivan Novikov's profile picture
Ivan Novikov1 day ago

exactly. the knowledge is already out there - your agent just needs access to it

Andrei Shemet's profile picture
Andrei Shemet1 day ago

My team has been using xerj for two weeks now. It really changes everything.

Ivan Novikov's profile picture
Ivan Novikov1 day ago

your corpus is really interesting, thanks for that

Vipin Gautam (Viipin I Gautam)'s profile picture
Vipin Gautam (Viipin I Gautam)1 day ago

You’ve got a solid idea here, especially for teams building agents around their own data.

Ivan Novikov's profile picture
Ivan Novikov1 day ago

exactly. your own code, docs, and past decisions are often the most useful context you can give it.

Alex's profile picture
Alex1 day ago

Thanks! Will test

Ivan Novikov's profile picture
Ivan Novikov1 day ago

share your feedback pls

Utkarsh Sharma's profile picture
Utkarsh Sharma1 day ago

This could save developers a lot of time searching through documentation.

Ivan Novikov's profile picture
Ivan Novikov1 day ago

@techxutkarsh and save the agent from reading the same docs over and over 😅

Raja Chichulkar's profile picture
Raja Chichulkar1 day ago

Giving AI agents access to structured, expert knowledge can make them far more useful.

Ivan Novikov's profile picture
Ivan Novikov1 day ago

especially knowledge specific to the task. “everything about coding” is a lot less useful than a good reference for what you're building

liam.'s profile picture
liam.1 day ago

this actually makes a lot of sense for agents

Ivan Novikov's profile picture
Ivan Novikov1 day ago

yeah, having them rediscover the docs on every task never made much sense to me

Theinfralab's profile picture
Theinfralab1 day ago

External memory could make smaller models much more capable.

Ivan Novikov's profile picture
Ivan Novikov1 day ago

rfight indexed knowledge is a next step to agi

Cherry's profile picture
Cherry1 day ago

this makes AI agents a lot more useful.

Ivan Novikov's profile picture
Ivan Novikov1 day ago

and cheap

Dhaval Makwana's profile picture
Dhaval Makwana1 day ago

curious how much this cuts repeated token usage on bigger repos.

Ivan Novikov's profile picture
Ivan Novikov1 day ago

up to 70% of output tokens

Alice The Ai Expert's profile picture
Alice The Ai Expert1 day ago

This is brilliant giving any agent superintelligent reference memory with indexed expert knowledge in one prompt is a game changer!

Ivan Novikov's profile picture
Ivan Novikov1 day ago

would love to see what you try it on!

AI Club's profile picture
AI Club1 day ago

I’m looking forward to testing this out in my own projects. Congrats on the launch excited to see where this goes!

Ivan Novikov's profile picture
Ivan Novikov1 day ago

thx

Astreus N's profile picture
Astreus N1 day ago

Reference memory is the missing layer — most agents recompute context they already had. How do you handle invalidation when the underlying corpus changes?

Amit's profile picture
Amit1 day ago

this is the kind of tool i want to experiment with on my own projects. huge congrats on the launch!

Ivan Novikov's profile picture
Ivan Novikov1 day ago

thanks, not the last launch at all, again, it is all OSS Apache 2, free forever for everyone

Aaliya's profile picture
Aaliya1 day ago

Keeping project notes and docs in one place sounds useful.

Ivan Novikov's profile picture
Ivan Novikov1 day ago

you also need an index search for it

Related Videos

HERMES AGENT CAN SHARE MEMORY WITH CODEX AND CLAUDE CODE THROUGH HINDSIGHT. ONE MEMORY BANK. ONE AGENT REMEMBERS, EVERY OTHER AGENT KNOWS. the problem: you use Hermes for orchestration. Codex for coding. Claude Code for debugging. each has its own memory. switch between them and you explain the same project three times. Hindsight fixes this. one shared memory bank that every agent reads and writes to. tell Codex: "the test color for this project is purple." switch to Hermes. ask: "what test color did I pick?" Hermes answers: "purple." no copy-paste. no re-explaining. instant recall. HOW IT WORKS: Hindsight runs as a Docker container on your machine. self-hosted. your data stays local. an LLM powers the memory processing (retain, recall, reflect). RETAIN: extracts facts from your conversations. entities, decisions, preferences, project context. saved to the memory bank automatically. RECALL: when you ask a question, Hindsight pulls from semantic search, keywords, graph connections, and temporal data. fused into one answer. REFLECT: deeper reasoning layer. connects memories across sessions. identifies patterns in your work. produces observations that get smarter over time. CONNECT TO HERMES: Desktop app: Settings → Memory and Context → switch provider from Namosin to Hindsight. set API URL to your local Docker container. set bank ID. done. CLI: hermes memory setup → select Hindsight. verify: hermes memory status should show: provider: hindsight, installed, available. CONNECT TO CODEX: npx hindsight-coding-agents install codex \ --self-hosted --server this installs lifecycle hooks: initialize memory on session start. recall context during work. retain the session when done. enable hooks in Codex: Settings → Hooks → trust all three. CONNECT TO CLAUDE CODE (same command): npx hindsight-coding-agents install all "all" connects every detected agent on your machine. Claude Code, Codex, Cursor, and others. one command. every agent shares the same bank. TAGS FOR FILTERING: every memory gets tagged by harness (Hermes, Codex, Claude Code) and optionally by project name. in the Hindsight control plane: filter by harness. see only Hermes memories. or only Codex memories. or search across everything. soft partitions inside one bank. not hard walls. cross-reference when you need to. ONE BANK OR MANY: one global bank: solo dev, related projects. all agents share everything. patterns emerge across projects. per-project banks: unrelated codebases. each project gets its own memory. no cross-contamination. your call. start with one. split when projects diverge. KNOWLEDGE PAGES (v0.9.0): Hindsight auto-generates living summaries from your accumulated memories. components, concepts, conventions, decisions. not static docs. projected from real agent conversations. auto-refresh as new memories land. WHAT TO KNOW: self-hosted via Docker. your data never leaves your machine. backup system built in (admin CLI + scheduled exports). works with any LLM (local Ollama, OpenAI, Codex subscription). memory defense: redact or block sensitive content automatically. 33,000+ memories accumulated in ~10 days of normal use.

YanXbt

29,658 views • 1 month ago