Loading video...

Video Failed to Load

Go Home

Introducing Firecrawl Developer Index, an index for supercharging coding agents. Search 70M+ primary sources including repos, docs, & issues with the highest recall of any coding-specific index. Ensure agents ship correct, up-to-date code every time!

259,750 views • 1 month ago •via X (Twitter)

34 Comments

Firecrawl's profile picture
Firecrawl1 month ago

Why a coding-specific index? Your agents can answer their own questions about code behavior, API contracts, error messages, & known bugs from the correct primary sources. That means issues, merged PRs, & READMEs from the most popular public repos & docs sites.

Firecrawl's profile picture
Firecrawl1 month ago

Our Developer Index hits 63% recall@10 across 1,179 real developer queries spanning repos, docs, and PRs. That beats the next best external provider by ~10%.

Firecrawl's profile picture
Firecrawl1 month ago

Ready to try it out? For best performance we recommend using the Firecrawl CLI or MCP with the companion skill, which you can install with: npx -y firecrawl-cli@latest setup developer-index

Firecrawl's profile picture
Firecrawl1 month ago

Also you can run the benchmark yourself from the repo! Let us know if you'd like to be included! Note: Our benchmark ships with half the queries, and we hold out the rest so nobody can train on the test.

Richard Oliver Bray's profile picture
Richard Oliver Bray1 month ago

I've been messing around with this internally for a bit. Glad everyone else can see how awesome it is.

Bob Tong's profile picture
Bob Tong1 month ago

this is the 3rd specialized index they've shipped this cycle, research index for arxiv, now this. reads less like a random feature drop and more like firecrawl building a set of domain-specific verticals on top of the general crawler, which is the smarter move than one giant undifferentiated index

Arsh - 16 y/o builder's profile picture
Arsh - 16 y/o builder1 month ago

Wish my agents could make videos like that

Eric Ciarla (hiring)'s profile picture
Eric Ciarla (hiring)1 month ago

My agents are going to love this!

Josh's profile picture
Josh1 month ago

How does it compare to context 7?

Charlie Schwartz's profile picture
Charlie Schwartz1 month ago

All curation grows until it requires search, and all search grows until it requires curation

Yousuf K.'s profile picture
Yousuf K.1 month ago

This is very useful. Agents are going to love this. Way better than guessing from stale docs page 🔥

Epoch News's profile picture
Epoch News1 month ago

coding agents didn’t need another wrapper, they needed fresh primary sources and a benchmark that proves retrieval actually works. 63% recall@10 got our attention

Mr. Reach's profile picture
Mr. Reach1 month ago

Wanted to build this for sooooo long Thanks!

Stephen Drew's profile picture
Stephen Drew1 month ago

Firecrawl is on its way to do everything and everything so cool

Sobhan's profile picture
Sobhan1 month ago

Ouuuu

Native Port's profile picture
Native Port1 month ago

Recall@10 is useful, but daily refresh creates a moving target. Does DevDex pin each provider's index state and query timestamp so a rerun separates ranking quality from corpus freshness?

SEO Mastery's profile picture
SEO Mastery1 month ago

70M sources is actually huge

Wulan Oktarina's profile picture
Wulan Oktarina1 month ago

Amazing web

Abdessalem Sadi's profile picture
Abdessalem Sadi1 month ago

We need b2b buying intent tracking @firecrawl

Nash | Second Mind's profile picture
Nash | Second Mind1 month ago

Better retrieval makes applicability more consequential. A coding agent can surface a README, merged PR, open issue, and versioned docs for the same behavior. Every source can be authentic and still describe a different version, state, or scope. The harness still has to bind that evidence to the task: what applies to this repo state, what has been superseded, and how conflicting sources should affect the change. Recall gets the right evidence into view. Correctness still depends on deciding what actually applies.

Mark Mercer's profile picture
Mark Mercer1 month ago

Can't stop. Won't stop.

Rimas's profile picture
Rimas1 month ago

highest recall measured against what. is there a public eval for this or internal numbers only

ShadowAguy's profile picture
ShadowAguy1 month ago

i'm sure it can find 70m sources and still pick the first outdated readme.

Native Port's profile picture
Native Port1 month ago

Recall@10 is useful, but daily refresh creates a moving target. Does DevDex pin each provider's index state and query timestamp so a rerun separates ranking quality from corpus freshness?

Default Settlement's profile picture
Default Settlement1 month ago

This removes a major failure mode: coding against stale internal knowledge. But retrieval improves the evidence available to an agent; it does not prove the resulting code is correct. A production run should bind the repository commit, documentation versions, retrieved sources, generated patch and test results into one verifiable record. Fresh sources help an agent write better code. Execution receipts prove what it actually changed and whether the declared checks passed.

AI Mastery Guide's profile picture
AI Mastery Guide1 month ago

70 million sources indexed, huge

Nick's profile picture
Nick1 month ago

how much of the 70m is issues versus repo code

Sigh's profile picture
Sigh1 month ago

Ouuu

Maya Collins's profile picture
Maya Collins1 month ago

7OM+ sources with highest recall? That's impressive, but can it really keep agents from shipping outdated code?

Sebastian Buzdugan's profile picture
Sebastian Buzdugan1 month ago

high recall helps, but version-aware ranking matters more when deprecated docs outrank current apis

Intern-n1's profile picture
Intern-n11 month ago

cool vid!

Keshaw Singh's profile picture
Keshaw Singh1 month ago

Love those art direction

WAi XeA's profile picture
WAi XeA1 month ago

Recall is the easy half. The hard half is that half of those 70M sources contradict each other and the index has no idea which repo's README is three breaking changes stale.

Omar Alenezi's profile picture
Omar Alenezi1 month ago

It would be so good for the tool to include reddit, x, discord, stack overflow, etc.

Related Videos