Introducing /agent by Firecrawl 🪄 Just describe what you need - with or without a URL then /agent searches, navigates, and gathers information from the widest range of websites, reaching data no other API can. Try out the research preview today.

It accomplishes in minutes what would take you hours or days of manual work. Think of it as deep research for datasets. Whether you need one data point or thousands, /agent handles it. Our research preview is live here:

Let’s gooooo!!!

incapsula we need more intense bot protection incapsula do you hear me

@ycombinator my attention span just got a promotion

Let’s go, team!🔥

big! gj guys

This is what APIs needed. The browser automation layer that doesn't break on every site redesign. Will be useful for RAG and agentic workflows that need real-time web context.

this would've been helpful for the era of scraping yeezys back in 2016 😂

Could I use this agent and tie it into my own app for the research part?

Is it able to catch informartion in pdf/images too?

This is a great product and it did successfully do a job for me. Buton the second job it got blocked by captcha. Are you looking into solving that?

@3ab3azz @marwantosolveX ممكن نحتاجه؟

how does it work when the region blocks too much?

It works, I was able to get info on yc companies.

its not even been 5 minutes all these urls

I love this service

Perfect timing for this! Excited to see the dedication this team has to advanced crawling. To see an amazing @firecrawl use case in action for ad creation, check out

Can you create an app in chat gpt

Have API?

Curious if this handles recursive or infinite pagination on its own yet. if i'm scanning deep directories where the sub-selectors change per depth, can the agent dynamically map the path or does it need a nudge?

This is awesome. It's like chatgpt tasks but now you can connect it to your own code and run it whenever you want.

I love the music!

real web unlock vibes, feels like cheating bro

brilliant launch Firecrawl! making your UX agentic is a power move trying right away let's launch/spotlight you on if up to btw

Nice ✨

Bro I just want to gather some sports parlay data from a specific bookie 😭 I forgot what happened last time but it did not work 🤔will try again this night

Whats the nature of the agentic capabilities, can it fill forms or do complex actions on a page in order to retrieve data? Like on a scale between a markdown generator and a fully autonomous web agent, where does FireCrawl Agent fit?

incredible work. looking forward to try it 🤩

The schema definition is the key part. Turns “scrape this site” into “get me this exact structure.”

ca?

Dope feature 👏🏻

Yo this is actually crazy, nice work

Okay this is great..