Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Reworkd is your scraping co-pilot. It understands website structures and auto-generates Playwright code to take actions, visit subpages, scrape, and save data based on your custom schema. With Reworkd you can simplify web data extraction at scale.

Y Combinator

1,603,360 subscribers

63,738 views • 1 year ago •via X (Twitter)

Education Finance Science & Technology

Anya Rossi• Live Now

Private livecam show

11 Comments

anirudh1 year ago

@ReworkdAI stagehand can help when your playwright code breaks!

HUDI2 years ago

🚀🌍Transform your online footprint with #IPDW - a groundbreaking protocol that decentralizes your data storage & exchange. Inspired by BitTorrent, we're creating a new era of data sovereignty with #HUDI. 🛡️ Secure, encrypted, and fully in your control, our P2P technology integrates seamlessly into your browser, making every user a vital node in our expansive Web 4.0 network. Ready to reclaim your digital power? Dive into the revolution at and discover the backbone tech at #DecentralizeYourData #Web4

Artypone1 year ago

@ReworkdAI What a disappointment for the investments after MCP. You can do it by developing your own scraptool in 10 mins and keep your scrapped data in privately. There like 10 opensource projects. Would you like me to share github links?

Israr Ahmed1 year ago

@ReworkdAI Scaling web data extraction is revolutionary. At @qryptum, we’re building decentralized AI and data solutions. What are your thoughts on how Reworkd could integrate with decentralized data sources?

vito1 year ago

@ReworkdAI cool! just what i was looking for.

Steph from OpenVC1 year ago

@ReworkdAI This is awesome!

Raiders1 year ago

@ReworkdAI Can we scrape twitter posts too? I doubt

Ashish1 year ago

This is useless, even for simple single page websites. I tried scrapping 2 very simple web pages, and it failed miserably. Now think of all varying complexities with different sites(captchas, geolocation, sessions), it does not stand a chance. If it is only good for basic sites, it is too costly. I can get that done on chatgpt subscription.

Tyler Clark1 year ago

@ReworkdAI @firecrawl_dev 4 life! 🔥

Vinnie 🌳1 year ago

@ReworkdAI 🌿 ReworkdAI could be a game-changer for eco-data projects! Let's see it simplify nature-data extraction! 🚀 #EcoData

Lantos (e/acc)1 year ago

@ReworkdAI @talos256

Related Videos

Thunderbit is probably the most powerful web scraper right now. It can scrape any website in just 2 clicks, no code, no setup. It’s smart enough to understand complex page layouts and nested structures. Normally, scraping this kind of data manually takes hours of tedious copy-paste work. With Thunderbit, you click twice, and it auto-builds the table for you, scraping in seconds. More details and examples below 👇 #Thunderbit #WebScraping #AITools #BlackFridayDeals

Thunderbit is probably the most powerful web scraper right now. It can scrape any website in just 2 clicks, no code, no setup. It’s smart enough to understand complex page layouts and nested structures. Normally, scraping this kind of data manually takes hours of tedious copy-paste work. With Thunderbit, you click twice, and it auto-builds the table for you, scraping in seconds. More details and examples below 👇 #Thunderbit #WebScraping #AITools #BlackFridayDeals

AshutoshShrivastava

17,809 views • 6 months ago

Excited to more broadly share what we've been working on at Reworkd ⚡️ This past year we've fully invested in building the next generation of web agents. They're already live in production today across a handful of companies serving as the simplest way to extract web data at scale. Come to us with a list of 100s-1000s of websites + a data schema, and we'll handle the rest 🤖

Excited to more broadly share what we've been working on at Reworkd ⚡️ This past year we've fully invested in building the next generation of web agents. They're already live in production today across a handful of companies serving as the simplest way to extract web data at scale. Come to us with a list of 100s-1000s of websites + a data schema, and we'll handle the rest 🤖

asim

94,412 views • 1 year ago

You can now scrape any website with AI in two clicks. Thunderbit is a zero-setup web scraper that extracts data from any site instantly, it even allows you subpage scraping. Here’s how to try free:

You can now scrape any website with AI in two clicks. Thunderbit is a zero-setup web scraper that extracts data from any site instantly, it even allows you subpage scraping. Here’s how to try free:

Alvaro Cintas

27,254 views • 6 months ago

You can now clone any website just by writing a prompt. Simply add the Firecrawl MCP server to your favorite AI coding tool for improved web data extraction, and let Claude code it for you. Here’s how:

You can now clone any website just by writing a prompt. Simply add the Firecrawl MCP server to your favorite AI coding tool for improved web data extraction, and let Claude code it for you. Here’s how:

Alvaro Cintas

83,022 views • 10 months ago

You can now clone any website just by writing a prompt. Simply add the new Firecrawl MCP server to your favorite AI coding tool for improved web data extraction, and let Claude code it for you. Here’s how:

You can now clone any website just by writing a prompt. Simply add the new Firecrawl MCP server to your favorite AI coding tool for improved web data extraction, and let Claude code it for you. Here’s how:

Alvaro Cintas

539,548 views • 1 year ago

DarkWeb Scraping DeepWebHarvester is a powerful tool designed to scrape onion sites on the dark web, enabling comprehensive crawling and extraction of valuable data. – A demo that illustrates how I extract data from an onion site ethically using the tool: #Cybersecurity

DarkWeb Scraping DeepWebHarvester is a powerful tool designed to scrape onion sites on the dark web, enabling comprehensive crawling and extraction of valuable data. – A demo that illustrates how I extract data from an onion site ethically using the tool: #Cybersecurity

Tech Enthusiast

18,787 views • 10 months ago

Web scraping is a critical skill, and yet nobody talks about it. How do you think companies are training their Large Language Models? Where do you think the data comes from? But web scraping goes beyond all of that. Imagine giving an AI agent access to any public online data in real time! I like to call this "web-scrapping on demand", and I'm pretty sure it's going to unlock unlimited power for AI applications. I recorded a quick video to show you how you can do this using Apify. I've talked about them before, and they are collaborating with me on this post. They have one of the best open-source web scraping and browser automation libraries out there: But it gets much better than this! You can use MCP to connect your AI Agents and applications to the Apify platform and use any specialized actor on demand to scrape and process online data. In the video, I used Cursor to scrape LinkedIn posts with the words "Machine Learning" in real time. Worked like a charm with no code needed! Here is a link to the platform: Think about this: You can now feed your AI applications with any public data on demand! We aren't ready for what's coming.

Web scraping is a critical skill, and yet nobody talks about it. How do you think companies are training their Large Language Models? Where do you think the data comes from? But web scraping goes beyond all of that. Imagine giving an AI agent access to any public online data in real time! I like to call this "web-scrapping on demand", and I'm pretty sure it's going to unlock unlimited power for AI applications. I recorded a quick video to show you how you can do this using Apify. I've talked about them before, and they are collaborating with me on this post. They have one of the best open-source web scraping and browser automation libraries out there: But it gets much better than this! You can use MCP to connect your AI Agents and applications to the Apify platform and use any specialized actor on demand to scrape and process online data. In the video, I used Cursor to scrape LinkedIn posts with the words "Machine Learning" in real time. Worked like a charm with no code needed! Here is a link to the platform: Think about this: You can now feed your AI applications with any public data on demand! We aren't ready for what's coming.

Santiago

101,310 views • 10 months ago

OpenClaw can now scrape websites without getting blocked. With the Scrapling plugin, your AI agent can crawl the web and collect data automatically.

OpenClaw can now scrape websites without getting blocked. With the Scrapling plugin, your AI agent can crawl the web and collect data automatically.

Julian Goldie SEO

23,619 views • 3 months ago

The Firecrawl plugin is now available through Anthropic's official marketplace 🔌 1. Run /plugin 2. Install Firecrawl 3. Ask Claude to fetch the web data you need Scrape and extract data from any website, directly inside Claude Code!

The Firecrawl plugin is now available through Anthropic's official marketplace 🔌 1. Run /plugin 2. Install Firecrawl 3. Ask Claude to fetch the web data you need Scrape and extract data from any website, directly inside Claude Code!

Firecrawl

91,321 views • 4 months ago

Olive (Olive) is the best way to build internal tools with natural language. It connects to your database, understands your schema, and generates functional tools in minutes. Congrats on the launch, Bardia Safari and Shrey Gupta!

Olive (Olive) is the best way to build internal tools with natural language. It connects to your database, understands your schema, and generates functional tools in minutes. Congrats on the launch, Bardia Safari and Shrey Gupta!

Y Combinator

46,069 views • 1 year ago

Excited to introduce DeepSeek R1 fine-tuning with Firecrawl 🔥 Learn how to fine-tune DeepSeek's R1 model on custom instruction datasets generated by Firecrawl's web data extraction. Train your own AI expert to answer domain-specific questions about your website!

Excited to introduce DeepSeek R1 fine-tuning with Firecrawl 🔥 Learn how to fine-tune DeepSeek's R1 model on custom instruction datasets generated by Firecrawl's web data extraction. Train your own AI expert to answer domain-specific questions about your website!

Eric Ciarla (hiring)

40,189 views • 1 year ago

🌊TrellisInsights (YC W24) makes unstructured data SQL-ready. It extracts and transforms your unstructured data to SQL-compliant tables with schema you define with natural language. Congrats on the launch, Mac Klinkachorn and Jacky Lin!

🌊TrellisInsights (YC W24) makes unstructured data SQL-ready. It extracts and transforms your unstructured data to SQL-compliant tables with schema you define with natural language. Congrats on the launch, Mac Klinkachorn and Jacky Lin!

Y Combinator

14,213 views • 2 years ago

Wow AI is your one-stop shop for everything AI data training: 1️⃣ OTS Dataset 2️⃣ Custom Data Collection 3️⃣ Labeling 4️⃣ Crowdsourcing With Wow AI, you can be confident that your AI training data is of the highest quality, ethical, and compliant. Visit us 👉

Wow AI is your one-stop shop for everything AI data training: 1️⃣ OTS Dataset 2️⃣ Custom Data Collection 3️⃣ Labeling 4️⃣ Crowdsourcing With Wow AI, you can be confident that your AI training data is of the highest quality, ethical, and compliant. Visit us 👉

Wow AI

51,869 views • 2 years ago

Here's how I would learn data engineering basics in 2025: - Find a data source you care about (examples: gaming APIs, stock market, web scraping, etc) - Use Python to interact and ingest your source. Initially just write the data to a CSV. - Setup an account with Snowflake or Google BigQuery. - update your Python script to load a table in Snowflake/BigQuery - schedule your script with CRON in the cloud with a service like Heroku. - build aggregations and visualizations on top of your ingested data Only thing this misses is data quality and complex job orchestration which you can learn later! How would you learn data engineering nowadays?

Here's how I would learn data engineering basics in 2025: - Find a data source you care about (examples: gaming APIs, stock market, web scraping, etc) - Use Python to interact and ingest your source. Initially just write the data to a CSV. - Setup an account with Snowflake or Google BigQuery. - update your Python script to load a table in Snowflake/BigQuery - schedule your script with CRON in the cloud with a service like Heroku. - build aggregations and visualizations on top of your ingested data Only thing this misses is data quality and complex job orchestration which you can learn later! How would you learn data engineering nowadays?

Zach Wilson

20,363 views • 11 months ago

Build your own Gen AI Agents with Salesforce’s new Agentforce platform—anyone can create, test, and scale custom Gen AI Agents using our unique Einstein1 low-code platform—deeply integrated with our Einstein1 platform. The future of AI Agent and App Dev is in your hands! With Agentforce, your custom AI agents: - Achieve greater accuracy by securely grounding in all your enterprise data with Data Cloud - Take action seamlessly by leveraging Flow automations - Connect effortlessly to your enterprise APIs through MuleSoft - Test with confidence in Sandboxes before deployment - Use in your apps, web, social, and Slack. Humans with AI drive customer success, together. Now everyone is an Einstein. More to come at Dreamforce 2024! 💙

Build your own Gen AI Agents with Salesforce’s new Agentforce platform—anyone can create, test, and scale custom Gen AI Agents using our unique Einstein1 low-code platform—deeply integrated with our Einstein1 platform. The future of AI Agent and App Dev is in your hands! With Agentforce, your custom AI agents: - Achieve greater accuracy by securely grounding in all your enterprise data with Data Cloud - Take action seamlessly by leveraging Flow automations - Connect effortlessly to your enterprise APIs through MuleSoft - Test with confidence in Sandboxes before deployment - Use in your apps, web, social, and Slack. Humans with AI drive customer success, together. Now everyone is an Einstein. More to come at Dreamforce 2024! 💙

Marc Benioff

70,898 views • 1 year ago

See your data on Google Earth's real-world canvas. You can now import large-scale KML and GeoJSON datasets—up to billions of features—directly into Google Earth. Don’t just view your data; validate it against reality. Customize styling, create custom data layers, and uncover new insights to create visualizations that drive decisions. Take advantage of increased storage and file size quotas in our professional plans to securely overlay your proprietary intelligence atop our trusted imagery and data layers to create a single source of truth.

See your data on Google Earth's real-world canvas. You can now import large-scale KML and GeoJSON datasets—up to billions of features—directly into Google Earth. Don’t just view your data; validate it against reality. Customize styling, create custom data layers, and uncover new insights to create visualizations that drive decisions. Take advantage of increased storage and file size quotas in our professional plans to securely overlay your proprietary intelligence atop our trusted imagery and data layers to create a single source of truth.

Google Earth

25,735 views • 4 months ago

Sync your Stripe data with *more* data storage services. Stripe Data Pipeline now supports Amazon Web Services S3, Microsoft Azure Blob Storage, and Google Cloud Storage (in addition to Amazon Web Services Redshift and SnowflakeDB). Centralize reporting with no code:

Sync your Stripe data with more data storage services. Stripe Data Pipeline now supports Amazon Web Services S3, Microsoft Azure Blob Storage, and Google Cloud Storage (in addition to Amazon Web Services Redshift and SnowflakeDB). Centralize reporting with no code:

Stripe

13,483 views • 1 year ago

we are excited to launch an experimental API focused on data extraction today Induced - send a URL and natural language query - get structured data back no custom scraping scripts required. supports csv, json and markdown with more to come. free to use. examples below 👇

we are excited to launch an experimental API focused on data extraction today Induced - send a URL and natural language query - get structured data back no custom scraping scripts required. supports csv, json and markdown with more to come. free to use. examples below 👇

Aryan Sharma

87,513 views • 2 years ago

Open Interpreter is like ChatGPT Code Interpreter, but you can run it locally on your computer, and it is 100% open-source. Write and execute code, analyze data, control your computer, and more. Great work killian Here's how to install and use it: 👇

Open Interpreter is like ChatGPT Code Interpreter, but you can run it locally on your computer, and it is 100% open-source. Write and execute code, analyze data, control your computer, and more. Great work killian Here's how to install and use it: 👇

Matthew Berman

142,883 views • 2 years ago