Loading video...

Video Failed to Load

Go Home

I asked @replit agent to build a web scraper API in Python using fastapi and save the scraped data into a database. Love how it can do backend too!

177,716 views • 1 year ago •via X (Twitter)

11 Comments

Andrew's profile picture
Andrew1 year ago

That works if you need to scrape well-known, good-working websites/web pages (like Wikipedia, for example) But this is not so easy to build any-page scraper. I'm building a crawler (to scrape all pages on the website), and there are many nuances. If the website doesn't want to be scraped, it becomes challenging.

Melvin Vivas's profile picture
Melvin Vivas1 year ago

@Replit try @firecrawl_dev. i think they will handle that issue

SecurityPal's profile picture
SecurityPal1 year ago

Questionnaire Concierge is now available as an API! With the new API, you can: 📝 Create new questionnaire request directly 🔍 Instantly search questionnaire details ⚒️ Build custom form and dashboard 🔗: #SecurityPal #SecurityQuestionnaires #API

Andrew Davison's profile picture
Andrew Davison1 year ago

@Replit You’re cooking today!

Melvin Vivas's profile picture
Melvin Vivas1 year ago

@Replit yeah my trial sub is about to expire 😁

Chris Laupama's profile picture
Chris Laupama1 year ago

@Replit Bro Replit is so incredible!

Jesus Vazquez's profile picture
Jesus Vazquez1 year ago

@Replit Replit Agents is gooood. It's also the only one that I know of that offers their own database integrated as well as some other perks. I really like it

Opeih's profile picture
Opeih1 year ago

@Replit How would you compare replit agent compared to v0, lovable, bolt or cursor ?

Melvin Vivas's profile picture
Melvin Vivas1 year ago

@Replit i think it's the most complete in terms of integration to auth, db and deployments

AGIdevice's profile picture
AGIdevice1 year ago

@Replit do you get the code too?

Shawn McAllister's profile picture
Shawn McAllister1 year ago

@Replit Try installing a chrome-headless-shell. I’ll wait…

Related Videos