Loading video...

Video Failed to Load

Go Home

I've built it for you!! It's an automated AI system that analyzes AI case studies (you can change the use case) to identify and document enterprise-level AI implementations. It starts by reading URLs from a CSV file and uses web scraping (either through WebLoader or Firecrawl) to extract the...

85,221 views • 1 year ago •via X (Twitter)

11 Comments

Arvid Kahl's profile picture
Arvid Kahl1 year ago

I want to run AI agents to scrape specific URLs and do some data extraction until they find a certain kind of information. Like an AI investigator. What’s the framework that allows for this kind of cutting-edge stuff? Is there an AI agent project that we should be using?

Muratcan Koylan's profile picture
Muratcan Koylan1 year ago

The repo is available for anyone who wants to try it

Arvid Kahl's profile picture
Arvid Kahl1 year ago

Amazing!

Muratcan Koylan's profile picture
Muratcan Koylan1 year ago

I hope it helps. Thank you.

UnShelledSec's profile picture
UnShelledSec1 year ago

@arvidkahl Yeah CrawlAI or Fire crawl is definitely a good scraper to use for such a project. Fire crawl is seriously improving overtime.

Gatsby Goldsmith's profile picture
Gatsby Goldsmith1 year ago

@arvidkahl White IDE oh no, my eyes 😑

⟁ndrew V's profile picture
⟁ndrew V1 year ago

Looks awesome, I really would love to know what the total cost of use is for this system implementation. Say running it on let’s just say a weather website or API on a daily basis for a week for one single location. Or if that’s too simple, then another example would be the cost projections for running this type of system on an aggregate of meet up and technology focused events. Essentially just seems like an insane amount of API token and function calling. Use to where even just running it for an hour would cost probably close to 100 bucks USD?

Muratcan Koylan's profile picture
Muratcan Koylan1 year ago

@arvidkahl I don't think it would be costly if you use Haiku or any other smaller and cheaper model.

Lurchi Hart's profile picture
Lurchi Hart1 year ago

@arvidkahl that’s one horrendous theme

Agent B's profile picture
Agent B1 year ago

@arvidkahl Cool one Muratcan ! 👏

Preston's profile picture
Preston1 year ago

@arvidkahl This is intriguing but I’m not sure I’m clear on what problem this is solving. Can you help me understand?

Related Videos

What has been done and what's next. I'm writing this text mainly for myself so as not to forget some things. Later, based on it, we'll create a roadmap for the near future. And for you, dear $Gruta Fam, it will be useful for a general understanding of where we're heading. So, the goal is to create a unique AI-based analytical platform that includes several tools. AI agent Grufender - real-time analysis of crypto communities on X. Activity analysis, sentiment analysis, FUD and FUDders analysis, as well as the creation of other unique social metrics. The AI agent has been created and is functioning, collecting and analyzing data in real time. Its completeness can be estimated at 80 percent, as further improvements are required. The dashboard for this AI agent is also functioning but needs refinement and a new design. Its completeness can be estimated at 70 percent. The goal for the full dashboard release is to connect 50 - 100 top crypto communities to the AI agent. AI agent Grutector - analysis of any X users for contradictions (flip-flops). The AI agent has been created and is functioning. It has undergone beta testing by volunteers and needs adjustments. Its readiness can be estimated at 70 percent. The dashboard for this agent has also been created but needs rework and additional features - its readiness can be estimated at 50 percent. During the testing of Grutector , it became clear that the main user interest is in checking various KOLs, so an additional level of analysis specifically for KOLs will be created. More in-depth. How it will look: we'll select about 50- 100 KOLs to start with and fully analyze them using our AI agent - every tweet throughout the entire history of their accounts. And this full analysis of all these KOLs will appear on the Grutector dashboard (let's call this analysis L2, and the flip-flop analysis - L1). Every user will be able to access this analysis and get the full picture, for example, regarding Ansem (who has over a hundred thousand tweets in his entire history!): how he became a KOL, what was the most interesting throughout the message history, what common patterns, which coins he promoted, and so on. And then the most interesting part - after reading this analysis, the user will be able to ask our AI agent: what did he say about women, for example? Or how did he promote certain coins? Or how consistent is he? And so on. Each such question will be paid. And, of course, we'll try to use #x402 in the internal payment system. Why is all this needed? Not only because it's interesting and will attract many users. But also if you've decided to buy a coin - you go to our analytical platform - and study the metrics for the coin's community, study the KOLs who shill the coin - and make a decision to buy the coin or abandon the purchase. And we're also currently creating a trading bot to participate in the trading AI bots contest from Aster 🥷 , which will make trading decisions based on metrics obtained from our AI agents 👀 Its readiness at the moment is approximately 15% of the planned functionality. Access to each product will be granted as it becomes ready. But right now, for example, you can explore the Grufender dashboard on the website along with beta testers (authorization via a wallet with a million $GRUTA tokens). In general, we're working, friends 🫡 $Gruta AI CA: 35t5DPbwJtB1tpGiSnqedLwQomi94BRKVDPyTRLdbonk

Dogtor

16,083 views • 7 months ago