Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

we are excited to launch an experimental API focused on data extraction today Induced - send a URL and natural language query - get structured data back no custom scraping scripts required. supports csv, json and markdown with more to come. free to use. examples below 👇

Aryan Sharma

16,608 subscribers

87,513 Aufrufe • vor 2 Jahren •via X (Twitter)

Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

11 Kommentare

Profilbild von aryan sharma

aryan sharmavor 2 Jahren

1/ our extraction API docs are live on you can receive your API key on every extraction request includes a URL and natural language query. you can optionally pass column names, output format and count of rows to be captured.

Profilbild von aryan sharma

aryan sharmavor 2 Jahren

2/ once a request is sent, the API returns an ID for your extraction job. you can use the ID to poll status and get structured data output back when the job is completed. example: extracting all products on @producthunt with their name, maker and upvotes.

Profilbild von aryan sharma

aryan sharmavor 2 Jahren

3/ this API is great for extracting structured data from unstructured web pages. - extract trending repositories from github. - extract most active stocks on google finance. - extract top 5 videos from youtube trending. 40-60 seconds per task on average.

Profilbild von aryan sharma

aryan sharmavor 2 Jahren

4/ we don't handle pagination or authenticated pages yet - but we'll be releasing a more configurable version soon. browser agents are super powerful for data extraction tasks and we want to help more devs use them. please share feedback! discord:

Profilbild von Saurabh Kumar

Saurabh Kumarvor 2 Jahren

Really nice work. But, how do you do data validation, meaning, validating if it actually got the data you requested. I mean here there's a "name" field with "trending repos list", what if it fetched something like "popular repos" instead of trending, despite trending being available(but rather in a separate route/behind a click event). Data extraction has to be deterministic, cause the only thing you have to be absolutely sure about is data. N runs of the same script shouldn't also return N scraping outputs, as they can with stochastic embedding.

Profilbild von Alessio Fanelli

Alessio Fanellivor 2 Jahren

@inducedai @AlexReibman

Profilbild von Musthaq

Musthaqvor 2 Jahren

@inducedai I can see the video is actually clipped from the time it takes to process the request. Assuming you are launching a headless browser, capturing a screenshot, parsing the HTML, AI request to query it, how much time does it usually take to complete this request?

Profilbild von aryan sharma

aryan sharmavor 2 Jahren

@inducedai 30-60s on avg, sometimes more depending on the data. but we run this is as an async process so you can poll for completion status instead of waiting.

Profilbild von Harsh Agrawal | itsharshag.com

Harsh Agrawal | itsharshag.comvor 2 Jahren

@inducedai can we do this with PDFs?

Profilbild von calix

calixvor 2 Jahren

@inducedai love this

Profilbild von aryan sharma

aryan sharmavor 2 Jahren

@inducedai thanks calix!

Ähnliche Videos

data extraction is now live on browse dot new Induced - prompt and describe what you want to extract - get structured data as JSON / CSV works on most websites out of the box. detailed prompts recommended. also available as an API.

data extraction is now live on browse dot new Induced - prompt and describe what you want to extract - get structured data as JSON / CSV works on most websites out of the box. detailed prompts recommended. also available as an API.

Aryan Sharma

35,435 Aufrufe • vor 2 Jahren

Transforming Invoice Data into JSON: Local LLM with LlamaIndex & Pydantic 🚀 Complete video: Code: I explain how to get structured JSON output with LlamaIndex and dynamic Pydantic class. This helps to implement the use case of data extraction from invoice documents. The solution runs on the local machine, thanks to Ollama. I'm using a MacBook Air M1 with 8GB RAM. LlamaIndex 🦙 Pydantic ollama #Python #LLM #RAG

Transforming Invoice Data into JSON: Local LLM with LlamaIndex & Pydantic 🚀 Complete video: Code: I explain how to get structured JSON output with LlamaIndex and dynamic Pydantic class. This helps to implement the use case of data extraction from invoice documents. The solution runs on the local machine, thanks to Ollama. I'm using a MacBook Air M1 with 8GB RAM. LlamaIndex 🦙 Pydantic ollama #Python #LLM #RAG

Andrej Baranovskij

147,947 Aufrufe • vor 2 Jahren

v0 now supports MCPs for Stripe, Supabase, Neon, and Upstash. Query databases, seed data, and ask about revenue, all with natural language and zero setup.

v0 now supports MCPs for Stripe, Supabase, Neon, and Upstash. Query databases, seed data, and ask about revenue, all with natural language and zero setup.

v0

38,067 Aufrufe • vor 6 Monaten

Gemini 2.5 Flash can control a browser! Excited to share Gemini Browser Agent, a simple Python script example on how to use Google DeepMind Gemini 2.5 Flash and Browser Use to act as general assistant! 🤯 Usage Examples: 1⃣ Single Query Mode: `python scripts/gemini-browser-use.py --url --query "Summarize the key features of Gemini 2.5 Flash."` 2⃣Interactive Mode: Start an interactive session, optionally with a starting URL. `python scripts/gemini-browser-use.py` Command-line options: --model: The Gemini model to use (default: gemini-2.5-flash-preview-04-17) --headless: Run the browser in headless mode --url: Starting URL for the browser to navigate to before processing the query --query: Run a single query and exit (instead of interactive mode) Time to build a replication of Manus and OpenAI Operator powered by Gemini 2.5. Code below ⬇️

Gemini 2.5 Flash can control a browser! Excited to share Gemini Browser Agent, a simple Python script example on how to use Google DeepMind Gemini 2.5 Flash and Browser Use to act as general assistant! 🤯 Usage Examples: 1⃣ Single Query Mode: `python scripts/gemini-browser-use.py --url --query "Summarize the key features of Gemini 2.5 Flash."` 2⃣Interactive Mode: Start an interactive session, optionally with a starting URL. `python scripts/gemini-browser-use.py` Command-line options: --model: The Gemini model to use (default: gemini-2.5-flash-preview-04-17) --headless: Run the browser in headless mode --url: Starting URL for the browser to navigate to before processing the query --query: Run a single query and exit (instead of interactive mode) Time to build a replication of Manus and OpenAI Operator powered by Gemini 2.5. Code below ⬇️

Philipp Schmid

105,308 Aufrufe • vor 1 Jahr

✨ I made a new thing today: 📑 Whenever I need to quickly copy paste a raw JSON data dump from my app and view it I'd always use json . parser . online . fr but it seems unmaintained, keeps going down, doesn't have HTTPS, and other JSON viewers are full of spyware/malware/tracking scripts So I made this today with a lot of help from ChatGPT to solve it for me and everyone else: visualizes raw JSON data for you, and does it 100% on the client without sending any data to the server But it also secretly supports a lot of other data formats like XML, PHP serialized data, hexadecimal, base64 encoded data, and even binary! And it also works well on mobile! Another one of my little hack projects :D If you want me to add other data types, let me know and I'll add them

✨ I made a new thing today: 📑 Whenever I need to quickly copy paste a raw JSON data dump from my app and view it I'd always use json . parser . online . fr but it seems unmaintained, keeps going down, doesn't have HTTPS, and other JSON viewers are full of spyware/malware/tracking scripts So I made this today with a lot of help from ChatGPT to solve it for me and everyone else: visualizes raw JSON data for you, and does it 100% on the client without sending any data to the server But it also secretly supports a lot of other data formats like XML, PHP serialized data, hexadecimal, base64 encoded data, and even binary! And it also works well on mobile! Another one of my little hack projects :D If you want me to add other data types, let me know and I'll add them

@levelsio

882,610 Aufrufe • vor 1 Jahr

Reworkd is your scraping co-pilot. It understands website structures and auto-generates Playwright code to take actions, visit subpages, scrape, and save data based on your custom schema. With Reworkd you can simplify web data extraction at scale.

Reworkd is your scraping co-pilot. It understands website structures and auto-generates Playwright code to take actions, visit subpages, scrape, and save data based on your custom schema. With Reworkd you can simplify web data extraction at scale.

Y Combinator

63,738 Aufrufe • vor 1 Jahr

After months of building, Ronak Gandhi and I are proud to launch Structify. We started Structify so that companies can get human quality data from anywhere, for any use case. I’m excited to show you below.

After months of building, Ronak Gandhi and I are proud to launch Structify. We started Structify so that companies can get human quality data from anywhere, for any use case. I’m excited to show you below.

Alex Reichenbach

111,700 Aufrufe • vor 2 Jahren

Introducing brand new scrim analysis tool View your scrim data INSTANTLY after a match ends. ✅ No Vods or Recording needed ✅ No lag or ping ✅ Scrim data is viewable immediately after the game ends on ✅ Matches are completely private and secure ✅ Export your data to JSON, and CSV (coming soon) ✅ Only $29.99/mo More features 👇

RIB.GG

75,936 Aufrufe • vor 2 Jahren

PEOPLE OF THE EARTH. Figured out how to ask natural language questions of current financial data and get back a natural language response...with correct/relevant numbers! 🤯💰✨ So. Freaking. Cool. 1. Send database schema along with the question and relevant scope/parameters to GPT. 2. GPT returns SQL query. 3. Run SQL query on your data. 4. Take returned data and pass it in along with the original question. 5. GPT returns natural language answer with relevant data! Original Question: What was the highest price of Apple's stock over the past decade and how does it compare to Tesla's highest stock price? And on what date were those highest prices? Final Answer: The highest price of Apple's stock over the past decade was $182.94 on January 4, 2022, while Tesla's highest stock price was $414.50 on November 4, 2021.

PEOPLE OF THE EARTH. Figured out how to ask natural language questions of current financial data and get back a natural language response...with correct/relevant numbers! 🤯💰✨ So. Freaking. Cool. 1. Send database schema along with the question and relevant scope/parameters to GPT. 2. GPT returns SQL query. 3. Run SQL query on your data. 4. Take returned data and pass it in along with the original question. 5. GPT returns natural language answer with relevant data! Original Question: What was the highest price of Apple's stock over the past decade and how does it compare to Tesla's highest stock price? And on what date were those highest prices? Final Answer: The highest price of Apple's stock over the past decade was $182.94 on January 4, 2022, while Tesla's highest stock price was $414.50 on November 4, 2021.

Josh Pigford

245,298 Aufrufe • vor 3 Jahren

Krishna Srinivasan, Founder and CEO of Data Bootstrap and former Google DeepMind researcher, discusses the challenges of data scraping and scalability. With experience at prior Apple, Yahoo, and IBM watsonx, Krishna demonstrates the difference between scraping with a single machine versus leveraging OpenLedger's community nodes. The results speak for themselves, parallelized scraping enables significantly higher efficiency and scale. Data Bootstrap is one of many companies building on our Data Intelligence Layer, and we’re excited to support innovations like these. Watch the video below to learn more.

Krishna Srinivasan, Founder and CEO of Data Bootstrap and former Google DeepMind researcher, discusses the challenges of data scraping and scalability. With experience at prior Apple, Yahoo, and IBM watsonx, Krishna demonstrates the difference between scraping with a single machine versus leveraging OpenLedger's community nodes. The results speak for themselves, parallelized scraping enables significantly higher efficiency and scale. Data Bootstrap is one of many companies building on our Data Intelligence Layer, and we’re excited to support innovations like these. Watch the video below to learn more.

OpenLedger

12,062 Aufrufe • vor 1 Jahr

Built to let anyone query SF public databases with just natural language. "show me all the muggings" "where are all the needles in Hayes Valley" access to public safety and demographic data should be democratized code is open-source and linked below:

Built to let anyone query SF public databases with just natural language. "show me all the muggings" "where are all the needles in Hayes Valley" access to public safety and demographic data should be democratized code is open-source and linked below:

rahul

622,231 Aufrufe • vor 3 Jahren

Here's how I would learn data engineering basics in 2025: - Find a data source you care about (examples: gaming APIs, stock market, web scraping, etc) - Use Python to interact and ingest your source. Initially just write the data to a CSV. - Setup an account with Snowflake or Google BigQuery. - update your Python script to load a table in Snowflake/BigQuery - schedule your script with CRON in the cloud with a service like Heroku. - build aggregations and visualizations on top of your ingested data Only thing this misses is data quality and complex job orchestration which you can learn later! How would you learn data engineering nowadays?

Here's how I would learn data engineering basics in 2025: - Find a data source you care about (examples: gaming APIs, stock market, web scraping, etc) - Use Python to interact and ingest your source. Initially just write the data to a CSV. - Setup an account with Snowflake or Google BigQuery. - update your Python script to load a table in Snowflake/BigQuery - schedule your script with CRON in the cloud with a service like Heroku. - build aggregations and visualizations on top of your ingested data Only thing this misses is data quality and complex job orchestration which you can learn later! How would you learn data engineering nowadays?

Zach Wilson

20,363 Aufrufe • vor 11 Monaten

Introducing: Data API The latest step in our data-first roadmap: programmatic access to Blockworks Data, anywhere you need it. No more CSV babysitting. No more unreliable sources. Just clean, validated onchain data straight into your stack. Join the waitlist 👇

Introducing: Data API The latest step in our data-first roadmap: programmatic access to Blockworks Data, anywhere you need it. No more CSV babysitting. No more unreliable sources. Just clean, validated onchain data straight into your stack. Join the waitlist 👇

Blockworks Research

60,054 Aufrufe • vor 10 Monaten

Use natural language to query logs, metrics, traces, and dashboards with the Datadog plugin.

Use natural language to query logs, metrics, traces, and dashboards with the Datadog plugin.

Cursor

73,409 Aufrufe • vor 3 Monaten

Agentic Document Extraction now supports field extraction! Many doc extraction use cases extract specific fields from forms and other structured documents. You can now input a picture or PDF of an invoice, request the vendor name, item list, and prices, and get back the extracted fields. Or input a medical form and specify a schema to extract patient name, patient ID, insurance number, etc. One cool feature: If you don't feel like writing a schema (json specification of what fields to extract) yourself, upload one sample document and write a natural language prompt saying what you want, and we automatically generate a schema for you. See the video for details!

Agentic Document Extraction now supports field extraction! Many doc extraction use cases extract specific fields from forms and other structured documents. You can now input a picture or PDF of an invoice, request the vendor name, item list, and prices, and get back the extracted fields. Or input a medical form and specify a schema to extract patient name, patient ID, insurance number, etc. One cool feature: If you don't feel like writing a schema (json specification of what fields to extract) yourself, upload one sample document and write a natural language prompt saying what you want, and we automatically generate a schema for you. See the video for details!

Andrew Ng

192,833 Aufrufe • vor 11 Monaten

🚀 Framer Forms are here! Enjoy 10+ input types, custom states, and secure data handling. Send data via email, Google Sheets, or custom Webhook. Learn more below.

🚀 Framer Forms are here! Enjoy 10+ input types, custom states, and secure data handling. Send data via email, Google Sheets, or custom Webhook. Learn more below.

Framer

100,853 Aufrufe • vor 2 Jahren

Introducing Granite Docling WebGPU 🐣 State-of-the-art document parsing 100% locally in your browser! 🤯 🔐 No data sent to a server (private & secure) 💰 Completely free... forever! 🔂 Docling ecosystem enables conversion to HTML, Markdown, JSON, and more! Try out the demo! 👇

Introducing Granite Docling WebGPU 🐣 State-of-the-art document parsing 100% locally in your browser! 🤯 🔐 No data sent to a server (private & secure) 💰 Completely free... forever! 🔂 Docling ecosystem enables conversion to HTML, Markdown, JSON, and more! Try out the demo! 👇

Xenova

55,875 Aufrufe • vor 8 Monaten

🌊TrellisInsights (YC W24) makes unstructured data SQL-ready. It extracts and transforms your unstructured data to SQL-compliant tables with schema you define with natural language. Congrats on the launch, Mac Klinkachorn and Jacky Lin!

🌊TrellisInsights (YC W24) makes unstructured data SQL-ready. It extracts and transforms your unstructured data to SQL-compliant tables with schema you define with natural language. Congrats on the launch, Mac Klinkachorn and Jacky Lin!

Y Combinator

14,213 Aufrufe • vor 2 Jahren

We are excited to launch the Hello Moon Developer Platform 🥳🥳🥳 Engage directly with on-chain Solana data (at Solana speeds) to build new dApps, analytics platforms, and more Build with us

We are excited to launch the Hello Moon Developer Platform 🥳🥳🥳 Engage directly with on-chain Solana data (at Solana speeds) to build new dApps, analytics platforms, and more Build with us

Hello Moon

541,409 Aufrufe • vor 3 Jahren

Obsidian Importer now lets you generate Markdown files from a CSV. It converts thousands records in seconds and automatically generates a Base that you can use to explore and edit the data.

Obsidian Importer now lets you generate Markdown files from a CSV. It converts thousands records in seconds and automatically generates a Base that you can use to explore and edit the data.

Obsidian

49,357 Aufrufe • vor 7 Monaten