It's happening. Last night, I started downloading financial data from the SEC. • income statements • balance sheets • cash flow statements 10,000+ public companies. 3 million rows in total. I’m using multiple worker nodes to pull, parse, and clean the data. The orchestration is beautiful. This week, I... will: • create an API for accessing the data • write and publish developer docs • add auth so you can use it cc buildspace nights & weekends 🔊 on for the videoshow more

SEC EDGAR’s file structure consistency is so under appreciated. Really happy you found the right method to get it from the source. Every day new files are uploaded to the SEC. Creating an API that does minimal standardization but delivers statements as presented will be 🔥🔥🔥

Yes sir. Finally cracking the standardized financial data problem

Build in public the podscan (@arvidkahl) for financial data and its analysis and you’ll have a really fun ride

@arvidkahl Arvid is a legend. Loved The Embedded Entrepreneur.

Gonna put it into a knowledge graph? Graph RAG?

That actually sounds dope

Will sponsor GPUs if you’re planning to opensource what you’re working on.

parsing sec XML has been painful for me: namespaces, structure changing over the years, gaap taxonomy (changing over time). I'm curious: how did you find a safe way to handle all of this?

Lots of coding and staring at the data. Will release design diagrams, etc. this week!

Have you seen