Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Yesterday I interviewed Sean Cai about AI data. This is essentially a guide for founders on how to sell data and RL envs to AI labs. "I've never seen a data contract get turned down by a top lab, if it's good quality data, for budget reasons." 00:00 What...

130,079 Aufrufe • vor 2 Monaten •via X (Twitter)

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

PhD Students – How to automatically extract data from papers for your literature review? Extracting relevant data from papers is challenging. However, this process can be automated. Meet AnswerThis – a tool that extracts data in seconds. Here is how it works. 1. Go to and log in. 2. After logging in, click on 𝐸𝑥𝑡𝑟𝑎𝑐𝑡 𝑑𝑎𝑡𝑎. 3. Then click on 𝑈𝑝𝑙𝑜𝑎𝑑 𝑃𝐷𝐹 and upload your papers. 4. These are the papers from which you want to extract data. 5. After uploading papers, select data you want to extract. 6. The predefined options are - Key findings - Research gaps - Methodology - Limitations - Future work - Contributions - Practical implications 7. You can also extract custom data e.g., dataset used. 8. For example, I want to extract methodology used in these papers. 9. I selected 𝑀𝑒𝑡ℎ𝑜𝑑𝑜𝑙𝑜𝑔𝑦 and clicked on 𝐴𝑑𝑑 𝐶𝑜𝑙𝑢𝑚𝑛. 10. AnswerThis extract data about methodology used in the papers. 11. You can change data view from normal to Table View. 12. For this, scroll back to top and click on 𝑇𝑎𝑏𝑙𝑒 𝑉𝑖𝑒𝑤. 13. Now for instance, you want to extract more data from these papers. 14. Go back to the top and click on 𝐸𝑥𝑡𝑟𝑎𝑐𝑡 𝑑𝑎𝑡𝑎. 15. Select the data type you want to extract. 16. For example, I want to extract data about future work. 17. So I click on 𝐹𝑢𝑡𝑢𝑟𝑒 𝑊𝑜𝑟𝑘 and then clicked on 𝐴𝑑𝑑 𝑐𝑜𝑙𝑢𝑚𝑛. 18. AnswerThis extracted data about future work from the papers. 19. After extracting the desired data, you can export it. 20. Select the data you want to extract. 21. Then click on 𝐸𝑥𝑝𝑜𝑟𝑡 𝑑𝑎𝑡𝑎. 22. Your data will be exported in CSV format. You can then analyze this data for your literature review. Try AnswerThis today: Anything you'd like to add?

Faheem Ullah

21,390 Aufrufe • vor 8 Monaten

Major program launch: Data Analytics Professional Certificate! This large, five-course sequence takes you all the way to being job-ready as a data analyst, and shows how to use Generative AI as a thought partner to enhance your work in this role. Offered by on Coursera, this is taught by Sean Barnes, Ph.D., a Data Science & Engineering Leader at Netflix. Analyzing data remains one of the most important skills in where the world is going with AI. This comprehensive certificate takes you all the way to being job-ready. Each course comes with practical projects demonstrated in real-world contexts, such as analyzing sales data for a Korean bakery, video game sales trends across different regions, or identifying factors impacting customer retention for a communications company. You'll also work on estimating fire distribution for forest fire prevention, analyzing how a diamond's properties affect its market value, and developing predictive models for retail sales analysis, carbon emissions, and coral reef conservation. Here's some of what you'll learn: - How to define data and categorize it into its many types such as discrete & continuous numerical, structured & unstructured, time series, categorical, and know what insights can be derived from the different types of data categories. - How to differentiate between data-related job roles and their responsibilities, and how data flows through an organization from the moment of capture to decision-making. - How to perform data processing functions and apply conditional formatting in spreadsheets to extract business value from your data using statistical calculations and best practices for visualizing and interpreting data. - How to use LLMs for stakeholder analysis, data exploration, and data visualization. - Best practices for using LLMs for as a thought partner to data analysis work By the end of this professional certificate program, you will have learned core statistical concepts, analysis techniques, and visualization methodologies that will serve as the foundation for working as a data analyst. The world needs more data analysts, especially ones who know how to use modern generative AI. With data science roles projected to grow 36% by 2033, the skills taught in this program create new professional opportunities in data. Sign up here!

Andrew Ng

84,686 Aufrufe • vor 1 Jahr

David Friedberg: Michael Burry’s Datacenter Math is Wrong “I actually think Michael Burberry's got this wrong.” “What Michael Burry is saying is that all of these hyperscalers have extended their depreciation schedule or the useful life of their data centers by roughly 2x, which cuts the operating costs in half when they report it in earnings. And so it's making their earnings inflate.” “So he's claiming they're cooking the books. Google first made this change in Q1 of 2021, where they said the servers are now going from 3 to 4 years. Separately in 2021, Google took networking equipment from 3 to 5 years. And then in 2023, they took it from 5 to 6 years.” “And so this is a result of this effort where they went in and did an analysis. So what happened?” “What happened in the data centers is that the data centers transitioned from being primarily data storage and data transfer systems, where you would use hard drives and RAM and memory to store data and then transmit it back out, to being data processing centers because of the AI boom.” “So as AI became more important in the data center, more of the dollars that are going into data centers were allocated towards chips from data storage, which initially was hard drives.” “And then suddenly, when you put these processors in to process the data to do AI, the majority of the spend and the majority of the energy is going towards the processors.” “I made some calls and I checked around with some other friends, and everyone says the same thing: that these 7-8 year old TPUs and GPUs that are sitting in the data centers are still being used and they're being used at 100% utilization.” “So that actually justifies and validates the depreciation schedule being much longer versus shorter.”

The All-In Podcast

304,297 Aufrufe • vor 7 Monaten

Building Data Pipelines has levels to it: - level 0 Understand the basic flow: Extract → Transform → Load (ETL) or ELT This is the foundation. - Extract: Pull data from sources (APIs, DBs, files) - Transform: Clean, filter, join, or enrich the data - Load: Store into a warehouse or lake for analysis You’re not a data engineer until you’ve scheduled a job to pull CSVs off an SFTP server at 3AM! level 1 Master the tools: - Airflow for orchestration - dbt for transformations - Spark or PySpark for big data - Snowflake, BigQuery, Redshift for warehouses - Kafka or Kinesis for streaming Understand when to batch vs stream. Most companies think they need real-time data. They usually don’t. level 2 Handle complexity with modular design: - DAGs should be atomic, idempotent, and parameterized - Use task dependencies and sensors wisely - Break transformations into layers (staging → clean → marts) - Design for failure recovery. If a step fails, how do you re-run it? From scratch or just that part? Learn how to backfill without breaking the world. level 3 Data quality and observability: - Add tests for nulls, duplicates, and business logic - Use tools like Great Expectations, Monte Carlo, or built-in dbt tests - Track lineage so you know what downstream will break if upstream changes Know the difference between: - a late-arriving dimension - a broken SCD2 - and a pipeline silently dropping rows At this level, you understand that reliability > cleverness. level 4 Build for scale and maintainability: - Version control your pipeline configs - Use feature flags to toggle behavior in prod - Push vs pull architecture - Decouple compute and storage (e.g. Iceberg and Delta Lake) - Data mesh, data contracts, streaming joins, and CDC are words you throw around because you know how and when to use them. What else belongs in the journey to mastering data pipelines?

Zach Wilson

16,688 Aufrufe • vor 1 Jahr

Here's a short preview of my interview with Rowan 🛡️ from Sapien, a really unique project which blends AI, Crypto, and drawing value from human contributors cc Trevor Koverko for visibility. Summary In this episode, Rowan Stone,co-founder and CEO of Sapien, shares his path from entrepreneur to building a mission-driven company at the intersection of AI and crypto. He discusses how Sapien is tackling one of the biggest challenges in AI: sourcing high-quality, human-generated data at scale. Rowan emphasizes the importance of aligning incentives from the start, building trust with contributors, and creating a system where real people help train more useful, nuanced AI models. The conversation touches on strategic partnerships, market demand, and how onboarding and education will define the future of the data economy. Takeaways — Rowan previously sold a company to Coinbase before launching Sapien. — Sapien’s goal is to monetize human understanding for AI training. — Real-world data from real people is essential for effective AI. — The need for labeled, high-quality data is growing exponentially. — Incentives and quality control are deeply integrated in Sapien’s model. — Onboarding and contributor education are critical for scale. — Sapien sees collaboration—not just competition—as a strength. — Upskilling contributors increases data quality and platform value. — Crypto-native incentives enable transparent, scalable coordination. Timeline (00:00) Introduction to Rowan Stone and His Background (02:55) The Vision Behind Sapien (06:06) Understanding AI and Data Annotation (09:01) The Role of Humans in AI Development (12:14) Sapien’s Unique Approach to Data Annotation (14:50) Partnerships and Customer Base (18:11) Quality Control and Community Involvement (21:13) On-Chain Coordination and Incentives (23:56) Demand for AI Data and Market Insights (29:51) The Future of Data Demand (30:44) Collaboration Over Competition (32:49) Revenue Generation in Crypto (35:31) The Two-Sided Market of Sapien (39:08) Customer Success Stories (44:35) The Role of Skills in Data Contribution (47:59) The Importance of Education and Onboarding (49:20) Inspiration and Influences (50:11) Overrated Trends in AI and Crypto (51:11) Distribution Channels for Onboarding (54:19) The Impact of TikTok on User Acquisition

papiofficial ᛤ

29,967 Aufrufe • vor 1 Jahr