Loading video...

Video Failed to Load

Go Home

Everyone in Embodied AI is talking about Vision-Language-Action (VLA) models. Almost no one is talking about the physical nightmare of collecting the data to train them. You can't scrape a kitchen table or a warehouse shelf from a web browser. To get to millions of hours of diverse, real-world...

ryanmhickman's profile picture

Ryan Hickman

3,207 subscribers

26,385 views • 2 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Exciting updates on Project GR00T! We discover a systematic way to scale up robot data, tackling the most painful pain point in robotics. The idea is simple: human collects demonstration on a real robot, and we multiply that data 1000x or more in simulation. Let’s break it down: 1. We use Apple Vision Pro (yes!!) to give the human operator first person control of the humanoid. Vision Pro parses human hand pose and retargets the motion to the robot hand, all in real time. From the human’s point of view, they are immersed in another body like the Avatar. Teleoperation is slow and time-consuming, but we can afford to collect a small amount of data. 2. We use RoboCasa, a generative simulation framework, to multiply the demonstration data by varying the visual appearance and layout of the environment. In Jensen’s keynote video below, the humanoid is now placing the cup in hundreds of kitchens with a huge diversity of textures, furniture, and object placement. We only have 1 physical kitchen at the GEAR Lab in NVIDIA HQ, but we can conjure up infinite ones in simulation. 3. Finally, we apply MimicGen, a technique to multiply the above data even more by varying the *motion* of the robot. MimicGen generates vast number of new action trajectories based on the original human data, and filters out failed ones (e.g. those that drop the cup) to form a much larger dataset. To sum up, given 1 human trajectory with Vision Pro -> RoboCasa produces N (varying visuals) -> MimicGen further augments to NxM (varying motions). This is the way to trade compute for expensive human data by GPU-accelerated simulation. A while ago, I mentioned that teleoperation is fundamentally not scalable, because we are always limited by 24 hrs/robot/day in the world of atoms. Our new GR00T synthetic data pipeline breaks this barrier in the world of bits. Scaling has been so much fun for LLMs, and it's finally our turn to have fun in robotics! We are building tools to enable everyone in the ecosystem to scale up with us. Links in thread:
1:21

Exciting updates on Project GR00T! We discover a systematic way to scale up robot data, tackling the most painful pain point in robotics. The idea is simple: human collects demonstration on a real robot, and we multiply that data 1000x or more in simulation. Let’s break it down: 1. We use Apple Vision Pro (yes!!) to give the human operator first person control of the humanoid. Vision Pro parses human hand pose and retargets the motion to the robot hand, all in real time. From the human’s point of view, they are immersed in another body like the Avatar. Teleoperation is slow and time-consuming, but we can afford to collect a small amount of data. 2. We use RoboCasa, a generative simulation framework, to multiply the demonstration data by varying the visual appearance and layout of the environment. In Jensen’s keynote video below, the humanoid is now placing the cup in hundreds of kitchens with a huge diversity of textures, furniture, and object placement. We only have 1 physical kitchen at the GEAR Lab in NVIDIA HQ, but we can conjure up infinite ones in simulation. 3. Finally, we apply MimicGen, a technique to multiply the above data even more by varying the *motion* of the robot. MimicGen generates vast number of new action trajectories based on the original human data, and filters out failed ones (e.g. those that drop the cup) to form a much larger dataset. To sum up, given 1 human trajectory with Vision Pro -> RoboCasa produces N (varying visuals) -> MimicGen further augments to NxM (varying motions). This is the way to trade compute for expensive human data by GPU-accelerated simulation. A while ago, I mentioned that teleoperation is fundamentally not scalable, because we are always limited by 24 hrs/robot/day in the world of atoms. Our new GR00T synthetic data pipeline breaks this barrier in the world of bits. Scaling has been so much fun for LLMs, and it's finally our turn to have fun in robotics! We are building tools to enable everyone in the ecosystem to scale up with us. Links in thread:

Jim Fan

364,514 views • 2 years ago

🚨OpenAI CFO speaks on AI boom and data centers “I think we are sooo in the early innings. I think a lot of prognosticators wanna call it “we’re on the sugar rush”… WE ARE NOT! more like the railroads or the build out of electricity. The internet turns out in hindsight a relatively capex light build out. I think we are just getting started! Now.. we have to do a lot to make data centers more efficient.. we need to think about new ways to power them. BUT in terms of AI, it is voracious right now for GPUs and COMPUTE. the biggest thing we face is WE ARE CONSTANTLY UNDER COMPUTE That’s why we launched Stargate. That’s why we are doing the BIGGER builds with ..Microsoft*, with ORACLE, CoreWeave and so on.. And we are just getting started!”
1:21

🚨OpenAI CFO speaks on AI boom and data centers “I think we are sooo in the early innings. I think a lot of prognosticators wanna call it “we’re on the sugar rush”… WE ARE NOT! more like the railroads or the build out of electricity. The internet turns out in hindsight a relatively capex light build out. I think we are just getting started! Now.. we have to do a lot to make data centers more efficient.. we need to think about new ways to power them. BUT in terms of AI, it is voracious right now for GPUs and COMPUTE. the biggest thing we face is WE ARE CONSTANTLY UNDER COMPUTE That’s why we launched Stargate. That’s why we are doing the BIGGER builds with ..Microsoft*, with ORACLE, CoreWeave and so on.. And we are just getting started!”

NIK

102,475 views • 11 months ago

We are publishing our first deep dive on what we believe is one of the most challenging layers in egocentric data - SLAM and VIO in the context of long-horizon state tracking. We break down how SLAM and VIO fail in egocentric settings - visual features vanish at close range, depth sensors saturate, fast head motion blurs frames, and these failures don't always occur in isolation. They hit at the exact same moment, leading to compounding errors and making the downstream data unusable. We believe the foundation for high-quality egocentric data demands sub-centimeter precision over long episodes ranging from a few minutes to up to an hour.
0:33

We are publishing our first deep dive on what we believe is one of the most challenging layers in egocentric data - SLAM and VIO in the context of long-horizon state tracking. We break down how SLAM and VIO fail in egocentric settings - visual features vanish at close range, depth sensors saturate, fast head motion blurs frames, and these failures don't always occur in isolation. They hit at the exact same moment, leading to compounding errors and making the downstream data unusable. We believe the foundation for high-quality egocentric data demands sub-centimeter precision over long episodes ranging from a few minutes to up to an hour.

FPV Labs

41,955 views • 4 months ago

Physics-based Motion Retargeting from Sparse Inputs paper page: Avatars are important to create interactive and immersive experiences in virtual worlds. One challenge in animating these characters to mimic a user's motion is that commercial AR/VR products consist only of a headset and controllers, providing very limited sensor data of the user's pose. Another challenge is that an avatar might have a different skeleton structure than a human and the mapping between them is unclear. In this work we address both of these challenges. We introduce a method to retarget motions in real-time from sparse human sensor data to characters of various morphologies. Our method uses reinforcement learning to train a policy to control characters in a physics simulator. We only require human motion capture data for training, without relying on artist-generated animations for each avatar. This allows us to use large motion capture datasets to train general policies that can track unseen users from real and sparse data in real-time. We demonstrate the feasibility of our approach on three characters with different skeleton structure: a dinosaur, a mouse-like creature and a human. We show that the avatar poses often match the user surprisingly well, despite having no sensor information of the lower body available. We discuss and ablate the important components in our framework, specifically the kinematic retargeting step, the imitation, contact and action reward as well as our asymmetric actor-critic observations. We further explore the robustness of our method in a variety of settings including unbalancing, dancing and sports motions.
7:12

Physics-based Motion Retargeting from Sparse Inputs paper page: Avatars are important to create interactive and immersive experiences in virtual worlds. One challenge in animating these characters to mimic a user's motion is that commercial AR/VR products consist only of a headset and controllers, providing very limited sensor data of the user's pose. Another challenge is that an avatar might have a different skeleton structure than a human and the mapping between them is unclear. In this work we address both of these challenges. We introduce a method to retarget motions in real-time from sparse human sensor data to characters of various morphologies. Our method uses reinforcement learning to train a policy to control characters in a physics simulator. We only require human motion capture data for training, without relying on artist-generated animations for each avatar. This allows us to use large motion capture datasets to train general policies that can track unseen users from real and sparse data in real-time. We demonstrate the feasibility of our approach on three characters with different skeleton structure: a dinosaur, a mouse-like creature and a human. We show that the avatar poses often match the user surprisingly well, despite having no sensor information of the lower body available. We discuss and ablate the important components in our framework, specifically the kinematic retargeting step, the imitation, contact and action reward as well as our asymmetric actor-critic observations. We further explore the robustness of our method in a variety of settings including unbalancing, dancing and sports motions.

AK

106,527 views • 3 years ago

We’re on the verge of interactive, real-time, photorealistic video generation with what are called World Models. These require a fair amount of expensive compute, but costs will come down over time. Today, these interactions are essentially real-time dreams. They lack the persistence and shared logic that turns a video into a multiplayer game. Or concert. Or classroom. Or the holodeck. We believe the ultimate architecture for gaming (and the holodeck) is Roblox Reality. It’s a hybrid architecture that marries the structured data and logic of the Roblox Engine and Roblox Cloud with the generative power of Video World Models. The Roblox Engine provides the underlying synchronized ground truth—the score, physics, multiplayer sync, etc.—while our video model acts as a Super Upsampler to layer on photorealistic detail. We believe this will ultimately remove barriers to high-fidelity creation, allowing a team of three people to build a narrative-driven, photorealistic masterpiece in a single week. This is an early look at turning solitary AI dreams into a social, playable reality.
0:31

We’re on the verge of interactive, real-time, photorealistic video generation with what are called World Models. These require a fair amount of expensive compute, but costs will come down over time. Today, these interactions are essentially real-time dreams. They lack the persistence and shared logic that turns a video into a multiplayer game. Or concert. Or classroom. Or the holodeck. We believe the ultimate architecture for gaming (and the holodeck) is Roblox Reality. It’s a hybrid architecture that marries the structured data and logic of the Roblox Engine and Roblox Cloud with the generative power of Video World Models. The Roblox Engine provides the underlying synchronized ground truth—the score, physics, multiplayer sync, etc.—while our video model acts as a Super Upsampler to layer on photorealistic detail. We believe this will ultimately remove barriers to high-fidelity creation, allowing a team of three people to build a narrative-driven, photorealistic masterpiece in a single week. This is an early look at turning solitary AI dreams into a social, playable reality.

David Baszucki

782,227 views • 3 months ago

The biggest marketplace on Earth won't be the assets humans own. It'll be the data AI needs. Everything that can be digitised is getting pulled in to train the next models. Every scientific dataset, every piece of research sitting in a university, every sensor reading off every John Deere tractor in a field. All of it feeds the machine, and almost none of it is visible to us. What comes out is an agentic economy running at machine speed. You plug your data into a vault, and agents monetise it on your behalf, trading with other agents in real time, in a marketplace we never see. The company sitting on proprietary data becomes part of it without even knowing. This is what the Economic Singularity actually looks like from the inside. The real economy stops being the one we can see and price, and moves somewhere we can't follow. You own a piece of it, or you get priced out of it. Jordi Visser.
1:27

The biggest marketplace on Earth won't be the assets humans own. It'll be the data AI needs. Everything that can be digitised is getting pulled in to train the next models. Every scientific dataset, every piece of research sitting in a university, every sensor reading off every John Deere tractor in a field. All of it feeds the machine, and almost none of it is visible to us. What comes out is an agentic economy running at machine speed. You plug your data into a vault, and agents monetise it on your behalf, trading with other agents in real time, in a marketplace we never see. The company sitting on proprietary data becomes part of it without even knowing. This is what the Economic Singularity actually looks like from the inside. The real economy stops being the one we can see and price, and moves somewhere we can't follow. You own a piece of it, or you get priced out of it. Jordi Visser.

Raoul Pal

78,985 views • 22 days ago

#BudgetSession2025 | Lok Sabha LoP and Congress MP Rahul Gandhi says "People talk about AI, but it's important to understand that AI on its own is absolutely meaningless because AI operates on top of data. Without data, AI means nothing. And if we look at data today, there is one thing which is very clear. Every single piece of data that comes out of the production system in the world. The data that was used to make this phone, the data that is used to make electric cars. The data that is used to make basically all electronics on the planet today is owned by China. And the consumption data is owned by the United States... China has at least a 10 year lead on India in this space. China has been working on batteries, robots, motors, optics for the last 10 years and we are behind...We would ensure that our banking system is not captured by 2-3 companies that basically do not allow you to build a production system. But our banking system is open, dynamic and accessible to small and medium businesses and to millions and millions of entrepreneurs who want to take part in this revolution. Our foreign policy would take into account this revolution. When we talk to the United States, we would not send our foreign minister to invite our Prime Minister to his coronation...Because if we had a production system and if we were working on these technologies, the American President would come here and invite the Prime Minister."
3:20

#BudgetSession2025 | Lok Sabha LoP and Congress MP Rahul Gandhi says "People talk about AI, but it's important to understand that AI on its own is absolutely meaningless because AI operates on top of data. Without data, AI means nothing. And if we look at data today, there is one thing which is very clear. Every single piece of data that comes out of the production system in the world. The data that was used to make this phone, the data that is used to make electric cars. The data that is used to make basically all electronics on the planet today is owned by China. And the consumption data is owned by the United States... China has at least a 10 year lead on India in this space. China has been working on batteries, robots, motors, optics for the last 10 years and we are behind...We would ensure that our banking system is not captured by 2-3 companies that basically do not allow you to build a production system. But our banking system is open, dynamic and accessible to small and medium businesses and to millions and millions of entrepreneurs who want to take part in this revolution. Our foreign policy would take into account this revolution. When we talk to the United States, we would not send our foreign minister to invite our Prime Minister to his coronation...Because if we had a production system and if we were working on these technologies, the American President would come here and invite the Prime Minister."

ANI

163,581 views • 1 year ago

WOW 🚨 Illinois resident says everyone showed up to their City Council meeting to oppose 14 data centers being built She said so many people showed up to oppose it, it took 6 hours with public comments At the end Democrats didn’t care and UNANIMOUSLY VOTED TO APPROVE THEM “I just spent six hours at a city council meeting — where they were discussing the 14 data centers they're gonna build in my city. And public comment went on for hours and hours and hours of people telling them how badly our community does not need this, and how detrimental it will be to the people, the wildlife, the health, the everything, all of the negative impacts of the data centers. We told them, and we told them over and over and over again, and then at the end, after sitting here for six hours, telling them this is not what we want — they unanimously voted yes for the data centers in our face”
2:04

WOW 🚨 Illinois resident says everyone showed up to their City Council meeting to oppose 14 data centers being built She said so many people showed up to oppose it, it took 6 hours with public comments At the end Democrats didn’t care and UNANIMOUSLY VOTED TO APPROVE THEM “I just spent six hours at a city council meeting — where they were discussing the 14 data centers they're gonna build in my city. And public comment went on for hours and hours and hours of people telling them how badly our community does not need this, and how detrimental it will be to the people, the wildlife, the health, the everything, all of the negative impacts of the data centers. We told them, and we told them over and over and over again, and then at the end, after sitting here for six hours, telling them this is not what we want — they unanimously voted yes for the data centers in our face”

Wall Street Apes

1,467,875 views • 5 months ago

For the past 3 months, I've been heads down building and extending our multimodal data capture rig for Physical AI training. What you're seeing here is a single synchronized capture from our system — RGB, depth (stereo IR camera) feed; real-time 3D hand reconstruction, and a 23×20 tactile pressure grid from sensor gloves, all aligned and timestamped together. Getting here took a lot of unglamorous iteration. We reworked the pipeline to deliver clean, gap-free depth at scale after identifying early depth frame drops caused by data throughput bottlenecks in our capture box. We built per-channel calibration models that convert raw resistance signals from our flex sensor gloves into accurate, drift-corrected force values — solving the creep behavior that made a steady grip falsely appear to fade over time. Even though we’ve stayed quiet on socials, word of mouth spread — our rigs have already been deployed in data factories, manufacturing lines, and homes across the US, Europe, China, and Southeast Asia by our customers and ourselves. In the next few days, I'll be sharing more about how we're tackling rights-cleared data capture from the hardware level, and our closed-loop data-model flywheel — using model evaluation results to identify gaps and guide what data our customers need. More soon, stay tuned…
0:26

For the past 3 months, I've been heads down building and extending our multimodal data capture rig for Physical AI training. What you're seeing here is a single synchronized capture from our system — RGB, depth (stereo IR camera) feed; real-time 3D hand reconstruction, and a 23×20 tactile pressure grid from sensor gloves, all aligned and timestamped together. Getting here took a lot of unglamorous iteration. We reworked the pipeline to deliver clean, gap-free depth at scale after identifying early depth frame drops caused by data throughput bottlenecks in our capture box. We built per-channel calibration models that convert raw resistance signals from our flex sensor gloves into accurate, drift-corrected force values — solving the creep behavior that made a steady grip falsely appear to fade over time. Even though we’ve stayed quiet on socials, word of mouth spread — our rigs have already been deployed in data factories, manufacturing lines, and homes across the US, Europe, China, and Southeast Asia by our customers and ourselves. In the next few days, I'll be sharing more about how we're tackling rights-cleared data capture from the hardware level, and our closed-loop data-model flywheel — using model evaluation results to identify gaps and guide what data our customers need. More soon, stay tuned…

Grace Zhang

54,115 views • 2 months ago

🖨️ It took over a year and lots of help from Claude Code but I have now been able to create a real dot matrix printer on the web that prints from Windows 3.11 in your browser: Here's the test page: I couldn't get the LPT1 port to work but COM2 did work (the dial up model already uses COM1), the JS receives the COM2 serial data (just raw print data) and then prints it Next is to make the dot matrix printer better looking (kinda 3d like on pieter dot com) and have the paper also flowing in 3d out of the printer and integrate it on the page My idea was that it might work because we also capture the COM1 data (from the dial up modem) and send it to a Websocket as a dial up connection, so we should be able to capture the COM2 traffic too but I didn't know how, but now I do IT WORKS!! 😊
0:51

🖨️ It took over a year and lots of help from Claude Code but I have now been able to create a real dot matrix printer on the web that prints from Windows 3.11 in your browser: Here's the test page: I couldn't get the LPT1 port to work but COM2 did work (the dial up model already uses COM1), the JS receives the COM2 serial data (just raw print data) and then prints it Next is to make the dot matrix printer better looking (kinda 3d like on pieter dot com) and have the paper also flowing in 3d out of the printer and integrate it on the page My idea was that it might work because we also capture the COM1 data (from the dial up modem) and send it to a Websocket as a dial up connection, so we should be able to capture the COM2 traffic too but I didn't know how, but now I do IT WORKS!! 😊

@levelsio

85,969 views • 2 months ago

We just launched a major new Data Engineering Professional Certificate on Coursera! Data underlies all modern AI systems, and engineers who know how to build systems to store and serve it are in high demand. If you're interested in learning this skill, please check out this 4-course sequence, which is designed to make you job-ready to be a Data Engineer. This is a new specialization taught by Joe Reis, the co-author of the best-selling book “Fundamentals of Data Engineering," in collaboration with AWS. (Disclosure, I serve on Amazon's board.) For many AI systems, data engineering is 80% of the work, and modeling is 20%. But people’s attention on these two topics is often flipped. This makes the job of the data engineer particularly important. In this professional certificate, you'll learn foundational data engineering skills while implementing modern data architectures using open-source tools: - Learn the key steps of the data lifecycle, to generate, ingest, store, transform, and serve data. - Learn to align with organizational goals to design the data pipeline right for your business' needs. - Understand how to make necessary trade-offs between speed, scalability, security, and cost. Joe has distilled into this specialization decades of experience helping startups and large companies with data infrastructure. He is also joined by 17 other industry leaders in the data field, who will help you learn in-demand skills for the growing field of data engineering. Please sign up here:
1:33

We just launched a major new Data Engineering Professional Certificate on Coursera! Data underlies all modern AI systems, and engineers who know how to build systems to store and serve it are in high demand. If you're interested in learning this skill, please check out this 4-course sequence, which is designed to make you job-ready to be a Data Engineer. This is a new specialization taught by Joe Reis, the co-author of the best-selling book “Fundamentals of Data Engineering," in collaboration with AWS. (Disclosure, I serve on Amazon's board.) For many AI systems, data engineering is 80% of the work, and modeling is 20%. But people’s attention on these two topics is often flipped. This makes the job of the data engineer particularly important. In this professional certificate, you'll learn foundational data engineering skills while implementing modern data architectures using open-source tools: - Learn the key steps of the data lifecycle, to generate, ingest, store, transform, and serve data. - Learn to align with organizational goals to design the data pipeline right for your business' needs. - Understand how to make necessary trade-offs between speed, scalability, security, and cost. Joe has distilled into this specialization decades of experience helping startups and large companies with data infrastructure. He is also joined by 17 other industry leaders in the data field, who will help you learn in-demand skills for the growing field of data engineering. Please sign up here:

Andrew Ng

118,937 views • 1 year ago

DAVID SACKS ON THE AI RACE: "The US is currently in an AI race, and our chief global competition is China, obviously. They're the only other country that has the talent, the resources, and the technology expertise to basically beat us in AI. And I think whoever wins this AI race, that's going to have tremendous ramifications for both our economy and our national security. Clearly, we want the US to be the winner, just like we were with the internet, and every other technology revolution before that […] We know that to win this AI race, we have to be the most innovative. You can't regulate your way just to beating your competitor. You have to out-innovate them. And we know that in the United States, the innovation comes from the private sector, not the government. So we have to do everything we can to help our companies win, to help them be innovative, and that means getting a lot of red tape out of the way… We have to have the most AI infrastructure in the US. It has to be the easiest place to build it. All of the new data centers that are going in, they require tremendous power, so getting ahead of the curve on energy, making sure we stand up all of this new infrastructure we're going to need to basically produce these AI factories… We want the US technology stack to dominate globally. We want to be the partner of choice for the whole world… I think everyone in Silicon Valley understands that the way that you win a technology race is to have the biggest ecosystem […] You just want everybody to be building on top of your technology stack, and that's what we want for the United States." David Sacks w/Marc Benioff Dreamforce
2:15

DAVID SACKS ON THE AI RACE: "The US is currently in an AI race, and our chief global competition is China, obviously. They're the only other country that has the talent, the resources, and the technology expertise to basically beat us in AI. And I think whoever wins this AI race, that's going to have tremendous ramifications for both our economy and our national security. Clearly, we want the US to be the winner, just like we were with the internet, and every other technology revolution before that […] We know that to win this AI race, we have to be the most innovative. You can't regulate your way just to beating your competitor. You have to out-innovate them. And we know that in the United States, the innovation comes from the private sector, not the government. So we have to do everything we can to help our companies win, to help them be innovative, and that means getting a lot of red tape out of the way… We have to have the most AI infrastructure in the US. It has to be the easiest place to build it. All of the new data centers that are going in, they require tremendous power, so getting ahead of the curve on energy, making sure we stand up all of this new infrastructure we're going to need to basically produce these AI factories… We want the US technology stack to dominate globally. We want to be the partner of choice for the whole world… I think everyone in Silicon Valley understands that the way that you win a technology race is to have the biggest ecosystem […] You just want everybody to be building on top of your technology stack, and that's what we want for the United States." David Sacks w/Marc Benioff Dreamforce

Ron Pragides 

231,781 views • 10 months ago

AMAZING NEWS for Geophysics reseachers!!!!! I got a wild idea, and decided to give it a try! Grok build was able to reverse engineer and build a NEW version of the old school Japanese NICT Magnetosphere / Magnetopause model which shows the Earths current magnetic environment in space! The old NICT site was shut down due to "lack of funding" after the great Japan megaquake in 2011, the service ran for a little while after the quake and then went away for good. I was able to get the old site in the wayback machine internet archive, give a link to Grok, with a little direction on where to look for the data they were using, and next then you know Grok has made a full 3D version that pulls data real time ! Now we have a basic working 3D version of the magnetopause , and soon will be coming the animations showing the data over time (we will be able to hit play and watch it bounce around !) This is next level. For real, I'm geeking out!!!!!!
6:03

AMAZING NEWS for Geophysics reseachers!!!!! I got a wild idea, and decided to give it a try! Grok build was able to reverse engineer and build a NEW version of the old school Japanese NICT Magnetosphere / Magnetopause model which shows the Earths current magnetic environment in space! The old NICT site was shut down due to "lack of funding" after the great Japan megaquake in 2011, the service ran for a little while after the quake and then went away for good. I was able to get the old site in the wayback machine internet archive, give a link to Grok, with a little direction on where to look for the data they were using, and next then you know Grok has made a full 3D version that pulls data real time ! Now we have a basic working 3D version of the magnetopause , and soon will be coming the animations showing the data over time (we will be able to hit play and watch it bounce around !) This is next level. For real, I'm geeking out!!!!!!

Dutchsinse

43,914 views • 3 days ago

We just made the Warp API and MCP completely free. Most HR platforms make you sit through a sales call and a questionnaire just to reach your own data. We think that's backwards. You can pull your entire company and employee data, time off, compensation, payroll, IT, basically anything in Warp. Build your own dashboards. Connect Warp to your internal systems. Run your own automations on top of your data. We built this because our customers are technical and AI-native. They don't want to stare at a dashboard. They want to build on top of their data. Legacy platforms silo it on purpose, and the API, when it exists at all, is a pricey add-on buried behind a sales process. We shipped the API eight weeks ago, and some of our top customers have already built real tools on top of Warp. Today we're removing the last barrier to doing that. If you're an AI-native founder, exec, CIO, or Chief People Officer who's been duct taping this together, the API and MCP are now included free on most plans. On Enterprise, a small fee unlocks the more powerful version with uptime SLAs, webhooks, and audit logs. Your data should be yours. Excited to see what you build with it.
1:23

We just made the Warp API and MCP completely free. Most HR platforms make you sit through a sales call and a questionnaire just to reach your own data. We think that's backwards. You can pull your entire company and employee data, time off, compensation, payroll, IT, basically anything in Warp. Build your own dashboards. Connect Warp to your internal systems. Run your own automations on top of your data. We built this because our customers are technical and AI-native. They don't want to stare at a dashboard. They want to build on top of their data. Legacy platforms silo it on purpose, and the API, when it exists at all, is a pricey add-on buried behind a sales process. We shipped the API eight weeks ago, and some of our top customers have already built real tools on top of Warp. Today we're removing the last barrier to doing that. If you're an AI-native founder, exec, CIO, or Chief People Officer who's been duct taping this together, the API and MCP are now included free on most plans. On Enterprise, a small fee unlocks the more powerful version with uptime SLAs, webhooks, and audit logs. Your data should be yours. Excited to see what you build with it.

Ayush S

730,614 views • 2 months ago

New PNAS paper. Historical GDP per capita data is scarce, but data on the places of birth, death, and occupations of famous individuals is abundant. In this paper we estimate the historical GDP per capita of hundreds of regions in Europe and North America using a machine learning model that leveraged data on about 500k famous biographies. Our estimates more-or-less quadruple the availability of historical GDP per capita estimates for the last 700 years. So why use biographies to augment historical GDP per capita data? Biographical data contains information about people who might have contributed directly to economic growth, like James Watt, or that were attracted to wealthy places looking for patrons, like Michelangelo. So we--mainly Philipp (Philipp Koch)--used this data to construct hundreds of features describing each European region. Then, we trained a machine learning model to find the features that explained most of the variance in a cross-validation test, where we split regions multiple times into a training set and a test set. On average, the model explained about 90% of the variance in GDP per capita of the regions it had not seen during training. But we wanted to go further, and Philipp really went to town by looking at different ways to validate our estimates. We found our estimates correlate positively with historical measures of wellbeing, church building activity, urbanization, and body height. We also used these measures to reproduce the basic Atlantic trade result of Acemoglu, Johnson, and Robison and to explore the economic consequences of the famous Lisbon earthquake of 1755. But what I personally loved most about this project, other than working with Philipp Koch and V, is that it shows that we can use machine learning methods not only to explore the future, but the past. There is a bright and growing future in the use of machine learning for economic history. Hope you enjoy the paper and the data. You can find links to the paper and a data exploration tool in the first comment.
3:25

New PNAS paper. Historical GDP per capita data is scarce, but data on the places of birth, death, and occupations of famous individuals is abundant. In this paper we estimate the historical GDP per capita of hundreds of regions in Europe and North America using a machine learning model that leveraged data on about 500k famous biographies. Our estimates more-or-less quadruple the availability of historical GDP per capita estimates for the last 700 years. So why use biographies to augment historical GDP per capita data? Biographical data contains information about people who might have contributed directly to economic growth, like James Watt, or that were attracted to wealthy places looking for patrons, like Michelangelo. So we--mainly Philipp (Philipp Koch)--used this data to construct hundreds of features describing each European region. Then, we trained a machine learning model to find the features that explained most of the variance in a cross-validation test, where we split regions multiple times into a training set and a test set. On average, the model explained about 90% of the variance in GDP per capita of the regions it had not seen during training. But we wanted to go further, and Philipp really went to town by looking at different ways to validate our estimates. We found our estimates correlate positively with historical measures of wellbeing, church building activity, urbanization, and body height. We also used these measures to reproduce the basic Atlantic trade result of Acemoglu, Johnson, and Robison and to explore the economic consequences of the famous Lisbon earthquake of 1755. But what I personally loved most about this project, other than working with Philipp Koch and V, is that it shows that we can use machine learning methods not only to explore the future, but the past. There is a bright and growing future in the use of machine learning for economic history. Hope you enjoy the paper and the data. You can find links to the paper and a data exploration tool in the first comment.

César A. Hidalgo

54,332 views • 1 year ago

We have 13B hours of player interaction on the platform monthly. This data enables us to train intelligent NPCs that can reason and interact in 3D worlds. Our training goes beyond videos of gameplay and simple WASD actions, utilizing our full data model for a more detailed representation of human interactions. Our video below shows Roblox NPCs figuring out how to build a campfire by reasoning backwards to find an axe, cut down a tree, and bring the wood to the firepit. This is still early research but we imagine a future where intelligent NPCs could play alongside real players. 4/4
0:30

We have 13B hours of player interaction on the platform monthly. This data enables us to train intelligent NPCs that can reason and interact in 3D worlds. Our training goes beyond videos of gameplay and simple WASD actions, utilizing our full data model for a more detailed representation of human interactions. Our video below shows Roblox NPCs figuring out how to build a campfire by reasoning backwards to find an axe, cut down a tree, and bring the wood to the firepit. This is still early research but we imagine a future where intelligent NPCs could play alongside real players. 4/4

Roblox

288,109 views • 6 months ago

I found Stilt's video for our Y Combinator 2016 application. The video was shot on a makeshift table (recorded on an old laptop) at my apartment in San Francisco. Priyank Singh and I were a couple of normal H-1B visa holders (prior international students) who thought a company should exist to provide better financial services for immigrants. We had no outside funding, so we started lending our money. When we applied, we had lent out $25,000 from our savings to strangers on the internet. When we ran out of our savings, we borrowed from friends. By the time we interviewed, that number had increased to $50,000. By the time we sold the company, we had originated hundreds of millions in loans to immigrants from more than 150 countries. Everything starts small. If you are interested in building a startup, just launch. Build one step at a time, and you'll get much farther than you thought you would in a short time.
1:05

I found Stilt's video for our Y Combinator 2016 application. The video was shot on a makeshift table (recorded on an old laptop) at my apartment in San Francisco. Priyank Singh and I were a couple of normal H-1B visa holders (prior international students) who thought a company should exist to provide better financial services for immigrants. We had no outside funding, so we started lending our money. When we applied, we had lent out $25,000 from our savings to strangers on the internet. When we ran out of our savings, we borrowed from friends. By the time we interviewed, that number had increased to $50,000. By the time we sold the company, we had originated hundreds of millions in loans to immigrants from more than 150 countries. Everything starts small. If you are interested in building a startup, just launch. Build one step at a time, and you'll get much farther than you thought you would in a short time.

Rohit Mittal

17,042 views • 1 year ago

Today we're launching Hebbian Robotics (YC S26) Hebbian Robotics (YC S26) . We build APIs for evaluating data quality, without training a robotics model. Data vendors use our API to search and analyze Physical AI data at scale, getting on-demand quality signals and metrics without managing infrastructure. High-quality data is the bottleneck to the next frontier of intelligence in robotics. Buyers want data they can trust. Data providers are focused on operational excellence. They don't have the bandwidth to understand the quality of their data at scale. We're fixing this. Vendors use our APIs to understand the impact of their decisions on their data quality: - Buyers demanding per-collector hour limits? Prove compliance while we stay ahead of the workarounds. - Changed your collection SOPs? Monitor for quality drift and regression. - Suspect duplicate samples? Verify with a single API call. Before Hebbian, I trained AI models for industrial cleaning robots, and kingston kuan spent years building large-scale infrastructure at Jane Street.
2:17

Today we're launching Hebbian Robotics (YC S26) Hebbian Robotics (YC S26) . We build APIs for evaluating data quality, without training a robotics model. Data vendors use our API to search and analyze Physical AI data at scale, getting on-demand quality signals and metrics without managing infrastructure. High-quality data is the bottleneck to the next frontier of intelligence in robotics. Buyers want data they can trust. Data providers are focused on operational excellence. They don't have the bandwidth to understand the quality of their data at scale. We're fixing this. Vendors use our APIs to understand the impact of their decisions on their data quality: - Buyers demanding per-collector hour limits? Prove compliance while we stay ahead of the workarounds. - Changed your collection SOPs? Monitor for quality drift and regression. - Suspect duplicate samples? Verify with a single API call. Before Hebbian, I trained AI models for industrial cleaning robots, and kingston kuan spent years building large-scale infrastructure at Jane Street.

Brandon Ong

164,057 views • 6 days ago

FRIEDBERG: VIDEO DATA WILL POWER THE NEXT GENERATION OF AI Friedberg broke down the scale shift coming to artificial intelligence, arguing that text based models like GPT are just the beginning, and that the real revolution will come from video-trained systems: “The internet and all these LLMs are language models trained on text from the internet, around 50 billion words total, maybe one to five terabytes of data in their training sets. But if you look at the video data out there, there are hundreds of billions of hours, much of it on YouTube. By some estimates, there’s a thousand exabytes of video data on the internet, about a billion times more than text data. I think we just saw that play out with the new video model that launched yesterday. Google has all this YouTube data, whether or not they’re using it to train, I don’t know. I’ve heard from insiders they’re not allowed to yet and would have to redo the terms of service.” Source: AIFinInsights david friedberg
2:12

FRIEDBERG: VIDEO DATA WILL POWER THE NEXT GENERATION OF AI Friedberg broke down the scale shift coming to artificial intelligence, arguing that text based models like GPT are just the beginning, and that the real revolution will come from video-trained systems: “The internet and all these LLMs are language models trained on text from the internet, around 50 billion words total, maybe one to five terabytes of data in their training sets. But if you look at the video data out there, there are hundreds of billions of hours, much of it on YouTube. By some estimates, there’s a thousand exabytes of video data on the internet, about a billion times more than text data. I think we just saw that play out with the new video model that launched yesterday. Google has all this YouTube data, whether or not they’re using it to train, I don’t know. I’ve heard from insiders they’re not allowed to yet and would have to redo the terms of service.” Source: AIFinInsights david friedberg

Mario Nawfal

15,855 views • 8 months ago