正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Spatial AI ( is building large real-world datasets to teach robots how to navigate the world and complete tasks. Their first open source dataset, SEA (Spatial Everyday Activities), is the largest curated egocentric dataset of people carrying out real tasks, with 10,000 hours of data.

Y Combinator

1,595,876 subscribers

20,944 次观看 • 8 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Over the Reality just hit another major milestone in the AI era. We have now surpassed 200,000 mappings in our dataset. 🎉 These are not just images. They are high-quality 3D maps generated from the mapping activity of our global community, which has produced more than 94M images of real-world locations so far. The dataset also includes 900TB+ of spatial data that can power Visual AI models, Robotics VPS for real-world navigation and positioning, XR VPS for precise spatial anchoring and AR experiences, Spatial Computing applications, Digital Twins, and the next generation of real-world AI infrastructure. In just the past 2 weeks, our dataset grew by +17,955 mapped locations. That is nearly +10% growth in just 14 days. More maps. More data. More demand for $OVR.

Over the Reality just hit another major milestone in the AI era. We have now surpassed 200,000 mappings in our dataset. 🎉 These are not just images. They are high-quality 3D maps generated from the mapping activity of our global community, which has produced more than 94M images of real-world locations so far. The dataset also includes 900TB+ of spatial data that can power Visual AI models, Robotics VPS for real-world navigation and positioning, XR VPS for precise spatial anchoring and AR experiences, Spatial Computing applications, Digital Twins, and the next generation of real-world AI infrastructure. In just the past 2 weeks, our dataset grew by +17,955 mapped locations. That is nearly +10% growth in just 14 days. More maps. More data. More demand for $OVR.

Over the Reality 🌐

926,557 次观看 • 4 个月前

A Rerun Viewer for the DROID Dataset! DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset is a robot manipulation dataset by Alexander Khazatsky et al. with 76k demonstration trajectories or 350h of interaction data, collected across 564 scenes and 86 tasks.

A Rerun Viewer for the DROID Dataset! DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset is a robot manipulation dataset by Alexander Khazatsky et al. with 76k demonstration trajectories or 350h of interaction data, collected across 564 scenes and 86 tasks.

Rerun

21,776 次观看 • 2 年前

Analyzing large vector datasets on Source Cooperative with #DuckDB 🦆Using the 75 GB National Wetlands Inventory as an example. It used to take me hours to get summary statistics of the dataset, now it takes seconds with DuckDB 🚀 Dataset: Colab: #geospatial #dataviz #opendata

Analyzing large vector datasets on Source Cooperative with #DuckDB 🦆Using the 75 GB National Wetlands Inventory as an example. It used to take me hours to get summary statistics of the dataset, now it takes seconds with DuckDB 🚀 Dataset: Colab: #geospatial #dataviz #opendata

Qiusheng Wu

13,309 次观看 • 2 年前

Figure is aiming to develop the world’s largest and most diverse real-world humanoid pretraining dataset. For this purpose, they’re partnering with Brookfield, a global asset manager overseeing $1 trillion in assets, including 100,000 residential units, 500M square feet of commercial office space, and 160M square feet of logistics space. The data collected from this collaboration will be used to train Figure’s Helix AI model, enabling humanoids to perform tasks autonomously in real-world environments designed for humans. In addition to data collection, the partnership will explore support for next-generation GPU data centers, real estate for robotic training environments, and commercial use cases across Brookfield’s global footprint.

Figure is aiming to develop the world’s largest and most diverse real-world humanoid pretraining dataset. For this purpose, they’re partnering with Brookfield, a global asset manager overseeing $1 trillion in assets, including 100,000 residential units, 500M square feet of commercial office space, and 160M square feet of logistics space. The data collected from this collaboration will be used to train Figure’s Helix AI model, enabling humanoids to perform tasks autonomously in real-world environments designed for humans. In addition to data collection, the partnership will explore support for next-generation GPU data centers, real estate for robotic training environments, and commercial use cases across Brookfield’s global footprint.

The Humanoid Hub

88,600 次观看 • 10 个月前

Today, we're launching the world's largest open-source dataset of computer-use recordings. 10,000+ hours across Salesforce, Blender, Photoshop and more, to automate the next level of white-collar work. Link in the comments :) Markov

Today, we're launching the world's largest open-source dataset of computer-use recordings. 10,000+ hours across Salesforce, Blender, Photoshop and more, to automate the next level of white-collar work. Link in the comments :) Markov

Dev

471,772 次观看 • 4 个月前

The largest open-source humanoid teleop dataset, 10+ TB collected from real homes, is now available to everyone. Proud to support BitRobot 🦾's journey in pushing real robotics to the frontier at Virtuals Protocol.

The largest open-source humanoid teleop dataset, 10+ TB collected from real homes, is now available to everyone. Proud to support BitRobot 🦾's journey in pushing real robotics to the frontier at Virtuals Protocol.

Virtuals Protocol

30,932 次观看 • 1 个月前

SuperMap: A Living Spatial Memory for Embodied AI RSS 2026 Carnegie Mellon University SuperMap is a living spatial memory for embodied AI. It perceives the world, remembers its evolution, and supports reasoning and action. It is a training-free spatio-temporal SLAM system that builds a persistent semantic world model. It fuses high-frequency geometric SLAM with asynchronous open-vocabulary perception, producing a 4D scene graph: a queryable map carrying spatial and temporal information for every object, enabling visual-language navigation and long-horizon reasoning on real robots.

SuperMap: A Living Spatial Memory for Embodied AI RSS 2026 Carnegie Mellon University SuperMap is a living spatial memory for embodied AI. It perceives the world, remembers its evolution, and supports reasoning and action. It is a training-free spatio-temporal SLAM system that builds a persistent semantic world model. It fuses high-frequency geometric SLAM with asynchronous open-vocabulary perception, producing a 4D scene graph: a queryable map carrying spatial and temporal information for every object, enabling visual-language navigation and long-horizon reasoning on real robots.

Ryohei Sasaki@engineer

22,639 次观看 • 3 天前

How can robots reliably place objects in diverse real-world tasks? 🤖🔍 Placement is tough—objects vary in shape and placement modes (such as stacking, hanging, and insertion), making it a challenging problem. We introduce AnyPlace, a two-stage method trained purely on synthetic data to predict diverse placement poses of unseen objects for real-world tasks. Read on for more👇

How can robots reliably place objects in diverse real-world tasks? 🤖🔍 Placement is tough—objects vary in shape and placement modes (such as stacking, hanging, and insertion), making it a challenging problem. We introduce AnyPlace, a two-stage method trained purely on synthetic data to predict diverse placement poses of unseen objects for real-world tasks. Read on for more👇

Animesh Garg

25,378 次观看 • 1 年前

🚀 Introducing EgoExo Forge - built on top of Rerun, Gradio, and Hugging Face hub (I’ll be in San Francisco July 21–29 — if you’re into robotics, egocentric AI, large-scale data collection, or just want to chat, DM me!) In my opinion, large-scale, diverse, and high-quality data is still the largest bottleneck for generalized robotics deployment. I believe that some version of imitation learning from human examples will be the most scalable + clean way to train humanoid robots 🤖 (similar to what Tesla did for Full Self Driving). Teleop is too expensive to collect a large enough dataset in a reasonable manner, so passive collection via egocentric (and in certain cases, exocentric) views feels like the right bet. Over the past few months, I've been trying to build out the scaffolding for this and using Rerun as my underlying infrastructure. Data being collected needs to be easily inspectable + time series and rerun provides the right tooling for this. My goal is to first build out a ground truth representative dataset from already existing open source data, generate some reasonable baselines, and then go out and collect my own data that adheres to the defined schema. 🔍 Starting with open-source datasets 1. EgoDex from Apple 2. HOCap from Nvidia and the University of Texas at Dallas 3. Assembly101 from Meta All these different datasets have different sensor configurations + annotations, so my goal with egoexo-forge is to have one consistent labeling scheme + data layout. I built a data pipeline that aligns all of the different datasets in one general schema assuming the COCO133 keypoint layout that allows for exo+ego, ego only, or exo only Since the scaffolding is already there, it becomes MUCH easier to add other datasets. So the next ones that I'll be including are HD-EPIC kitchens dataset, HOT3D, and finally my own personal iPhone + insta360 go collection method. Once I have a diverse variety of datasets, I'll double down on what I believe to be the key algorithms required to make useful data for imitation learning 📊 1. Camera Pose estimation via SLAM/SFM for ego perspective (and automatic calibration for exo) 2. Human pose estimation for both egocentric + exocentric views 3. Metric 3D reconstruction + object tracking I'll be setting up reasonable open-source baselines for each of these to validate that these datasets work, and then finally try to use the generated datasets for some imitation learning via the pi0-lerobot repo I've been working on. I plan on making a blog post + providing more info on all of this in the near future so stay tuned

🚀 Introducing EgoExo Forge - built on top of Rerun, Gradio, and Hugging Face hub (I’ll be in San Francisco July 21–29 — if you’re into robotics, egocentric AI, large-scale data collection, or just want to chat, DM me!) In my opinion, large-scale, diverse, and high-quality data is still the largest bottleneck for generalized robotics deployment. I believe that some version of imitation learning from human examples will be the most scalable + clean way to train humanoid robots 🤖 (similar to what Tesla did for Full Self Driving). Teleop is too expensive to collect a large enough dataset in a reasonable manner, so passive collection via egocentric (and in certain cases, exocentric) views feels like the right bet. Over the past few months, I've been trying to build out the scaffolding for this and using Rerun as my underlying infrastructure. Data being collected needs to be easily inspectable + time series and rerun provides the right tooling for this. My goal is to first build out a ground truth representative dataset from already existing open source data, generate some reasonable baselines, and then go out and collect my own data that adheres to the defined schema. 🔍 Starting with open-source datasets 1. EgoDex from Apple 2. HOCap from Nvidia and the University of Texas at Dallas 3. Assembly101 from Meta All these different datasets have different sensor configurations + annotations, so my goal with egoexo-forge is to have one consistent labeling scheme + data layout. I built a data pipeline that aligns all of the different datasets in one general schema assuming the COCO133 keypoint layout that allows for exo+ego, ego only, or exo only Since the scaffolding is already there, it becomes MUCH easier to add other datasets. So the next ones that I'll be including are HD-EPIC kitchens dataset, HOT3D, and finally my own personal iPhone + insta360 go collection method. Once I have a diverse variety of datasets, I'll double down on what I believe to be the key algorithms required to make useful data for imitation learning 📊 1. Camera Pose estimation via SLAM/SFM for ego perspective (and automatic calibration for exo) 2. Human pose estimation for both egocentric + exocentric views 3. Metric 3D reconstruction + object tracking I'll be setting up reasonable open-source baselines for each of these to validate that these datasets work, and then finally try to use the generated datasets for some imitation learning via the pi0-lerobot repo I've been working on. I plan on making a blog post + providing more info on all of this in the near future so stay tuned

Pablo Vela

32,085 次观看 • 1 年前

We are proud to announce our first contribution to open source Computer Vision research! 🚀 Today, we’re publishing on Hugging Face a 1,000 3D Maps Dataset under CC-BY-NC license, designed to accelerate progress in 3D perception and spatial AI. Our way to give back to the global AI community and show how DePIN can make an impact. 🧵 👉

We are proud to announce our first contribution to open source Computer Vision research! 🚀 Today, we’re publishing on Hugging Face a 1,000 3D Maps Dataset under CC-BY-NC license, designed to accelerate progress in 3D perception and spatial AI. Our way to give back to the global AI community and show how DePIN can make an impact. 🧵 👉

Over the Reality 🌐

88,633 次观看 • 8 个月前

💰 The payroll market is going real-time. From large enterprise to everyday families — Zebec is changing how the world gets paid. ⛵️ Learn how:

💰 The payroll market is going real-time. From large enterprise to everyday families — Zebec is changing how the world gets paid. ⛵️ Learn how:

Zebec Network

156,135 次观看 • 1 年前

We’re building the first real AI + on-chain product suite on Keeta Network and early users own a piece of it. We’re giving 5% of $KTAI to the community via our Founders Airdrop. Complete tasks. Refer friends. Climb the leaderboard. → Let the race begin.

We’re building the first real AI + on-chain product suite on Keeta Network and early users own a piece of it. We’re giving 5% of $KTAI to the community via our Founders Airdrop. Complete tasks. Refer friends. Climb the leaderboard. → Let the race begin.

KeetaAI

22,677 次观看 • 1 年前

Big congrats to the whole team at Giza for the release their new product Giza World. I was given the opportunity to turn their dataset of more than 16.000 active agents, performing more than 800.000 transactions, into a living data sculpture. Kind of mind-blowing to experience the end result, knowing that each movement of each individual particle is backed by real, on-chain, transactions.

Big congrats to the whole team at Giza for the release their new product Giza World. I was given the opportunity to turn their dataset of more than 16.000 active agents, performing more than 800.000 transactions, into a living data sculpture. Kind of mind-blowing to experience the end result, knowing that each movement of each individual particle is backed by real, on-chain, transactions.

𝕭𝖏ø𝖗𝖓 𝕾𝖙𝖆𝖆𝖑

114,112 次观看 • 5 个月前

Today we’re releasing SAIR, the Structurally Augmented IC50 Repository. SAIR is the Largest Open-Sourced Binding Affinity Dataset with Cofolded 3D Structures. It includes more than 5 million protein-ligand structures, generated using our Large Quantitative Models and labeled with binding affinity data. By providing this unprecedented scale of structure-activity data, we aim to enable researchers to train and evaluate new AI models for drug discovery, bridging the historical gap between molecular structures and drug potency prediction. The SAIR dataset was created using the NVIDIA DGX Cloud and is now publicly available on the Google Cloud Platform. Access and build with SAIR today! 📰Read the Press Release: 📥Learn More and Download the Dataset at #DrugDiscovery #LQMs #SAIR #AIforScience #SandboxAQ

Today we’re releasing SAIR, the Structurally Augmented IC50 Repository. SAIR is the Largest Open-Sourced Binding Affinity Dataset with Cofolded 3D Structures. It includes more than 5 million protein-ligand structures, generated using our Large Quantitative Models and labeled with binding affinity data. By providing this unprecedented scale of structure-activity data, we aim to enable researchers to train and evaluate new AI models for drug discovery, bridging the historical gap between molecular structures and drug potency prediction. The SAIR dataset was created using the NVIDIA DGX Cloud and is now publicly available on the Google Cloud Platform. Access and build with SAIR today! 📰Read the Press Release: 📥Learn More and Download the Dataset at #DrugDiscovery #LQMs #SAIR #AIforScience #SandboxAQ

SandboxAQ

129,416 次观看 • 1 年前

How can we address the scarcity of data required for specialized AI? Learn about Simula, a framework that reframes synthetic data generation as dataset-level mechanism design. By using reasoning to architect datasets from first principles, Simula enables fine-grained control over coverage, complexity, and quality. More →

How can we address the scarcity of data required for specialized AI? Learn about Simula, a framework that reframes synthetic data generation as dataset-level mechanism design. By using reasoning to architect datasets from first principles, Simula enables fine-grained control over coverage, complexity, and quality. More →

Google Research

142,546 次观看 • 3 个月前

AI is giving you more control than ever to cosplay as an artist. Move the flesh ball and black box in the void, show the world how creative the stolen work in the dataset is.

AI is giving you more control than ever to cosplay as an artist. Move the flesh ball and black box in the void, show the world how creative the stolen work in the dataset is.

Reid Southen

325,397 次观看 • 2 年前