Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

The first global, city-scale 3D map is taking shape, and it’s machine-readable. City-scale environments can now be reconstructed in high-fidelity, reaching a level of detail that is becoming almost indistinguishable from reality. This leap is made possible by large-scale mapping using just an Insta360 X5 and Over the Reality... show more

Over the Reality 🌐

91,495 subscribers

69,605 Aufrufe • vor 3 Monaten •via X (Twitter)

Bildung Nachrichten & Politik Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

America. Europe. Africa. Asia. Oceania. More than 250,000 real-world locations across 120+ countries have already been transformed into ultra high quality 3D Gaussian Splats by Over the Reality. From city centers and museums to beaches, mountains, and historical landmarks, every mapping created by our community contributes to a growing machine-readable representation of the physical world. This scene started as a simple Insta360 X5 recording and was transformed into a digital twin, where geometry, textures, and spatial structure are preserved and can be used by AI, Robotics, VPS, XR, and next-generation world models. This is what city-scale 3D mapping looks like. The link to become an Insta360 X5 mapper is in the first comment. 👇

America. Europe. Africa. Asia. Oceania. More than 250,000 real-world locations across 120+ countries have already been transformed into ultra high quality 3D Gaussian Splats by Over the Reality. From city centers and museums to beaches, mountains, and historical landmarks, every mapping created by our community contributes to a growing machine-readable representation of the physical world. This scene started as a simple Insta360 X5 recording and was transformed into a digital twin, where geometry, textures, and spatial structure are preserved and can be used by AI, Robotics, VPS, XR, and next-generation world models. This is what city-scale 3D mapping looks like. The link to become an Insta360 X5 mapper is in the first comment. 👇

Over the Reality 🌐

19,030 Aufrufe • vor 26 Tagen

Another city. Another full 3D Gaussian Splat reconstruction. This entire neighborhood was captured while walking with an Insta360 X5, then processed with our GPU pipeline and transformed into a high-fidelity, machine-readable 3D environment with Over the Reality. What you’re seeing is not an isolated virtual world. It’s a 3D digital twin of a real-world location, built from structured spatial data where every building, street, and detail can become usable by AI, robotics, and XR. And it’s happening at scale, across cities in more than 180 countries every day. Have an Insta360 X5 and want to become a mapper? Apply here: Want to build a 3D Gaussian Splat from a video you already recorded? Do it for free at powered by Over the Reality.

Another city. Another full 3D Gaussian Splat reconstruction. This entire neighborhood was captured while walking with an Insta360 X5, then processed with our GPU pipeline and transformed into a high-fidelity, machine-readable 3D environment with Over the Reality. What you’re seeing is not an isolated virtual world. It’s a 3D digital twin of a real-world location, built from structured spatial data where every building, street, and detail can become usable by AI, robotics, and XR. And it’s happening at scale, across cities in more than 180 countries every day. Have an Insta360 X5 and want to become a mapper? Apply here: Want to build a 3D Gaussian Splat from a video you already recorded? Do it for free at powered by Over the Reality.

Over the Reality 🌐

400,097 Aufrufe • vor 2 Monaten

Have you ever seen a robot walk along a waterfront, understand its surroundings, and look out at the sea? 🤖 Thanks to Over the Reality, this is possible. Places like this are mapped every day by our global community of 360 mappers. Using our technology, they are transformed into high-fidelity machine-readable 3D Gaussian Splats. This data can be used to: • navigate robots through the physical world • train AI and Visual Models • power VPS localization • anchor persistent XR content to real-world locations This is just one of more than 250,000 real-world locations already mapped by the Over the Reality community. And unlike traditional datasets, these places can be explored directly through a smartphone, browser, or XR headset, allowing anyone to navigate and experience them in first person. From city streets and waterfronts to landmarks and cultural sites, we're building one of the world's largest machine-readable maps for AI, robotics, and spatial computing.

Have you ever seen a robot walk along a waterfront, understand its surroundings, and look out at the sea? 🤖 Thanks to Over the Reality, this is possible. Places like this are mapped every day by our global community of 360 mappers. Using our technology, they are transformed into high-fidelity machine-readable 3D Gaussian Splats. This data can be used to: • navigate robots through the physical world • train AI and Visual Models • power VPS localization • anchor persistent XR content to real-world locations This is just one of more than 250,000 real-world locations already mapped by the Over the Reality community. And unlike traditional datasets, these places can be explored directly through a smartphone, browser, or XR headset, allowing anyone to navigate and experience them in first person. From city streets and waterfronts to landmarks and cultural sites, we're building one of the world's largest machine-readable maps for AI, robotics, and spatial computing.

Over the Reality 🌐

31,824 Aufrufe • vor 1 Monat

Large-scale Gaussian splats have reached a new level of realism. This is a well-known temple in Bangkok, reconstructed as a high-fidelity 3D environment from 360 captures. At this level, the boundary between video and 3D starts to disappear. But what you’re looking at is not a video. It’s a dense spatial representation of a real place, where geometry, texture, and structure are preserved and made machine-readable. This kind of 3D data can power Visual AI, Robotics navigation, VPS localization, XR experiences, world models, and next-generation spatial computing systems. Built with Over the Reality.

Large-scale Gaussian splats have reached a new level of realism. This is a well-known temple in Bangkok, reconstructed as a high-fidelity 3D environment from 360 captures. At this level, the boundary between video and 3D starts to disappear. But what you’re looking at is not a video. It’s a dense spatial representation of a real place, where geometry, texture, and structure are preserved and made machine-readable. This kind of 3D data can power Visual AI, Robotics navigation, VPS localization, XR experiences, world models, and next-generation spatial computing systems. Built with Over the Reality.

Over the Reality 🌐

347,044 Aufrufe • vor 1 Monat

Mapping with Over the Reality is now powered not only by smartphones, but also by Insta360 X5. If you own an Insta360 X5 and want to be part of it: 👉 Apply here: With 360 capture, contributors can cover significantly larger areas in a single session, turning daily walks into true city level mapping and building 3D infrastructure for AI, XR, and Robotics. Rewards are active, and we’re opening the Insta360 X5 Alpha Mapper Program to early contributors.

Mapping with Over the Reality is now powered not only by smartphones, but also by Insta360 X5. If you own an Insta360 X5 and want to be part of it: 👉 Apply here: With 360 capture, contributors can cover significantly larger areas in a single session, turning daily walks into true city level mapping and building 3D infrastructure for AI, XR, and Robotics. Rewards are active, and we’re opening the Insta360 X5 Alpha Mapper Program to early contributors.

Over the Reality 🌐

343,017 Aufrufe • vor 4 Monaten

Introducing WorldView 3D, a first-of-its-kind satellite tasking product that delivers up-to-date 3D ground truth anywhere on Earth. From GPS-denied autonomy and intelligence analysis to consumer-grade mapping and disaster response, the world's most important missions increasingly depend on accurate, up-to-date 3D terrain. But for years, keeping 3D maps current at global scale hasn't been possible. WorldView 3D changes that. Built on Vantor’s trusted spatial foundation, our new tasking capability empowers customers to task and receive updated 3D data within 24 hours of image collection. For missions that require greater fidelity, they can also produce high-definition 3D maps anywhere in the world. 3D is the future of spatial intelligence, and Vantor is leading the change. Our trusted spatial foundation already includes 100 million sq km of the world mapped inhighly accurate 3D. Now customers can update the locations that matter most with the speed, scale, and fidelity required for critical missions. Read the full announcement:

Introducing WorldView 3D, a first-of-its-kind satellite tasking product that delivers up-to-date 3D ground truth anywhere on Earth. From GPS-denied autonomy and intelligence analysis to consumer-grade mapping and disaster response, the world's most important missions increasingly depend on accurate, up-to-date 3D terrain. But for years, keeping 3D maps current at global scale hasn't been possible. WorldView 3D changes that. Built on Vantor’s trusted spatial foundation, our new tasking capability empowers customers to task and receive updated 3D data within 24 hours of image collection. For missions that require greater fidelity, they can also produce high-definition 3D maps anywhere in the world. 3D is the future of spatial intelligence, and Vantor is leading the change. Our trusted spatial foundation already includes 100 million sq km of the world mapped inhighly accurate 3D. Now customers can update the locations that matter most with the speed, scale, and fidelity required for critical missions. Read the full announcement:

Vantor

15,434 Aufrufe • vor 14 Tagen

A museum in France. Accessible from anywhere in the world. One of our mappers captured the Musée Archéologique du Val-d'Oise, home to more than 35,000 archaeological artifacts and over 3,000 objects on display. Using an Insta360 X5 and Over the Reality's reconstruction technology, the entire museum, including its multiple floors, has been transformed into a high-fidelity 3D Gaussian Splat and digital twin. This means anyone can now explore the museum remotely, walk through its galleries, move across different floors, and experience the space as if they were there in person. What was once a physical location is now a machine-readable 3D environment, preserved digitally and accessible through a browser, smartphone, or XR headset. From museums and cultural landmarks to entire cities, Over the Reality has built the largest 3D map of the world. The link to explore the experience remotely is available in the first comment.

A museum in France. Accessible from anywhere in the world. One of our mappers captured the Musée Archéologique du Val-d'Oise, home to more than 35,000 archaeological artifacts and over 3,000 objects on display. Using an Insta360 X5 and Over the Reality's reconstruction technology, the entire museum, including its multiple floors, has been transformed into a high-fidelity 3D Gaussian Splat and digital twin. This means anyone can now explore the museum remotely, walk through its galleries, move across different floors, and experience the space as if they were there in person. What was once a physical location is now a machine-readable 3D environment, preserved digitally and accessible through a browser, smartphone, or XR headset. From museums and cultural landmarks to entire cities, Over the Reality has built the largest 3D map of the world. The link to explore the experience remotely is available in the first comment.

Over the Reality 🌐

27,224 Aufrufe • vor 1 Monat

People are just realizing something important. One of the largest real-world visual datasets for AI was built by millions of users… without them even knowing it. At Over the Reality, we believe this should work differently. We are building a global 3D map of the world through a community that maps real places on purpose, and gets rewarded for every meaningful contribution. People helping build the global 3D map of the world can earn from $1 to $3 for each location mapped with a smartphone, or up to $18 per hour using an Insta360 X5. Apply here:

People are just realizing something important. One of the largest real-world visual datasets for AI was built by millions of users… without them even knowing it. At Over the Reality, we believe this should work differently. We are building a global 3D map of the world through a community that maps real places on purpose, and gets rewarded for every meaningful contribution. People helping build the global 3D map of the world can earn from $1 to $3 for each location mapped with a smartphone, or up to $18 per hour using an Insta360 X5. Apply here:

Over the Reality 🌐

288,789 Aufrufe • vor 3 Monaten

Robots are gaining spatial awareness with Over the Reality. 🤖 Powered by the world’s largest 3D dataset, we enable robots to see, sense, and collaborate in real-world environments. This early test shows how a Unitree Go2 perceives its surroundings through OVER’s VPS — on the right, the real life robot; on the left, its real-time perception of the position inside one of OVER’s 3D maps. Robotic spatial awareness is here, living in 155,000+ mapped locations and expanding every day. One step closer to Physical AI. Stay tuned for our upcoming ROS 2 integration, unlocking a universal framework for robotic perception leveraging OVER's infrastructure!

Robots are gaining spatial awareness with Over the Reality. 🤖 Powered by the world’s largest 3D dataset, we enable robots to see, sense, and collaborate in real-world environments. This early test shows how a Unitree Go2 perceives its surroundings through OVER’s VPS — on the right, the real life robot; on the left, its real-time perception of the position inside one of OVER’s 3D maps. Robotic spatial awareness is here, living in 155,000+ mapped locations and expanding every day. One step closer to Physical AI. Stay tuned for our upcoming ROS 2 integration, unlocking a universal framework for robotic perception leveraging OVER's infrastructure!

Over the Reality 🌐

263,818 Aufrufe • vor 9 Monaten

The physical world is becoming a new digital layer for Robotics, AI, and XR. With Over the Reality, you can help build it. Every place you visit can become a 3D map that powers this new infrastructure, simply by scanning it with your phone. And every location you map unlocks rewards, turning your daily walks into earnings or vouchers you can use everyday. It’s free to start. Comment “map” and we’ll send you access.

The physical world is becoming a new digital layer for Robotics, AI, and XR. With Over the Reality, you can help build it. Every place you visit can become a 3D map that powers this new infrastructure, simply by scanning it with your phone. And every location you map unlocks rewards, turning your daily walks into earnings or vouchers you can use everyday. It’s free to start. Comment “map” and we’ll send you access.

Over the Reality 🌐

379,791 Aufrufe • vor 3 Monaten

.Polymath is training world generation models to automate the creation of RL environments. Traditionally, RL environment generation has been bottlenecked by human data. Superintelligence will never be achieved by human data alone. Polymath is building the core technology to enable automated environment generation using far less human effort than traditionally required, and eventually none. This allows for more complex and realistic worlds, and higher quality, scale, and diversity of tasks. This will be essential to unlock RL scaling. The end goal is to create large-scale, long-horizon environments from a text description alone. This will enable the creation of worlds of arbitrary complexity and scale, which is foundational for training & evaluating autonomous, superintelligent AI agents. Congrats on the launch, Dylan Ma and Naren Yenuganti!

.Polymath is training world generation models to automate the creation of RL environments. Traditionally, RL environment generation has been bottlenecked by human data. Superintelligence will never be achieved by human data alone. Polymath is building the core technology to enable automated environment generation using far less human effort than traditionally required, and eventually none. This allows for more complex and realistic worlds, and higher quality, scale, and diversity of tasks. This will be essential to unlock RL scaling. The end goal is to create large-scale, long-horizon environments from a text description alone. This will enable the creation of worlds of arbitrary complexity and scale, which is foundational for training & evaluating autonomous, superintelligent AI agents. Congrats on the launch, Dylan Ma and Naren Yenuganti!

Y Combinator

44,192 Aufrufe • vor 4 Monaten

Scaling 3D scene data is a long-standing challenge in scene understanding, spatial reasoning, and robotics. Since scanning, reconstruction, and labeling are so labor-intensive, data scarcity has remained a major bottleneck. 🛑 To solve this, we propose SceneVerse++: Lifting Unlabeled Internet-level Data for 3D Scene Understanding (CVPR 2026). By reconstructing internet videos and annotating 3D scenes automatically, we’ve created a massive real-world dataset for end-to-end understanding. 🌐📐 SceneVerse++ makes it easy to scale "in-the-wild" 3D scenes toward more capable spatial reasoning systems. This significantly promotes progress in 3D VQA, visual navigation, and broader tasks in Embodied AI and Robotics. 🤖🦾 We are fully open-sourced! Check out the paper, code, and data here: 🌐 Project: 📄 Paper: 📊 Dataset: Code:

Scaling 3D scene data is a long-standing challenge in scene understanding, spatial reasoning, and robotics. Since scanning, reconstruction, and labeling are so labor-intensive, data scarcity has remained a major bottleneck. 🛑 To solve this, we propose SceneVerse++: Lifting Unlabeled Internet-level Data for 3D Scene Understanding (CVPR 2026). By reconstructing internet videos and annotating 3D scenes automatically, we’ve created a massive real-world dataset for end-to-end understanding. 🌐📐 SceneVerse++ makes it easy to scale "in-the-wild" 3D scenes toward more capable spatial reasoning systems. This significantly promotes progress in 3D VQA, visual navigation, and broader tasks in Embodied AI and Robotics. 🤖🦾 We are fully open-sourced! Check out the paper, code, and data here: 🌐 Project: 📄 Paper: 📊 Dataset: Code:

Siyuan Huang

12,612 Aufrufe • vor 2 Monaten

🇪🇺 Today it has been all about demos, and yes, our indoor navigation is finally live. We scanned and mapped the UnitedXR venue with centimetre-level precision. Key elements: 🔹 Digital Twins as enabling technology for Smart Cities 🔹 Visual Positioning Systems (VPS) 🔹 Accessibility and inclusivity as core design principles The future of Smart Cities is being built by you, one map at a time. Tomorrow: important meetings that will shape future European projects 🇪🇺.

🇪🇺 Today it has been all about demos, and yes, our indoor navigation is finally live. We scanned and mapped the UnitedXR venue with centimetre-level precision. Key elements: 🔹 Digital Twins as enabling technology for Smart Cities 🔹 Visual Positioning Systems (VPS) 🔹 Accessibility and inclusivity as core design principles The future of Smart Cities is being built by you, one map at a time. Tomorrow: important meetings that will shape future European projects 🇪🇺.

Over the Reality 🌐

32,133 Aufrufe • vor 7 Monaten

Excited to share this demo from Over the Reality! Watch our Unitree Go2 robodog navigating our office while reconstructing the 3D space in real-time using the VGGT-based foundation vision model. This is a prime example of machine perception in action, turning raw RGB camera feeds into rich, detailed 3D maps! The robodog's RGB cam generates a dense, textured 3D reconstruction via VGGT from a few photograms, capturing nuances like object shapes and surfaces with impressive fidelity (main view). Compare that to the standard LiDAR system (top right), it's sparser, more point-cloud focused, lacking the visual richness. Vision models are closing the gap fast! What's powering this? VGGT, a cutting-edge foundation model for 3D perception, trained on datasets orders of magnitude smaller than our massive OVER 3D maps dataset. Imagine the leap when we apply OVER's scale to VGGT-like transformer based architectures, denser reconstructions, better generalization, revolutionary for robotics, machine perception & AR! Stay tuned for more breakthroughs at the intersection of AI, robotics, and DePIN. We're building the future of Physical AI and Spatial Computing at Over the Reality 🌐 What do you think, ready for robodogs in your world? Drop your thoughts! 🤖🌐

Excited to share this demo from Over the Reality! Watch our Unitree Go2 robodog navigating our office while reconstructing the 3D space in real-time using the VGGT-based foundation vision model. This is a prime example of machine perception in action, turning raw RGB camera feeds into rich, detailed 3D maps! The robodog's RGB cam generates a dense, textured 3D reconstruction via VGGT from a few photograms, capturing nuances like object shapes and surfaces with impressive fidelity (main view). Compare that to the standard LiDAR system (top right), it's sparser, more point-cloud focused, lacking the visual richness. Vision models are closing the gap fast! What's powering this? VGGT, a cutting-edge foundation model for 3D perception, trained on datasets orders of magnitude smaller than our massive OVER 3D maps dataset. Imagine the leap when we apply OVER's scale to VGGT-like transformer based architectures, denser reconstructions, better generalization, revolutionary for robotics, machine perception & AR! Stay tuned for more breakthroughs at the intersection of AI, robotics, and DePIN. We're building the future of Physical AI and Spatial Computing at Over the Reality 🌐 What do you think, ready for robodogs in your world? Drop your thoughts! 🤖🌐

Over the Reality 🌐

359,647 Aufrufe • vor 10 Monaten

Big news from OVER! 🚀 We're expanding our Visual Positioning System (VPS) globally integrating open datasets from Mapillary & Panoramax. Precise AR re-localization everywhere. Yes, EVERYWHERE! 🗺️ Mapillary & panoramax offer over 2 BILLION geolocalized images under CC-BY-SA license. Mapillary (recently acquired by Meta) covers the globe, while Panoramax specializes in France. These datasets beautifully complement OVER's community-driven OVRMaps. While they're less dense (about 1-2 orders sparser), their scale is massive. Check out Mapillary’s global coverage here: But leveraging such sparse, varied data isn't easy—think limited overlap, camera distortion, and no metric scaling. Yet, we've cracked the code! 💡 Our recent breakthroughs combining our VPS pipeline with cutting-edge Large Geospatial Models (LGMs) allow us to build accurate 3D digital twins and offer reliable VPS services using these sparse datasets. 📍 Accuracy might be lower than our detailed community maps, but it still blows GPS out of the water! This is HUGE for OVER. It means we’re extending our coverage WAY beyond the 110,000+ locations already mapped by our community. Web3 DePIN + Open Source beats Web2 giants like Niantic! And that's not all—we're also unlocking exciting new possibilities soon: 1️⃣ Faster and easier mapping through our Map2Earn program using 360-degree camera integration. 2️⃣ Integrating datasets from new DePIN partners—like our recent partnership with NATIX Network the OVER ecosystem. Stay tuned! The future of AR Spatial Computing and decentralized mapping is here, and it's open, collaborative, and unstoppable!

Big news from OVER! 🚀 We're expanding our Visual Positioning System (VPS) globally integrating open datasets from Mapillary & Panoramax. Precise AR re-localization everywhere. Yes, EVERYWHERE! 🗺️ Mapillary & panoramax offer over 2 BILLION geolocalized images under CC-BY-SA license. Mapillary (recently acquired by Meta) covers the globe, while Panoramax specializes in France. These datasets beautifully complement OVER's community-driven OVRMaps. While they're less dense (about 1-2 orders sparser), their scale is massive. Check out Mapillary’s global coverage here: But leveraging such sparse, varied data isn't easy—think limited overlap, camera distortion, and no metric scaling. Yet, we've cracked the code! 💡 Our recent breakthroughs combining our VPS pipeline with cutting-edge Large Geospatial Models (LGMs) allow us to build accurate 3D digital twins and offer reliable VPS services using these sparse datasets. 📍 Accuracy might be lower than our detailed community maps, but it still blows GPS out of the water! This is HUGE for OVER. It means we’re extending our coverage WAY beyond the 110,000+ locations already mapped by our community. Web3 DePIN + Open Source beats Web2 giants like Niantic! And that's not all—we're also unlocking exciting new possibilities soon: 1️⃣ Faster and easier mapping through our Map2Earn program using 360-degree camera integration. 2️⃣ Integrating datasets from new DePIN partners—like our recent partnership with NATIX Network the OVER ecosystem. Stay tuned! The future of AR Spatial Computing and decentralized mapping is here, and it's open, collaborative, and unstoppable!

Over the Reality 🌐

1,313,342 Aufrufe • vor 1 Jahr

PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Tracking paper page: introduce PointOdyssey, a large-scale synthetic dataset, and data generation framework, for the training and evaluation of long-term fine-grained tracking algorithms. Our goal is to advance the state-of-the-art by placing emphasis on long videos with naturalistic motion. Toward the goal of naturalism, we animate deformable characters using real-world motion capture data, we build 3D scenes to match the motion capture environments, and we render camera viewpoints using trajectories mined via structure-from-motion on real videos. We create combinatorial diversity by randomizing character appearance, motion profiles, materials, lighting, 3D assets, and atmospheric effects. Our dataset currently includes 104 videos, averaging 2,000 frames long, with orders of magnitude more correspondence annotations than prior work. We show that existing methods can be trained from scratch in our dataset and outperform the published variants. Finally, we introduce modifications to the PIPs point tracking method, greatly widening its temporal receptive field, which improves its performance on PointOdyssey as well as on two real-world benchmarks.

PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Tracking paper page: introduce PointOdyssey, a large-scale synthetic dataset, and data generation framework, for the training and evaluation of long-term fine-grained tracking algorithms. Our goal is to advance the state-of-the-art by placing emphasis on long videos with naturalistic motion. Toward the goal of naturalism, we animate deformable characters using real-world motion capture data, we build 3D scenes to match the motion capture environments, and we render camera viewpoints using trajectories mined via structure-from-motion on real videos. We create combinatorial diversity by randomizing character appearance, motion profiles, materials, lighting, 3D assets, and atmospheric effects. Our dataset currently includes 104 videos, averaging 2,000 frames long, with orders of magnitude more correspondence annotations than prior work. We show that existing methods can be trained from scratch in our dataset and outperform the published variants. Finally, we introduce modifications to the PIPs point tracking method, greatly widening its temporal receptive field, which improves its performance on PointOdyssey as well as on two real-world benchmarks.

AK

122,533 Aufrufe • vor 2 Jahren

POKÉMON GO PLAYERS TRAINED 30 BILLION IMAGE AI MAP Niantic says photos and scans collected through Pokémon Go and its AR apps have produced a massive dataset of more than 30 billion real-world images. The company is now using that data to power visual navigation for delivery robots, letting them identify exact locations on city streets without relying on GPS. Source: NewsForce

POKÉMON GO PLAYERS TRAINED 30 BILLION IMAGE AI MAP Niantic says photos and scans collected through Pokémon Go and its AR apps have produced a massive dataset of more than 30 billion real-world images. The company is now using that data to power visual navigation for delivery robots, letting them identify exact locations on city streets without relying on GPS. Source: NewsForce

NewsForce

23,654,903 Aufrufe • vor 4 Monaten

The infrastructure for working with video data at scale barely exists. Grass Video Search is our first step in changing that. You can now find anything in a video based on the contents of its frames, not just transcripts or tags. Over the last several months, the Grass Foundation has quietly assembled one of the largest video datasets in history: over a billion videos from across the public web, and is segmenting them by scene with VLM annotations of keyframes. This dataset is now searchable, so you can find the exact moment a visual, pattern, or concept appears. Curation has always been the bottleneck in video analysis. We built a system that automates it. This is just the beginning. Over 4 billion additional videos are queued for processing, and the index is growing daily. We’re opening access to a limited set of collaborators. If you’re a researcher, journalist, or nonprofit working with video, archives, or large-scale analysis, we’d love to hear from you.

The infrastructure for working with video data at scale barely exists. Grass Video Search is our first step in changing that. You can now find anything in a video based on the contents of its frames, not just transcripts or tags. Over the last several months, the Grass Foundation has quietly assembled one of the largest video datasets in history: over a billion videos from across the public web, and is segmenting them by scene with VLM annotations of keyframes. This dataset is now searchable, so you can find the exact moment a visual, pattern, or concept appears. Curation has always been the bottleneck in video analysis. We built a system that automates it. This is just the beginning. Over 4 billion additional videos are queued for processing, and the index is growing daily. We’re opening access to a limited set of collaborators. If you’re a researcher, journalist, or nonprofit working with video, archives, or large-scale analysis, we’d love to hear from you.

Grass

471,103 Aufrufe • vor 1 Jahr

🚀 Announcing Echo — our new frontier model for 3D world generation. Echo turns a simple text prompt or image into a fully explorable, 3D-consistent world. Instead of disconnected views, the result is a single, coherent spatial representation you can move through freely. This is part of a bigger shift in AI: from generating pixels and tokens to generating spaces. Echo predicts a geometry-grounded 3D scene at metric scale, meaning every novel view, depth map, and interaction comes from the same underlying world — not independent hallucinations. Once generated, the world is interactive in real time. You control the camera, explore from any angle, and render instantly — even on low-end hardware, directly in the browser. High-quality 3D world exploration is no longer gated by expensive equipment. Under the hood, Echo infers a physically grounded 3D representation and converts it into a renderable format. For our web demo, we use 3D Gaussian Splatting (3DGS) for fast, GPU-friendly rendering — but the representation itself is flexible and can be easily adapted. Why this matters: consistent 3D worlds unlock real workflows — digital twins, 3D design, game environments, robotics simulation, and more. From a single photo or a line of text, Echo builds worlds that are reliable, editable, and spatially faithful. Echo also enables scene editing and restyling. Change materials, remove or add objects, explore design variations — all while preserving global 3D consistency. Editing no longer breaks the world. This is only the beginning. Echo is the foundation for future world models with dynamics, physical reasoning, and richer interaction — environments that don’t just look right, but behave right. Explore the generated worlds on our website and sign up for the closed beta. The era of spatial intelligence starts here. 🌍 #Echo #WorldModels #SpatialAI #3DFoundationModels Check it out:

🚀 Announcing Echo — our new frontier model for 3D world generation. Echo turns a simple text prompt or image into a fully explorable, 3D-consistent world. Instead of disconnected views, the result is a single, coherent spatial representation you can move through freely. This is part of a bigger shift in AI: from generating pixels and tokens to generating spaces. Echo predicts a geometry-grounded 3D scene at metric scale, meaning every novel view, depth map, and interaction comes from the same underlying world — not independent hallucinations. Once generated, the world is interactive in real time. You control the camera, explore from any angle, and render instantly — even on low-end hardware, directly in the browser. High-quality 3D world exploration is no longer gated by expensive equipment. Under the hood, Echo infers a physically grounded 3D representation and converts it into a renderable format. For our web demo, we use 3D Gaussian Splatting (3DGS) for fast, GPU-friendly rendering — but the representation itself is flexible and can be easily adapted. Why this matters: consistent 3D worlds unlock real workflows — digital twins, 3D design, game environments, robotics simulation, and more. From a single photo or a line of text, Echo builds worlds that are reliable, editable, and spatially faithful. Echo also enables scene editing and restyling. Change materials, remove or add objects, explore design variations — all while preserving global 3D consistency. Editing no longer breaks the world. This is only the beginning. Echo is the foundation for future world models with dynamics, physical reasoning, and richer interaction — environments that don’t just look right, but behave right. Explore the generated worlds on our website and sign up for the closed beta. The era of spatial intelligence starts here. 🌍 #Echo #WorldModels #SpatialAI #3DFoundationModels Check it out:

SpAItial AI

175,909 Aufrufe • vor 7 Monaten

People are undoubtedly a little alarmed at having unwittingly helped build a 3D map of the world for Niantic by contributing 30 billion crowdsourced images. I interviewed Niantic's CTO Brian McClendon about exactly this in a TED interview last year -- he's also the guy who co-created Google Earth. But let's put it in perspective. Pokestop data isn't what you think it is. It's not a surveillance panopticon of your neighborhood. These are static captures of parks, statues, murals, landmarks -- the places people congregate. Brian described it as "building the map from the bottom up, from the locations where people spend time." Think of these 20 million waypoints as basically the inverse of what Google mapped with Street View. Google mapped the drivable streets. Niantic mapped where people actually hang out. Cool data, genuinely useful for visual positioning -- but very different from what the headlines imply. And lest we forget that Niantic is just one of many companies quietly building their own map of the world right now -- and they're all capturing different facets of reality: >🚶 person-level: Axon body cams on hundreds of thousands of officers. Meta Ray-Ban glasses capturing first-person POV at scale -- overseas operators reviewing images every time someone says "Hey Meta." > 🚗 vehicle-level: Tesla dashcams on every car in the fleet, massive onboard compute extracting and distilling data to the cloud. Waymo with cm-accurate 3D maps of every city they operate in. Fleet telematics cameras on delivery vehicles globally. > 🏠 street & home-level: Flock Safety deploying CCTV across neighborhoods and cities. Amazon with Ring cameras on every doorstep and mailroom (recently got dragged over that Super Bowl commercial about fusing all these cams together to find your dog) plus dashcams on every Prime delivery van. Roomba mapping your floor plan every time it vacuums -- Amazon wanted that data badly enough to try acquiring iRobot for $1.7B before regulators shut it down. > 🥽 headset-level: Apple Vision Pro and Meta Quest build a 3D model of whatever room you're in every time you put them on. Between Ring, Roomba, and your headset, your entire home is being spatially understood by at least three different companies. >📍platform-level: Google with Street View cars, aerial planes, satellite imagery, and live location from every Android phone in your pocket. Apple doing the same with mapping cars AND every LiDAR iPhone is quietly a 3D scanner. And yeah, despite the "Apple is too privacy-conscious" narrative, they're collecting location data too. >🏃 trajectory-level: Strava mapped every running and cycling trail on Earth -- and accidentally exposed secret military bases in Afghanistan and Syria because soldiers logged their jogs. When you aggregate enough individual trajectories, patterns emerge that were never supposed to be visible. > 🛰️ space-level: Planet Labs imaging the entire Earth's landmass every single day from orbit. Vantor capturing it in higher detail. Iceye doing it in 3D using SAR. If something changes anywhere on the planet -- a building goes up, a forest burns down, a military convoy moves -- before-and-after imagery within 24 hours. Fused together -- we have everything from body cam to dashcam to doorbell to phone to satellite -- every layer of physical reality is being mapped by somebody right now. Different sensors, different angles, different purposes. Same pattern. The interesting part is how they incentivize it. Google spends billions. Mapillary tried altruism. Hivemapper grinds with crypto. Pokémon GO cracked something none of them could: a game mechanic that subsidizes the scanning behavior. You're not building a map. You're catching pokemon. The map is just a side effect. 3D scanning is still a niche hobby for reality capture nerds like me. The moment somebody gamifies dense 3D capture at scale -- not posed photos but actual geometry -- that's when this blows wide open. Niantic sold the games for $3.5B but kept the spatial platform, with a data-sharing agreement in place. One team makes the game great, the other builds the spatial infrastructure underneath. Incentives finally aligned. Gaming is becoming a way for humans to contribute real-world trajectories that help physical AI learn about the real world. Google does it with live traffic. Tesla does it with autopilot. The mechanic is different but the pattern is identical -- and most people are already part of at least one -- if not a majority -- of these datasets whether they realize it or not.

People are undoubtedly a little alarmed at having unwittingly helped build a 3D map of the world for Niantic by contributing 30 billion crowdsourced images. I interviewed Niantic's CTO Brian McClendon about exactly this in a TED interview last year -- he's also the guy who co-created Google Earth. But let's put it in perspective. Pokestop data isn't what you think it is. It's not a surveillance panopticon of your neighborhood. These are static captures of parks, statues, murals, landmarks -- the places people congregate. Brian described it as "building the map from the bottom up, from the locations where people spend time." Think of these 20 million waypoints as basically the inverse of what Google mapped with Street View. Google mapped the drivable streets. Niantic mapped where people actually hang out. Cool data, genuinely useful for visual positioning -- but very different from what the headlines imply. And lest we forget that Niantic is just one of many companies quietly building their own map of the world right now -- and they're all capturing different facets of reality: >🚶 person-level: Axon body cams on hundreds of thousands of officers. Meta Ray-Ban glasses capturing first-person POV at scale -- overseas operators reviewing images every time someone says "Hey Meta." > 🚗 vehicle-level: Tesla dashcams on every car in the fleet, massive onboard compute extracting and distilling data to the cloud. Waymo with cm-accurate 3D maps of every city they operate in. Fleet telematics cameras on delivery vehicles globally. > 🏠 street & home-level: Flock Safety deploying CCTV across neighborhoods and cities. Amazon with Ring cameras on every doorstep and mailroom (recently got dragged over that Super Bowl commercial about fusing all these cams together to find your dog) plus dashcams on every Prime delivery van. Roomba mapping your floor plan every time it vacuums -- Amazon wanted that data badly enough to try acquiring iRobot for $1.7B before regulators shut it down. > 🥽 headset-level: Apple Vision Pro and Meta Quest build a 3D model of whatever room you're in every time you put them on. Between Ring, Roomba, and your headset, your entire home is being spatially understood by at least three different companies. >📍platform-level: Google with Street View cars, aerial planes, satellite imagery, and live location from every Android phone in your pocket. Apple doing the same with mapping cars AND every LiDAR iPhone is quietly a 3D scanner. And yeah, despite the "Apple is too privacy-conscious" narrative, they're collecting location data too. >🏃 trajectory-level: Strava mapped every running and cycling trail on Earth -- and accidentally exposed secret military bases in Afghanistan and Syria because soldiers logged their jogs. When you aggregate enough individual trajectories, patterns emerge that were never supposed to be visible. > 🛰️ space-level: Planet Labs imaging the entire Earth's landmass every single day from orbit. Vantor capturing it in higher detail. Iceye doing it in 3D using SAR. If something changes anywhere on the planet -- a building goes up, a forest burns down, a military convoy moves -- before-and-after imagery within 24 hours. Fused together -- we have everything from body cam to dashcam to doorbell to phone to satellite -- every layer of physical reality is being mapped by somebody right now. Different sensors, different angles, different purposes. Same pattern. The interesting part is how they incentivize it. Google spends billions. Mapillary tried altruism. Hivemapper grinds with crypto. Pokémon GO cracked something none of them could: a game mechanic that subsidizes the scanning behavior. You're not building a map. You're catching pokemon. The map is just a side effect. 3D scanning is still a niche hobby for reality capture nerds like me. The moment somebody gamifies dense 3D capture at scale -- not posed photos but actual geometry -- that's when this blows wide open. Niantic sold the games for $3.5B but kept the spatial platform, with a data-sharing agreement in place. One team makes the game great, the other builds the spatial infrastructure underneath. Incentives finally aligned. Gaming is becoming a way for humans to contribute real-world trajectories that help physical AI learn about the real world. Google does it with live traffic. Tesla does it with autopilot. The mechanic is different but the pattern is identical -- and most people are already part of at least one -- if not a majority -- of these datasets whether they realize it or not.

Bilawal Sidhu

203,550 Aufrufe • vor 4 Monaten