正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

The first global, city-scale 3D map is taking shape, and it’s machine-readable. City-scale environments can now be reconstructed in high-fidelity, reaching a level of detail that is becoming almost indistinguishable from reality. This leap is made possible by large-scale mapping using just an Insta360 X5 and Over the Reality... show more

Over the Reality 🌐

90,320 subscribers

69,822 次观看 • 4 个月前 •via X (Twitter)

教育新闻政治科学技术

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

America. Europe. Africa. Asia. Oceania. More than 250,000 real-world locations across 120+ countries have already been transformed into ultra high quality 3D Gaussian Splats by Over the Reality. From city centers and museums to beaches, mountains, and historical landmarks, every mapping created by our community contributes to a growing machine-readable representation of the physical world. This scene started as a simple Insta360 X5 recording and was transformed into a digital twin, where geometry, textures, and spatial structure are preserved and can be used by AI, Robotics, VPS, XR, and next-generation world models. This is what city-scale 3D mapping looks like. The link to become an Insta360 X5 mapper is in the first comment. 👇

America. Europe. Africa. Asia. Oceania. More than 250,000 real-world locations across 120+ countries have already been transformed into ultra high quality 3D Gaussian Splats by Over the Reality. From city centers and museums to beaches, mountains, and historical landmarks, every mapping created by our community contributes to a growing machine-readable representation of the physical world. This scene started as a simple Insta360 X5 recording and was transformed into a digital twin, where geometry, textures, and spatial structure are preserved and can be used by AI, Robotics, VPS, XR, and next-generation world models. This is what city-scale 3D mapping looks like. The link to become an Insta360 X5 mapper is in the first comment. 👇

Over the Reality 🌐

19,273 次观看 • 1 个月前

Another city. Another full 3D Gaussian Splat reconstruction. This entire neighborhood was captured while walking with an Insta360 X5, then processed with our GPU pipeline and transformed into a high-fidelity, machine-readable 3D environment with Over the Reality. What you’re seeing is not an isolated virtual world. It’s a 3D digital twin of a real-world location, built from structured spatial data where every building, street, and detail can become usable by AI, robotics, and XR. And it’s happening at scale, across cities in more than 180 countries every day. Have an Insta360 X5 and want to become a mapper? Apply here: Want to build a 3D Gaussian Splat from a video you already recorded? Do it for free at powered by Over the Reality.

Another city. Another full 3D Gaussian Splat reconstruction. This entire neighborhood was captured while walking with an Insta360 X5, then processed with our GPU pipeline and transformed into a high-fidelity, machine-readable 3D environment with Over the Reality. What you’re seeing is not an isolated virtual world. It’s a 3D digital twin of a real-world location, built from structured spatial data where every building, street, and detail can become usable by AI, robotics, and XR. And it’s happening at scale, across cities in more than 180 countries every day. Have an Insta360 X5 and want to become a mapper? Apply here: Want to build a 3D Gaussian Splat from a video you already recorded? Do it for free at powered by Over the Reality.

Over the Reality 🌐

400,097 次观看 • 3 个月前

Have you ever seen a robot walk along a waterfront, understand its surroundings, and look out at the sea? 🤖 Thanks to Over the Reality, this is possible. Places like this are mapped every day by our global community of 360 mappers. Using our technology, they are transformed into high-fidelity machine-readable 3D Gaussian Splats. This data can be used to: • navigate robots through the physical world • train AI and Visual Models • power VPS localization • anchor persistent XR content to real-world locations This is just one of more than 250,000 real-world locations already mapped by the Over the Reality community. And unlike traditional datasets, these places can be explored directly through a smartphone, browser, or XR headset, allowing anyone to navigate and experience them in first person. From city streets and waterfronts to landmarks and cultural sites, we're building one of the world's largest machine-readable maps for AI, robotics, and spatial computing.

Have you ever seen a robot walk along a waterfront, understand its surroundings, and look out at the sea? 🤖 Thanks to Over the Reality, this is possible. Places like this are mapped every day by our global community of 360 mappers. Using our technology, they are transformed into high-fidelity machine-readable 3D Gaussian Splats. This data can be used to: • navigate robots through the physical world • train AI and Visual Models • power VPS localization • anchor persistent XR content to real-world locations This is just one of more than 250,000 real-world locations already mapped by the Over the Reality community. And unlike traditional datasets, these places can be explored directly through a smartphone, browser, or XR headset, allowing anyone to navigate and experience them in first person. From city streets and waterfronts to landmarks and cultural sites, we're building one of the world's largest machine-readable maps for AI, robotics, and spatial computing.

Over the Reality 🌐

31,824 次观看 • 2 个月前

A 10-minute walk. That's all it takes to transform a real-world neighborhood into a machine-readable digital twin. Captured with an Insta360 X5 and reconstructed by Over the Reality, this environment is no longer just a place on a map. It's spatial data that can power Visual AI, Robotics localization, VPS, XR experiences, and next-generation world models. Today, the OVER community has already created more than 270,000 machine-readable locations like this, forming one of the world's largest 3D datasets for Physical AI, an increasingly valuable asset as demand for high quality real-world data continues to grow.

A 10-minute walk. That's all it takes to transform a real-world neighborhood into a machine-readable digital twin. Captured with an Insta360 X5 and reconstructed by Over the Reality, this environment is no longer just a place on a map. It's spatial data that can power Visual AI, Robotics localization, VPS, XR experiences, and next-generation world models. Today, the OVER community has already created more than 270,000 machine-readable locations like this, forming one of the world's largest 3D datasets for Physical AI, an increasingly valuable asset as demand for high quality real-world data continues to grow.

Over the Reality 🌐

16,642 次观看 • 1 个月前

Large-scale Gaussian splats have reached a new level of realism. This is a well-known temple in Bangkok, reconstructed as a high-fidelity 3D environment from 360 captures. At this level, the boundary between video and 3D starts to disappear. But what you’re looking at is not a video. It’s a dense spatial representation of a real place, where geometry, texture, and structure are preserved and made machine-readable. This kind of 3D data can power Visual AI, Robotics navigation, VPS localization, XR experiences, world models, and next-generation spatial computing systems. Built with Over the Reality.

Large-scale Gaussian splats have reached a new level of realism. This is a well-known temple in Bangkok, reconstructed as a high-fidelity 3D environment from 360 captures. At this level, the boundary between video and 3D starts to disappear. But what you’re looking at is not a video. It’s a dense spatial representation of a real place, where geometry, texture, and structure are preserved and made machine-readable. This kind of 3D data can power Visual AI, Robotics navigation, VPS localization, XR experiences, world models, and next-generation spatial computing systems. Built with Over the Reality.

Over the Reality 🌐

347,311 次观看 • 2 个月前

Entire cities are being transformed into immersive digital twins faster than ever, creating the digital foundation that can help make them smarter, more connected, and easier to navigate. This complete historic town was captured with a single Insta360 X5 by one of our mappers and reconstructed by OVER into a high-fidelity 3D environment. What once required specialised equipment can now be captured simply by walking. Our mapping network is now covering more than 15,000 new locations every month, and it continues to grow as more mappers join. Every new mapper means more cities, shopping malls, museums, cultural landmarks, public spaces, and businesses being captured and transformed by OVER into detailed digital twins. These environments can support virtual exploration, indoor and outdoor navigation, location-based XR experiences, cultural preservation, Visual AI, VPS, Robotics localisation, and the development of spatial models capable of understanding real-world environments. Explore the complete digital twin and navigate the town:

Entire cities are being transformed into immersive digital twins faster than ever, creating the digital foundation that can help make them smarter, more connected, and easier to navigate. This complete historic town was captured with a single Insta360 X5 by one of our mappers and reconstructed by OVER into a high-fidelity 3D environment. What once required specialised equipment can now be captured simply by walking. Our mapping network is now covering more than 15,000 new locations every month, and it continues to grow as more mappers join. Every new mapper means more cities, shopping malls, museums, cultural landmarks, public spaces, and businesses being captured and transformed by OVER into detailed digital twins. These environments can support virtual exploration, indoor and outdoor navigation, location-based XR experiences, cultural preservation, Visual AI, VPS, Robotics localisation, and the development of spatial models capable of understanding real-world environments. Explore the complete digital twin and navigate the town:

Over the Reality 🌐

21,305 次观看 • 17 天前

Mapping with Over the Reality is now powered not only by smartphones, but also by Insta360 X5. If you own an Insta360 X5 and want to be part of it: 👉 Apply here: With 360 capture, contributors can cover significantly larger areas in a single session, turning daily walks into true city level mapping and building 3D infrastructure for AI, XR, and Robotics. Rewards are active, and we’re opening the Insta360 X5 Alpha Mapper Program to early contributors.

Mapping with Over the Reality is now powered not only by smartphones, but also by Insta360 X5. If you own an Insta360 X5 and want to be part of it: 👉 Apply here: With 360 capture, contributors can cover significantly larger areas in a single session, turning daily walks into true city level mapping and building 3D infrastructure for AI, XR, and Robotics. Rewards are active, and we’re opening the Insta360 X5 Alpha Mapper Program to early contributors.

Over the Reality 🌐

343,060 次观看 • 6 个月前

Introducing WorldView 3D, a first-of-its-kind satellite tasking product that delivers up-to-date 3D ground truth anywhere on Earth. From GPS-denied autonomy and intelligence analysis to consumer-grade mapping and disaster response, the world's most important missions increasingly depend on accurate, up-to-date 3D terrain. But for years, keeping 3D maps current at global scale hasn't been possible. WorldView 3D changes that. Built on Vantor’s trusted spatial foundation, our new tasking capability empowers customers to task and receive updated 3D data within 24 hours of image collection. For missions that require greater fidelity, they can also produce high-definition 3D maps anywhere in the world. 3D is the future of spatial intelligence, and Vantor is leading the change. Our trusted spatial foundation already includes 100 million sq km of the world mapped inhighly accurate 3D. Now customers can update the locations that matter most with the speed, scale, and fidelity required for critical missions. Read the full announcement:

Introducing WorldView 3D, a first-of-its-kind satellite tasking product that delivers up-to-date 3D ground truth anywhere on Earth. From GPS-denied autonomy and intelligence analysis to consumer-grade mapping and disaster response, the world's most important missions increasingly depend on accurate, up-to-date 3D terrain. But for years, keeping 3D maps current at global scale hasn't been possible. WorldView 3D changes that. Built on Vantor’s trusted spatial foundation, our new tasking capability empowers customers to task and receive updated 3D data within 24 hours of image collection. For missions that require greater fidelity, they can also produce high-definition 3D maps anywhere in the world. 3D is the future of spatial intelligence, and Vantor is leading the change. Our trusted spatial foundation already includes 100 million sq km of the world mapped inhighly accurate 3D. Now customers can update the locations that matter most with the speed, scale, and fidelity required for critical missions. Read the full announcement:

Vantor

16,030 次观看 • 1 个月前

A museum in France. Accessible from anywhere in the world. One of our mappers captured the Musée Archéologique du Val-d'Oise, home to more than 35,000 archaeological artifacts and over 3,000 objects on display. Using an Insta360 X5 and Over the Reality's reconstruction technology, the entire museum, including its multiple floors, has been transformed into a high-fidelity 3D Gaussian Splat and digital twin. This means anyone can now explore the museum remotely, walk through its galleries, move across different floors, and experience the space as if they were there in person. What was once a physical location is now a machine-readable 3D environment, preserved digitally and accessible through a browser, smartphone, or XR headset. From museums and cultural landmarks to entire cities, Over the Reality has built the largest 3D map of the world. The link to explore the experience remotely is available in the first comment.

A museum in France. Accessible from anywhere in the world. One of our mappers captured the Musée Archéologique du Val-d'Oise, home to more than 35,000 archaeological artifacts and over 3,000 objects on display. Using an Insta360 X5 and Over the Reality's reconstruction technology, the entire museum, including its multiple floors, has been transformed into a high-fidelity 3D Gaussian Splat and digital twin. This means anyone can now explore the museum remotely, walk through its galleries, move across different floors, and experience the space as if they were there in person. What was once a physical location is now a machine-readable 3D environment, preserved digitally and accessible through a browser, smartphone, or XR headset. From museums and cultural landmarks to entire cities, Over the Reality has built the largest 3D map of the world. The link to explore the experience remotely is available in the first comment.

Over the Reality 🌐

27,503 次观看 • 2 个月前

People are just realizing something important. One of the largest real-world visual datasets for AI was built by millions of users… without them even knowing it. At Over the Reality, we believe this should work differently. We are building a global 3D map of the world through a community that maps real places on purpose, and gets rewarded for every meaningful contribution. People helping build the global 3D map of the world can earn from $1 to $3 for each location mapped with a smartphone, or up to $18 per hour using an Insta360 X5. Apply here:

People are just realizing something important. One of the largest real-world visual datasets for AI was built by millions of users… without them even knowing it. At Over the Reality, we believe this should work differently. We are building a global 3D map of the world through a community that maps real places on purpose, and gets rewarded for every meaningful contribution. People helping build the global 3D map of the world can earn from $1 to $3 for each location mapped with a smartphone, or up to $18 per hour using an Insta360 X5. Apply here:

Over the Reality 🌐

288,805 次观看 • 5 个月前

Robots are gaining spatial awareness with Over the Reality. 🤖 Powered by the world’s largest 3D dataset, we enable robots to see, sense, and collaborate in real-world environments. This early test shows how a Unitree Go2 perceives its surroundings through OVER’s VPS — on the right, the real life robot; on the left, its real-time perception of the position inside one of OVER’s 3D maps. Robotic spatial awareness is here, living in 155,000+ mapped locations and expanding every day. One step closer to Physical AI. Stay tuned for our upcoming ROS 2 integration, unlocking a universal framework for robotic perception leveraging OVER's infrastructure!

Robots are gaining spatial awareness with Over the Reality. 🤖 Powered by the world’s largest 3D dataset, we enable robots to see, sense, and collaborate in real-world environments. This early test shows how a Unitree Go2 perceives its surroundings through OVER’s VPS — on the right, the real life robot; on the left, its real-time perception of the position inside one of OVER’s 3D maps. Robotic spatial awareness is here, living in 155,000+ mapped locations and expanding every day. One step closer to Physical AI. Stay tuned for our upcoming ROS 2 integration, unlocking a universal framework for robotic perception leveraging OVER's infrastructure!

Over the Reality 🌐

263,818 次观看 • 10 个月前

The physical world is becoming a new digital layer for Robotics, AI, and XR. With Over the Reality, you can help build it. Every place you visit can become a 3D map that powers this new infrastructure, simply by scanning it with your phone. And every location you map unlocks rewards, turning your daily walks into earnings or vouchers you can use everyday. It’s free to start. Comment “map” and we’ll send you access.

The physical world is becoming a new digital layer for Robotics, AI, and XR. With Over the Reality, you can help build it. Every place you visit can become a 3D map that powers this new infrastructure, simply by scanning it with your phone. And every location you map unlocks rewards, turning your daily walks into earnings or vouchers you can use everyday. It’s free to start. Comment “map” and we’ll send you access.

Over the Reality 🌐

379,791 次观看 • 4 个月前

.Polymath is training world generation models to automate the creation of RL environments. Traditionally, RL environment generation has been bottlenecked by human data. Superintelligence will never be achieved by human data alone. Polymath is building the core technology to enable automated environment generation using far less human effort than traditionally required, and eventually none. This allows for more complex and realistic worlds, and higher quality, scale, and diversity of tasks. This will be essential to unlock RL scaling. The end goal is to create large-scale, long-horizon environments from a text description alone. This will enable the creation of worlds of arbitrary complexity and scale, which is foundational for training & evaluating autonomous, superintelligent AI agents. Congrats on the launch, Dylan Ma and Naren Yenuganti!

.Polymath is training world generation models to automate the creation of RL environments. Traditionally, RL environment generation has been bottlenecked by human data. Superintelligence will never be achieved by human data alone. Polymath is building the core technology to enable automated environment generation using far less human effort than traditionally required, and eventually none. This allows for more complex and realistic worlds, and higher quality, scale, and diversity of tasks. This will be essential to unlock RL scaling. The end goal is to create large-scale, long-horizon environments from a text description alone. This will enable the creation of worlds of arbitrary complexity and scale, which is foundational for training & evaluating autonomous, superintelligent AI agents. Congrats on the launch, Dylan Ma and Naren Yenuganti!

Y Combinator

44,192 次观看 • 5 个月前

Scaling 3D scene data is a long-standing challenge in scene understanding, spatial reasoning, and robotics. Since scanning, reconstruction, and labeling are so labor-intensive, data scarcity has remained a major bottleneck. 🛑 To solve this, we propose SceneVerse++: Lifting Unlabeled Internet-level Data for 3D Scene Understanding (CVPR 2026). By reconstructing internet videos and annotating 3D scenes automatically, we’ve created a massive real-world dataset for end-to-end understanding. 🌐📐 SceneVerse++ makes it easy to scale "in-the-wild" 3D scenes toward more capable spatial reasoning systems. This significantly promotes progress in 3D VQA, visual navigation, and broader tasks in Embodied AI and Robotics. 🤖🦾 We are fully open-sourced! Check out the paper, code, and data here: 🌐 Project: 📄 Paper: 📊 Dataset: Code:

Scaling 3D scene data is a long-standing challenge in scene understanding, spatial reasoning, and robotics. Since scanning, reconstruction, and labeling are so labor-intensive, data scarcity has remained a major bottleneck. 🛑 To solve this, we propose SceneVerse++: Lifting Unlabeled Internet-level Data for 3D Scene Understanding (CVPR 2026). By reconstructing internet videos and annotating 3D scenes automatically, we’ve created a massive real-world dataset for end-to-end understanding. 🌐📐 SceneVerse++ makes it easy to scale "in-the-wild" 3D scenes toward more capable spatial reasoning systems. This significantly promotes progress in 3D VQA, visual navigation, and broader tasks in Embodied AI and Robotics. 🤖🦾 We are fully open-sourced! Check out the paper, code, and data here: 🌐 Project: 📄 Paper: 📊 Dataset: Code:

Siyuan Huang

12,612 次观看 • 3 个月前

🇪🇺 Today it has been all about demos, and yes, our indoor navigation is finally live. We scanned and mapped the UnitedXR venue with centimetre-level precision. Key elements: 🔹 Digital Twins as enabling technology for Smart Cities 🔹 Visual Positioning Systems (VPS) 🔹 Accessibility and inclusivity as core design principles The future of Smart Cities is being built by you, one map at a time. Tomorrow: important meetings that will shape future European projects 🇪🇺.

🇪🇺 Today it has been all about demos, and yes, our indoor navigation is finally live. We scanned and mapped the UnitedXR venue with centimetre-level precision. Key elements: 🔹 Digital Twins as enabling technology for Smart Cities 🔹 Visual Positioning Systems (VPS) 🔹 Accessibility and inclusivity as core design principles The future of Smart Cities is being built by you, one map at a time. Tomorrow: important meetings that will shape future European projects 🇪🇺.

Over the Reality 🌐

32,133 次观看 • 8 个月前

Excited to share this demo from Over the Reality! Watch our Unitree Go2 robodog navigating our office while reconstructing the 3D space in real-time using the VGGT-based foundation vision model. This is a prime example of machine perception in action, turning raw RGB camera feeds into rich, detailed 3D maps! The robodog's RGB cam generates a dense, textured 3D reconstruction via VGGT from a few photograms, capturing nuances like object shapes and surfaces with impressive fidelity (main view). Compare that to the standard LiDAR system (top right), it's sparser, more point-cloud focused, lacking the visual richness. Vision models are closing the gap fast! What's powering this? VGGT, a cutting-edge foundation model for 3D perception, trained on datasets orders of magnitude smaller than our massive OVER 3D maps dataset. Imagine the leap when we apply OVER's scale to VGGT-like transformer based architectures, denser reconstructions, better generalization, revolutionary for robotics, machine perception & AR! Stay tuned for more breakthroughs at the intersection of AI, robotics, and DePIN. We're building the future of Physical AI and Spatial Computing at Over the Reality 🌐 What do you think, ready for robodogs in your world? Drop your thoughts! 🤖🌐

Excited to share this demo from Over the Reality! Watch our Unitree Go2 robodog navigating our office while reconstructing the 3D space in real-time using the VGGT-based foundation vision model. This is a prime example of machine perception in action, turning raw RGB camera feeds into rich, detailed 3D maps! The robodog's RGB cam generates a dense, textured 3D reconstruction via VGGT from a few photograms, capturing nuances like object shapes and surfaces with impressive fidelity (main view). Compare that to the standard LiDAR system (top right), it's sparser, more point-cloud focused, lacking the visual richness. Vision models are closing the gap fast! What's powering this? VGGT, a cutting-edge foundation model for 3D perception, trained on datasets orders of magnitude smaller than our massive OVER 3D maps dataset. Imagine the leap when we apply OVER's scale to VGGT-like transformer based architectures, denser reconstructions, better generalization, revolutionary for robotics, machine perception & AR! Stay tuned for more breakthroughs at the intersection of AI, robotics, and DePIN. We're building the future of Physical AI and Spatial Computing at Over the Reality 🌐 What do you think, ready for robodogs in your world? Drop your thoughts! 🤖🌐

Over the Reality 🌐

359,717 次观看 • 11 个月前

Big news from OVER! 🚀 We're expanding our Visual Positioning System (VPS) globally integrating open datasets from Mapillary & Panoramax. Precise AR re-localization everywhere. Yes, EVERYWHERE! 🗺️ Mapillary & panoramax offer over 2 BILLION geolocalized images under CC-BY-SA license. Mapillary (recently acquired by Meta) covers the globe, while Panoramax specializes in France. These datasets beautifully complement OVER's community-driven OVRMaps. While they're less dense (about 1-2 orders sparser), their scale is massive. Check out Mapillary’s global coverage here: But leveraging such sparse, varied data isn't easy—think limited overlap, camera distortion, and no metric scaling. Yet, we've cracked the code! 💡 Our recent breakthroughs combining our VPS pipeline with cutting-edge Large Geospatial Models (LGMs) allow us to build accurate 3D digital twins and offer reliable VPS services using these sparse datasets. 📍 Accuracy might be lower than our detailed community maps, but it still blows GPS out of the water! This is HUGE for OVER. It means we’re extending our coverage WAY beyond the 110,000+ locations already mapped by our community. Web3 DePIN + Open Source beats Web2 giants like Niantic! And that's not all—we're also unlocking exciting new possibilities soon: 1️⃣ Faster and easier mapping through our Map2Earn program using 360-degree camera integration. 2️⃣ Integrating datasets from new DePIN partners—like our recent partnership with NATIX Network the OVER ecosystem. Stay tuned! The future of AR Spatial Computing and decentralized mapping is here, and it's open, collaborative, and unstoppable!

Big news from OVER! 🚀 We're expanding our Visual Positioning System (VPS) globally integrating open datasets from Mapillary & Panoramax. Precise AR re-localization everywhere. Yes, EVERYWHERE! 🗺️ Mapillary & panoramax offer over 2 BILLION geolocalized images under CC-BY-SA license. Mapillary (recently acquired by Meta) covers the globe, while Panoramax specializes in France. These datasets beautifully complement OVER's community-driven OVRMaps. While they're less dense (about 1-2 orders sparser), their scale is massive. Check out Mapillary’s global coverage here: But leveraging such sparse, varied data isn't easy—think limited overlap, camera distortion, and no metric scaling. Yet, we've cracked the code! 💡 Our recent breakthroughs combining our VPS pipeline with cutting-edge Large Geospatial Models (LGMs) allow us to build accurate 3D digital twins and offer reliable VPS services using these sparse datasets. 📍 Accuracy might be lower than our detailed community maps, but it still blows GPS out of the water! This is HUGE for OVER. It means we’re extending our coverage WAY beyond the 110,000+ locations already mapped by our community. Web3 DePIN + Open Source beats Web2 giants like Niantic! And that's not all—we're also unlocking exciting new possibilities soon: 1️⃣ Faster and easier mapping through our Map2Earn program using 360-degree camera integration. 2️⃣ Integrating datasets from new DePIN partners—like our recent partnership with NATIX Network the OVER ecosystem. Stay tuned! The future of AR Spatial Computing and decentralized mapping is here, and it's open, collaborative, and unstoppable!

Over the Reality 🌐

1,313,342 次观看 • 1 年前

PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Tracking paper page: introduce PointOdyssey, a large-scale synthetic dataset, and data generation framework, for the training and evaluation of long-term fine-grained tracking algorithms. Our goal is to advance the state-of-the-art by placing emphasis on long videos with naturalistic motion. Toward the goal of naturalism, we animate deformable characters using real-world motion capture data, we build 3D scenes to match the motion capture environments, and we render camera viewpoints using trajectories mined via structure-from-motion on real videos. We create combinatorial diversity by randomizing character appearance, motion profiles, materials, lighting, 3D assets, and atmospheric effects. Our dataset currently includes 104 videos, averaging 2,000 frames long, with orders of magnitude more correspondence annotations than prior work. We show that existing methods can be trained from scratch in our dataset and outperform the published variants. Finally, we introduce modifications to the PIPs point tracking method, greatly widening its temporal receptive field, which improves its performance on PointOdyssey as well as on two real-world benchmarks.

PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Tracking paper page: introduce PointOdyssey, a large-scale synthetic dataset, and data generation framework, for the training and evaluation of long-term fine-grained tracking algorithms. Our goal is to advance the state-of-the-art by placing emphasis on long videos with naturalistic motion. Toward the goal of naturalism, we animate deformable characters using real-world motion capture data, we build 3D scenes to match the motion capture environments, and we render camera viewpoints using trajectories mined via structure-from-motion on real videos. We create combinatorial diversity by randomizing character appearance, motion profiles, materials, lighting, 3D assets, and atmospheric effects. Our dataset currently includes 104 videos, averaging 2,000 frames long, with orders of magnitude more correspondence annotations than prior work. We show that existing methods can be trained from scratch in our dataset and outperform the published variants. Finally, we introduce modifications to the PIPs point tracking method, greatly widening its temporal receptive field, which improves its performance on PointOdyssey as well as on two real-world benchmarks.

AK

122,560 次观看 • 3 年前

POKÉMON GO PLAYERS TRAINED 30 BILLION IMAGE AI MAP Niantic says photos and scans collected through Pokémon Go and its AR apps have produced a massive dataset of more than 30 billion real-world images. The company is now using that data to power visual navigation for delivery robots, letting them identify exact locations on city streets without relying on GPS. Source: NewsForce

POKÉMON GO PLAYERS TRAINED 30 BILLION IMAGE AI MAP Niantic says photos and scans collected through Pokémon Go and its AR apps have produced a massive dataset of more than 30 billion real-world images. The company is now using that data to power visual navigation for delivery robots, letting them identify exact locations on city streets without relying on GPS. Source: NewsForce

NewsForce

23,678,761 次观看 • 5 个月前

The infrastructure for working with video data at scale barely exists. Grass Video Search is our first step in changing that. You can now find anything in a video based on the contents of its frames, not just transcripts or tags. Over the last several months, the Grass Foundation has quietly assembled one of the largest video datasets in history: over a billion videos from across the public web, and is segmenting them by scene with VLM annotations of keyframes. This dataset is now searchable, so you can find the exact moment a visual, pattern, or concept appears. Curation has always been the bottleneck in video analysis. We built a system that automates it. This is just the beginning. Over 4 billion additional videos are queued for processing, and the index is growing daily. We’re opening access to a limited set of collaborators. If you’re a researcher, journalist, or nonprofit working with video, archives, or large-scale analysis, we’d love to hear from you.

The infrastructure for working with video data at scale barely exists. Grass Video Search is our first step in changing that. You can now find anything in a video based on the contents of its frames, not just transcripts or tags. Over the last several months, the Grass Foundation has quietly assembled one of the largest video datasets in history: over a billion videos from across the public web, and is segmenting them by scene with VLM annotations of keyframes. This dataset is now searchable, so you can find the exact moment a visual, pattern, or concept appears. Curation has always been the bottleneck in video analysis. We built a system that automates it. This is just the beginning. Over 4 billion additional videos are queued for processing, and the index is growing daily. We’re opening access to a limited set of collaborators. If you’re a researcher, journalist, or nonprofit working with video, archives, or large-scale analysis, we’d love to hear from you.

Grass

471,574 次观看 • 1 年前