Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

💥 Think more real data is needed for scene reconstruction? Think again! Meet MegaSynth: scaling up feed-forward 3D scene reconstruction with synthesized scenes. In 3 days, it generates 700K scenes for training—70x larger than real data! ✨ The secret? Reconstruction is mostly non-semantic! No need to rely heavily on... show more

Hanwen Jiang

1,955 subscribers

26,832 görüntüleme • 1 yıl önce •via X (Twitter)

Bilim & Teknoloji Eğitim

Anya Rossi• Live Now

Private livecam show

10 Yorum

Hanwen Jiang profil fotoğrafı

Hanwen Jiang1 yıl önce

🔍 How does MegaSynth work? MegaSynth focuses on basic geometric structures, using augmented non-semantic shape primitives combined with randomized lighting and materials. It enhances data scalability, control, diversity, and provides accurate metadata for training models. (2/4)

Hanwen Jiang profil fotoğrafı

Hanwen Jiang1 yıl önce

📈 MegaSynth delivers results! Training with MegaSynth consistently improves performance across models, testing scenarios, and training settings. It enhances handling of complex lighting, materials, thin structures, and cluttered scenes—highlighting the power of synthesized data! (3/4)

Hanwen Jiang profil fotoğrafı

Hanwen Jiang1 yıl önce

🤯 Surprising insight. Training with zero real data performs comparably, confirming that multi-view reconstruction is largely non-semantic and low-level—aligning with observations from optimization-based methods like NeRF and COLMAP. (4/4)

Hanwen Jiang profil fotoğrafı

Hanwen Jiang1 yıl önce

Joint work with @zexiangxu , @DesaiXie , @chenziwee , @Haian_Jin , @fujun_luan , Zhixin Shu, @KaiZhang9546 , @Sai__Bi , Xin Sun, Jiuxiang Gu, @qixing_huang , @geopavlakos and @HaoTan5

Jianyuan Wang profil fotoğrafı

Jianyuan Wang1 yıl önce

Awesome! Do you happen to have an estimated timeline for the release of the data?

Hanwen Jiang profil fotoğrafı

Hanwen Jiang1 yıl önce

Thanks for your interest. It should be very quick, probably in January

Dusan Svilarkovic profil fotoğrafı

Dusan Svilarkovic1 yıl önce

What license are you using for datasets ?

Jonathan Clark profil fotoğrafı

Jonathan Clark1 yıl önce

Looks really interesting! Would it be able to handle object centric reconstruction too?

Hanwen Jiang profil fotoğrafı

Hanwen Jiang1 yıl önce

Yes it works. Object-centric is easier 😁

Thuan Hoang Nguyen profil fotoğrafı

Thuan Hoang Nguyen1 yıl önce

How about real+synthetic combined ? Can it boost performance further ?

Benzer Videolar

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a camera-conditioned video diffusion model can be transformed into a generative reconstruction model that directly outputs a high-quality 3D Gaussian Splatting representation through self-distillation, without requiring real-world training data. Check out our results in the video (wait for dynamic scenes in the second half!) : Project Page: Code and Models: Paper:

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a camera-conditioned video diffusion model can be transformed into a generative reconstruction model that directly outputs a high-quality 3D Gaussian Splatting representation through self-distillation, without requiring real-world training data. Check out our results in the video (wait for dynamic scenes in the second half!) : Project Page: Code and Models: Paper:

Sherwin Bahmani

66,417 görüntüleme • 9 ay önce

So I heard we need more data for robot learning :) Purely real world teleop is expensive and slow, making large scale data collection challenging. I’ve been excited about getting more data into robot learning, going beyond just real-world teleop data. To this end, we’ve been scaling up data generation with RL in realistic simulations generated on the fly from crowdsourced videos. Enables realistic data collection, much more cheaply than purely real world teleop. Importantly, data collection becomes even*cheaper* with more environments, allowing training with over 100x more data. Transfers to real robots for generalizable manipulation. A 🧵 (1/N)

So I heard we need more data for robot learning :) Purely real world teleop is expensive and slow, making large scale data collection challenging. I’ve been excited about getting more data into robot learning, going beyond just real-world teleop data. To this end, we’ve been scaling up data generation with RL in realistic simulations generated on the fly from crowdsourced videos. Enables realistic data collection, much more cheaply than purely real world teleop. Importantly, data collection becomes evencheaper with more environments, allowing training with over 100x more data. Transfers to real robots for generalizable manipulation. A 🧵 (1/N)

Abhishek Gupta

13,336 görüntüleme • 1 yıl önce

Scaling 3D scene data is a long-standing challenge in scene understanding, spatial reasoning, and robotics. Since scanning, reconstruction, and labeling are so labor-intensive, data scarcity has remained a major bottleneck. 🛑 To solve this, we propose SceneVerse++: Lifting Unlabeled Internet-level Data for 3D Scene Understanding (CVPR 2026). By reconstructing internet videos and annotating 3D scenes automatically, we’ve created a massive real-world dataset for end-to-end understanding. 🌐📐 SceneVerse++ makes it easy to scale "in-the-wild" 3D scenes toward more capable spatial reasoning systems. This significantly promotes progress in 3D VQA, visual navigation, and broader tasks in Embodied AI and Robotics. 🤖🦾 We are fully open-sourced! Check out the paper, code, and data here: 🌐 Project: 📄 Paper: 📊 Dataset: Code:

Scaling 3D scene data is a long-standing challenge in scene understanding, spatial reasoning, and robotics. Since scanning, reconstruction, and labeling are so labor-intensive, data scarcity has remained a major bottleneck. 🛑 To solve this, we propose SceneVerse++: Lifting Unlabeled Internet-level Data for 3D Scene Understanding (CVPR 2026). By reconstructing internet videos and annotating 3D scenes automatically, we’ve created a massive real-world dataset for end-to-end understanding. 🌐📐 SceneVerse++ makes it easy to scale "in-the-wild" 3D scenes toward more capable spatial reasoning systems. This significantly promotes progress in 3D VQA, visual navigation, and broader tasks in Embodied AI and Robotics. 🤖🦾 We are fully open-sourced! Check out the paper, code, and data here: 🌐 Project: 📄 Paper: 📊 Dataset: Code:

Siyuan Huang

12,612 görüntüleme • 1 ay önce

Introducing VGGT-Ω: scaling feed-forward reconstruction across static and dynamic scenes, and studying whether the learned geometric representations transfer beyond reconstruction.

Introducing VGGT-Ω: scaling feed-forward reconstruction across static and dynamic scenes, and studying whether the learned geometric representations transfer beyond reconstruction.

Jianyuan

778,042 görüntüleme • 1 ay önce

🚀 Our NeurIPS '24 work, Large Spatial Model (LSM), is here! LSM performs semantic 3D reconstruction in just 0.1s, processing unposed data via feed-forward 3D reconstruction. 👉It leverages large-scale 3D datasets with minimal annotations, defining a 3D latent space. We are continuously exploring how this explicit 3D representation can further enhance reasoning and robotic learning. 🔗 Try our online Gradio demo with your own data at #NeurIPS2024 #3DReconstruction

🚀 Our NeurIPS '24 work, Large Spatial Model (LSM), is here! LSM performs semantic 3D reconstruction in just 0.1s, processing unposed data via feed-forward 3D reconstruction. 👉It leverages large-scale 3D datasets with minimal annotations, defining a 3D latent space. We are continuously exploring how this explicit 3D representation can further enhance reasoning and robotic learning. 🔗 Try our online Gradio demo with your own data at #NeurIPS2024 #3DReconstruction

Zhiwen(Aaron) Fan

43,826 görüntüleme • 1 yıl önce

Multi-view Reconstruction via SfM-guided Monocular Depth Estimation Contributions: • We propose a novel approach to inject SfM priors into diffusion-based depth estimation, enabling highly accurate and multi-view consistent depth predictions for each viewpoint. • Based on the proposed depth estimator, we design a new multi-view 3D geometry reconstruction framework and process some synthetic datasets to facilitate training. • We evaluate our method on diverse real-world scene data, including objects, indoor environments, streetscapes, and aerial scenes, demonstrating the superior performance and generalization capability of our approach.

Multi-view Reconstruction via SfM-guided Monocular Depth Estimation Contributions: • We propose a novel approach to inject SfM priors into diffusion-based depth estimation, enabling highly accurate and multi-view consistent depth predictions for each viewpoint. • Based on the proposed depth estimator, we design a new multi-view 3D geometry reconstruction framework and process some synthetic datasets to facilitate training. • We evaluate our method on diverse real-world scene data, including objects, indoor environments, streetscapes, and aerial scenes, demonstrating the superior performance and generalization capability of our approach.

MrNeRF

25,651 görüntüleme • 1 yıl önce

Scale AI's Alexandr Wang says "the data wall and the wall on progress that we've hit right now is certainly real" and synthetic data isn't living up to its promise, with more human-generated data needed

Scale AI's Alexandr Wang says "the data wall and the wall on progress that we've hit right now is certainly real" and synthetic data isn't living up to its promise, with more human-generated data needed

Tsarathustra

578,870 görüntüleme • 1 yıl önce

As robotics teams scale, collecting real-world data can quickly become slow and expensive. 📉 Lightwheel is changing that with a simulation-first platform built on our technology, helping customers generate a 100:1 simulated-to-real data ratio for training autonomous systems. Together, we’re turning synthetic and real data into more capable, more reliable robots. Read the full success story 🔗

As robotics teams scale, collecting real-world data can quickly become slow and expensive. 📉 Lightwheel is changing that with a simulation-first platform built on our technology, helping customers generate a 100:1 simulated-to-real data ratio for training autonomous systems. Together, we’re turning synthetic and real data into more capable, more reliable robots. Read the full success story 🔗

NVIDIA Robotics

10,780 görüntüleme • 2 ay önce

Everyone is scaling VLAs with more robot data. TiPToP shows another path. No robot training, no policy learning. Just RGB + language → 3D scene → GPU TAMP planner → trajectory. Foundation models + planning alone can run real manipulation tasks.

Everyone is scaling VLAs with more robot data. TiPToP shows another path. No robot training, no policy learning. Just RGB + language → 3D scene → GPU TAMP planner → trajectory. Foundation models + planning alone can run real manipulation tasks.

Robots Digest 🤖

10,362 görüntüleme • 3 ay önce

Spatio-Temporal Reconstruction Model for Large-Scale Outdoor Scenes Contributions: • We propose STORM, the first feed-forward, self-supervised method for fast and accurate reconstruction of dynamic 3D scenes from sparse, multi-timestep, posed camera images. • Our bottom-up framework aggregates and transforms per-frame 3D Gaussian Splats into a cohesive scene representation, enabling self-supervised motion estimation. Furthermore, we introduce motion tokens that capture common motion primitives and regularize motion predictions, facilitating dynamic motion group segmentation without explicit motion or correspondence supervision. • We present several enhancements for in-the-wild scenarios, including sky modeling, camera exposure inconsistency handling, large novel-view extrapolation, and fine-grained human motions reconstruction, making STORM well-suited for real-world applications.

Spatio-Temporal Reconstruction Model for Large-Scale Outdoor Scenes Contributions: • We propose STORM, the first feed-forward, self-supervised method for fast and accurate reconstruction of dynamic 3D scenes from sparse, multi-timestep, posed camera images. • Our bottom-up framework aggregates and transforms per-frame 3D Gaussian Splats into a cohesive scene representation, enabling self-supervised motion estimation. Furthermore, we introduce motion tokens that capture common motion primitives and regularize motion predictions, facilitating dynamic motion group segmentation without explicit motion or correspondence supervision. • We present several enhancements for in-the-wild scenarios, including sky modeling, camera exposure inconsistency handling, large novel-view extrapolation, and fine-grained human motions reconstruction, making STORM well-suited for real-world applications.

MrNeRF

53,292 görüntüleme • 1 yıl önce

[1/N] Current visual geometry prediction models primarily rely on labeled 3D data. Our CVPR26 paper, Flow3r, allows additionally leveraging unlabeled videos (using flow supervision) for scalable visual geometry learning, enabling accurate multi-view 3D reconstruction in-the-wild.

[1/N] Current visual geometry prediction models primarily rely on labeled 3D data. Our CVPR26 paper, Flow3r, allows additionally leveraging unlabeled videos (using flow supervision) for scalable visual geometry learning, enabling accurate multi-view 3D reconstruction in-the-wild.

Shubham Tulsiani

15,974 görüntüleme • 3 ay önce

NEWS: Nvidia shows how its new “Cosmos” system uses cars to generate synthetic real world driving scenarios to train self-driving cars. It can create drivable 3D environments. Driving scenario variations can be generated from replayed drive logs or AI traffic generators. Next, a neural reconstruction engine uses autonomous vehicle sensor logs to create high fidelity 4D simulation environments. It replays previous drives in 3D and generates scenario variations to amplify training data. Nvidia’s AI data factory scales hundreds of drives into billions of effective miles.

NEWS: Nvidia shows how its new “Cosmos” system uses cars to generate synthetic real world driving scenarios to train self-driving cars. It can create drivable 3D environments. Driving scenario variations can be generated from replayed drive logs or AI traffic generators. Next, a neural reconstruction engine uses autonomous vehicle sensor logs to create high fidelity 4D simulation environments. It replays previous drives in 3D and generates scenario variations to amplify training data. Nvidia’s AI data factory scales hundreds of drives into billions of effective miles.

Sawyer Merritt

918,183 görüntüleme • 1 yıl önce

Our product team walks through the full journey: Capture → Reconstruct → Localize Scaniverse creates high-fidelity 3D inputs from the real world—built for reconstruction, localization, and semantic understanding. Watch the full YouTube playlist: #NianticSpatial #Scaniverse #Reconstruction #VPS #GeospatialAI #AI #PhysicalAI

Our product team walks through the full journey: Capture → Reconstruct → Localize Scaniverse creates high-fidelity 3D inputs from the real world—built for reconstruction, localization, and semantic understanding. Watch the full YouTube playlist: #NianticSpatial #Scaniverse #Reconstruction #VPS #GeospatialAI #AI #PhysicalAI

Niantic Spatial 🌎

10,943 görüntüleme • 2 ay önce

WaterSplatting: Fast Underwater 3D Scene Reconstruction Using Gaussian Splatting Project: Method ⬇️ 1 I 2

WaterSplatting: Fast Underwater 3D Scene Reconstruction Using Gaussian Splatting Project: Method ⬇️ 1 I 2

MrNeRF

12,175 görüntüleme • 1 yıl önce

Large-scale 3D Scene Generation (all scenes are real-time rendered)!! Physically-grounded generative data without hallucinations is the missing link for robot learning and testing at scale. We introduce a method that directly generates large-scale 3D driving scenes with accurate geometry, allowing for causal view synthesis and generation with object permanence and explicit 3D geometry. This also allows for extreme trajectory extrapolation without failure! We also show that we can build fully data-driven simulators for end-to-end learning with this approach. Project: with the amazing team of Julian Ost, Amogh Joshi , Andrea Ramazzina, Maximilian Bömer, Mario Bijelic.

Large-scale 3D Scene Generation (all scenes are real-time rendered)!! Physically-grounded generative data without hallucinations is the missing link for robot learning and testing at scale. We introduce a method that directly generates large-scale 3D driving scenes with accurate geometry, allowing for causal view synthesis and generation with object permanence and explicit 3D geometry. This also allows for extreme trajectory extrapolation without failure! We also show that we can build fully data-driven simulators for end-to-end learning with this approach. Project: with the amazing team of Julian Ost, Amogh Joshi , Andrea Ramazzina, Maximilian Bömer, Mario Bijelic.

Felix Heide

27,763 görüntüleme • 9 ay önce

🚀 Introducing Salesforce's game-changer: Data Cloud Vector Database + Einstein Copilot Semantic Search! ✨ Harness both structured & unstructured data for smarter AI responses. No more costly training! Real-time data-driven insights with RAG, complete with citations to curb AI hallucinations. Trust in enterprise AI just got a major upgrade, thanks to Salesforce! ❤️

🚀 Introducing Salesforce's game-changer: Data Cloud Vector Database + Einstein Copilot Semantic Search! ✨ Harness both structured & unstructured data for smarter AI responses. No more costly training! Real-time data-driven insights with RAG, complete with citations to curb AI hallucinations. Trust in enterprise AI just got a major upgrade, thanks to Salesforce! ❤️

Marc Benioff

113,094 görüntüleme • 2 yıl önce

New concept! With Data Binding! Highly visual design + strong logic + real data in Rive . Emotional + functional. All size and price values sync + transform live in Rive! ✨ Big thanks to Uliana Kalashnikova for setting up data binding! Workflow: AI images → PS → Rive (animation + logic) → data binding → generated sound Try it: More complex, data-driven projects coming soon!

New concept! With Data Binding! Highly visual design + strong logic + real data in Rive . Emotional + functional. All size and price values sync + transform live in Rive! ✨ Big thanks to Uliana Kalashnikova for setting up data binding! Workflow: AI images → PS → Rive (animation + logic) → data binding → generated sound Try it: More complex, data-driven projects coming soon!

Daria Nevezhyna

23,844 görüntüleme • 1 yıl önce

Chucky's reconstruction scene is ASMR

Chucky's reconstruction scene is ASMR

𝙱𝙴 𝙰𝙵𝚁𝙰𝙸𝙳

33,733 görüntüleme • 2 ay önce

If the Fed is data dependent and the data is bad, make-up cuts are needed. President Donald J. Trump showed the system was broken, and now it’s time to fix it with real data. E.J. Antoni, Ph.D. is the right leader for BLS with integrity, data-driven focus, and a relentless commitment to pursuing the truth.

If the Fed is data dependent and the data is bad, make-up cuts are needed. President Donald J. Trump showed the system was broken, and now it’s time to fix it with real data. E.J. Antoni, Ph.D. is the right leader for BLS with integrity, data-driven focus, and a relentless commitment to pursuing the truth.

Treasury Secretary Scott Bessent

524,342 görüntüleme • 9 ay önce