Загрузка видео...

Не удалось загрузить видео

На главную

Our SOTA world model, Echo, reconstructs high-quality scenes from sparse inputs and fills missing areas using its world knowledge. That means far less capture, data, and prep to produce geometrically consistent, multi-room reconstructions. We can’t wait to share it. Public release coming soon

SpAItial_AI's profile picture

SpAItial AI

4,392 subscribers

10,500 просмотров • 1 месяц назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Large, consistent, and high-quality 3D worlds from simple iPhone recordings. Works for multi-room scenes, fills missing gaps consistently while maintaining high quality, and it’s super easy to use. Now in beta with partners and coming soon to the SpAItial API. Link to the scenes in the comments so you can navigate this world yourself 👇🏽
0:54

Large, consistent, and high-quality 3D worlds from simple iPhone recordings. Works for multi-room scenes, fills missing gaps consistently while maintaining high quality, and it’s super easy to use. Now in beta with partners and coming soon to the SpAItial API. Link to the scenes in the comments so you can navigate this world yourself 👇🏽

SpAItial AI

66,875 просмотров • 1 день назад

NEWS: Waymo has introduced the Waymo World Model, "a frontier generative model built on Google DeepMind’s Genie 3 that sets a new bar for large-scale, hyper-realistic autonomous driving simulation." "By simulating the “impossible”, we proactively prepare the Waymo Driver for some of the most rare and complex scenarios—from tornadoes to planes landing on freeways—long before it encounters them in the real world. The model’s architecture offers high controllability, allowing our engineers to modify simulations with simple language prompts, driving inputs, and scene layouts. Notably, the Waymo World Model generates high-fidelity, multi-sensor outputs that include both camera and lidar data. This combination of broad world knowledge, fine-grained controllability, and multi-modal realism enhances Waymo’s ability to safely scale our service across more places and new driving environments. In the following sections we showcase the Waymo World Model in action, featuring simulations of the Waymo Driver navigating diverse rare edge-case scenarios." More info below.
1:03

NEWS: Waymo has introduced the Waymo World Model, "a frontier generative model built on Google DeepMind’s Genie 3 that sets a new bar for large-scale, hyper-realistic autonomous driving simulation." "By simulating the “impossible”, we proactively prepare the Waymo Driver for some of the most rare and complex scenarios—from tornadoes to planes landing on freeways—long before it encounters them in the real world. The model’s architecture offers high controllability, allowing our engineers to modify simulations with simple language prompts, driving inputs, and scene layouts. Notably, the Waymo World Model generates high-fidelity, multi-sensor outputs that include both camera and lidar data. This combination of broad world knowledge, fine-grained controllability, and multi-modal realism enhances Waymo’s ability to safely scale our service across more places and new driving environments. In the following sections we showcase the Waymo World Model in action, featuring simulations of the Waymo Driver navigating diverse rare edge-case scenarios." More info below.

Sawyer Merritt

133,168 просмотров • 6 месяцев назад

📸 A few photos. ⚡ A few seconds. A high-quality 3D scene！🎬 Meet Topos-Lite, our new 3D Gaussian Splatting model. With just a few sparse multi-view images, it can generate a high-quality, renderable 3D scene in few seconds We’re excited to share more soon. The technical report is coming shortly — stay tuned and stay in touch. 👀 #ToposLite #3DGS #3DGeneration #SpatialAI #AIGC #photograph #3DArtwork
1:03

📸 A few photos. ⚡ A few seconds. A high-quality 3D scene！🎬 Meet Topos-Lite, our new 3D Gaussian Splatting model. With just a few sparse multi-view images, it can generate a high-quality, renderable 3D scene in few seconds We’re excited to share more soon. The technical report is coming shortly — stay tuned and stay in touch. 👀 #ToposLite #3DGS #3DGeneration #SpatialAI #AIGC #photograph #3DArtwork

InSpatio｜影溯

22,935 просмотров • 1 месяц назад

We got a robot to clean up homes that were never seen in its training data! Our new model, π-0.5, aims to tackle open-world generalization. We took our robot into homes that were not in the training data and asked it to clean kitchens and bedrooms. More below⤵️
3:09

We got a robot to clean up homes that were never seen in its training data! Our new model, π-0.5, aims to tackle open-world generalization. We took our robot into homes that were not in the training data and asked it to clean kitchens and bedrooms. More below⤵️

Physical Intelligence

492,169 просмотров • 1 год назад

Introducing 👀Stereo4D👀 A method for mining 4D from internet stereo videos. It enables large-scale, high-quality, dynamic, *metric* 3D reconstructions, with camera poses and long-term 3D motion trajectories. We used Stereo4D to make a dataset of over 100k real-world 4D scenes.
1:04

Introducing 👀Stereo4D👀 A method for mining 4D from internet stereo videos. It enables large-scale, high-quality, dynamic, *metric* 3D reconstructions, with camera poses and long-term 3D motion trajectories. We used Stereo4D to make a dataset of over 100k real-world 4D scenes.

Linyi Jin

94,588 просмотров • 1 год назад

🤔What does it take to train an omni world model from scratch? 📽️Petabytes of video. 6⃣pipeline stages. And every improvement in data quality pays off twice when you're training a model that both generates and understands video. Our Reka Labs' data team on how it works → #PhysicalAI #WorldModels #AI #RekaLabs
0:38

🤔What does it take to train an omni world model from scratch? 📽️Petabytes of video. 6⃣pipeline stages. And every improvement in data quality pays off twice when you're training a model that both generates and understands video. Our Reka Labs' data team on how it works → #PhysicalAI #WorldModels #AI #RekaLabs

Reka

15,090 просмотров • 1 месяц назад

V3D Video Diffusion Models are Effective 3D Generators Automatic 3D generation has recently attracted widespread attention. Recent methods have greatly accelerated the generation speed, but usually produce less-detailed objects due to limited model capacity or 3D data. Motivated by recent advancements in video diffusion models, we introduce V3D, which leverages the world simulation capacity of pre-trained video diffusion models to facilitate 3D generation. To fully unleash the potential of video diffusion to perceive the 3D world, we further introduce geometrical consistency prior and extend the video diffusion model to a multi-view consistent 3D generator. Benefiting from this, the state-of-the-art video diffusion model could be fine-tuned to generate 360degree orbit frames surrounding an object given a single image. With our tailored reconstruction pipelines, we can generate high-quality meshes or 3D Gaussians within 3 minutes. Furthermore, our method can be extended to scene-level novel view synthesis, achieving precise control over the camera path with sparse input views. Extensive experiments demonstrate the superior performance of the proposed approach, especially in terms of generation quality and multi-view consistency
0:21

V3D Video Diffusion Models are Effective 3D Generators Automatic 3D generation has recently attracted widespread attention. Recent methods have greatly accelerated the generation speed, but usually produce less-detailed objects due to limited model capacity or 3D data. Motivated by recent advancements in video diffusion models, we introduce V3D, which leverages the world simulation capacity of pre-trained video diffusion models to facilitate 3D generation. To fully unleash the potential of video diffusion to perceive the 3D world, we further introduce geometrical consistency prior and extend the video diffusion model to a multi-view consistent 3D generator. Benefiting from this, the state-of-the-art video diffusion model could be fine-tuned to generate 360degree orbit frames surrounding an object given a single image. With our tailored reconstruction pipelines, we can generate high-quality meshes or 3D Gaussians within 3 minutes. Furthermore, our method can be extended to scene-level novel view synthesis, achieving precise control over the camera path with sparse input views. Extensive experiments demonstrate the superior performance of the proposed approach, especially in terms of generation quality and multi-view consistency

AK

31,997 просмотров • 2 лет назад

This is an update on Loftia’s Beta and Early Access timelines 🌱☀️ It’s been an incredible 3 years and we truly wouldn’t be here without the support from this amazing community! Thank you for everything, and we can’t wait to share our cozy world with you soon 💛
2:05

This is an update on Loftia’s Beta and Early Access timelines 🌱☀️ It’s been an incredible 3 years and we truly wouldn’t be here without the support from this amazing community! Thank you for everything, and we can’t wait to share our cozy world with you soon 💛

☁️ Loftia - Wishlist on Steam! ☁️

13,840 просмотров • 7 месяцев назад

🚨 JUST IN: You’ve asked for it, and it’s happening! RavenQuest will be coming to MOBILE for Full-Release, making it more accessible for players around the world! 🌍 It’s still early, but we couldn’t wait to share this with you. Check out what we’ve got so far 👇
0:21

🚨 JUST IN: You’ve asked for it, and it’s happening! RavenQuest will be coming to MOBILE for Full-Release, making it more accessible for players around the world! 🌍 It’s still early, but we couldn’t wait to share this with you. Check out what we’ve got so far 👇

RavenQuest

21,504 просмотров • 1 год назад

📢📢 𝐏𝐞𝐫𝐜𝐇𝐞𝐚𝐝: 𝐏𝐞𝐫𝐜𝐞𝐩𝐭𝐮𝐚𝐥 𝐇𝐞𝐚𝐝 𝐌𝐨𝐝𝐞𝐥 𝐟𝐨𝐫 𝐒𝐢𝐧𝐠𝐥𝐞-𝐈𝐦𝐚𝐠𝐞 𝟑𝐃 𝐇𝐞𝐚𝐝 𝐑𝐞𝐜𝐨𝐧𝐬𝐭𝐫𝐮𝐜𝐭𝐢𝐨𝐧 & 𝐄𝐝𝐢𝐭𝐢𝐧𝐠📢📢 PercHead reconstructs realistic 3D heads from a single image and enables disentangled 3D editing via geometric controls and style inputs from images or text. At its core is a generalized 3D head decoder trained with perceptual supervision from DINOv2 and SAM 2.1. We find that our new perceptual loss formulation improves reconstruction fidelity compared to commonly-used methods such as LPIPS. Our trained reconstruction model is able to generate 3D-consistent heads from a single input image. Even with challenging side-view inputs, the model robustly infers missing regions for a coherent, high-fidelity output. In addition, our architecture seamlessly adapts to downstream tasks: by swapping the encoder, we can transform the model into a disentangled 3D editing pipeline. In this scenario, we can control geometry through - potentially hand-drawn - segmentation maps, and condition style via image or text prompt. We also provide an interactive GUI to enable the exploration of our editing pipeline. 🌍 📽️ Great work by Antonio Oroz and Tobias Kirschstein
0:30

📢📢 𝐏𝐞𝐫𝐜𝐇𝐞𝐚𝐝: 𝐏𝐞𝐫𝐜𝐞𝐩𝐭𝐮𝐚𝐥 𝐇𝐞𝐚𝐝 𝐌𝐨𝐝𝐞𝐥 𝐟𝐨𝐫 𝐒𝐢𝐧𝐠𝐥𝐞-𝐈𝐦𝐚𝐠𝐞 𝟑𝐃 𝐇𝐞𝐚𝐝 𝐑𝐞𝐜𝐨𝐧𝐬𝐭𝐫𝐮𝐜𝐭𝐢𝐨𝐧 & 𝐄𝐝𝐢𝐭𝐢𝐧𝐠📢📢 PercHead reconstructs realistic 3D heads from a single image and enables disentangled 3D editing via geometric controls and style inputs from images or text. At its core is a generalized 3D head decoder trained with perceptual supervision from DINOv2 and SAM 2.1. We find that our new perceptual loss formulation improves reconstruction fidelity compared to commonly-used methods such as LPIPS. Our trained reconstruction model is able to generate 3D-consistent heads from a single input image. Even with challenging side-view inputs, the model robustly infers missing regions for a coherent, high-fidelity output. In addition, our architecture seamlessly adapts to downstream tasks: by swapping the encoder, we can transform the model into a disentangled 3D editing pipeline. In this scenario, we can control geometry through - potentially hand-drawn - segmentation maps, and condition style via image or text prompt. We also provide an interactive GUI to enable the exploration of our editing pipeline. 🌍 📽️ Great work by Antonio Oroz and Tobias Kirschstein

Matthias Niessner

18,885 просмотров • 9 месяцев назад

Today, we are open-sourcing Hunyuan World 1.1 (WorldMirror), a universal feed-forward 3D reconstruction model. 🚀🚀🚀 While our previously released Hunyuan World 1.0 (open-sourced, lite version deployable on consumer GPUs) focused on generating 3D worlds from text or single-view images, Hunyuan World 1.1 significantly expands the input scope by unlocking video-to-3D and multi-view-to-3D world creation. Highlights: 🔹Any Input, Maximized Flexibility and Fidelity: Flexibly integrates diverse geometric priors (camera poses, intrinsics, depth maps) to resolve structural ambiguities and ensure geometrically consistent 3D outputs. 🔹Any Output, SOTA Results：This elegant architecture simultaneously generates multiple 3D representations: dense point clouds, multi-view depth maps, camera parameters, surface normals, and 3D Gaussian Splattings. 🔹Single-GPU & Fast Inference: As an all-in-one, feed-forward model, Hunyuan World 1.1 runs on a single GPU and delivers all 3D attributes in a single forward pass, within seconds. 🌐Project Page: 🔗Github： 🤗Hugging Face： ✨Demo: 📄Technical Report:
1:20

Today, we are open-sourcing Hunyuan World 1.1 (WorldMirror), a universal feed-forward 3D reconstruction model. 🚀🚀🚀 While our previously released Hunyuan World 1.0 (open-sourced, lite version deployable on consumer GPUs) focused on generating 3D worlds from text or single-view images, Hunyuan World 1.1 significantly expands the input scope by unlocking video-to-3D and multi-view-to-3D world creation. Highlights: 🔹Any Input, Maximized Flexibility and Fidelity: Flexibly integrates diverse geometric priors (camera poses, intrinsics, depth maps) to resolve structural ambiguities and ensure geometrically consistent 3D outputs. 🔹Any Output, SOTA Results：This elegant architecture simultaneously generates multiple 3D representations: dense point clouds, multi-view depth maps, camera parameters, surface normals, and 3D Gaussian Splattings. 🔹Single-GPU & Fast Inference: As an all-in-one, feed-forward model, Hunyuan World 1.1 runs on a single GPU and delivers all 3D attributes in a single forward pass, within seconds. 🌐Project Page: 🔗Github： 🤗Hugging Face： ✨Demo: 📄Technical Report:

Tencent Hy

168,625 просмотров • 10 месяцев назад

AI is only as good as its data. Everyone talks about building smarter AI models, but fewer people ask where the training data comes from. That’s what makes Humyn Labs interesting. They’re focused on collecting high-quality, real-world human data across different environments, behaviors, and sensory inputs. Because if AI is going to understand the physical world, it first needs to learn from the people who already live and work in it. I shared my thoughts in this short video. Let me know what stood out to you. 👇🎥 Humyn Labs KGeN Community #KGeN
1:20

AI is only as good as its data. Everyone talks about building smarter AI models, but fewer people ask where the training data comes from. That’s what makes Humyn Labs interesting. They’re focused on collecting high-quality, real-world human data across different environments, behaviors, and sensory inputs. Because if AI is going to understand the physical world, it first needs to learn from the people who already live and work in it. I shared my thoughts in this short video. Let me know what stood out to you. 👇🎥 Humyn Labs KGeN Community #KGeN

Bahdfella™ ❤️‍🔥

18,156 просмотров • 1 месяц назад

📢📢GenRecon: Bridging Generative Priors for Multi-View 3D Scene Reconstruction📢📢 Reconstructing high-fidelity 3D scenes from sparse RGB input is hard. It needs a strong 3D prior! We reformulate multi-view scene reconstruction as conditional 3D generation over overlapping spatial chunks, lifting posed image features into a generative shape prior via 3D conditioning. As an example prior, we build on Trellis2, and train it such that its reconstruction is pixel aligned and matches from all views. GenRecon achieves unprecedented reconstruction quality from any sparse RGB input sequence, even from a phone capture. The reconstruction also includes PBR materials which facilitates relighting and virtual object insertion. Amazing work by Katharina Schmid, Nicolas von Lützow, Jozef, Angela Dai
0:26

📢📢GenRecon: Bridging Generative Priors for Multi-View 3D Scene Reconstruction📢📢 Reconstructing high-fidelity 3D scenes from sparse RGB input is hard. It needs a strong 3D prior! We reformulate multi-view scene reconstruction as conditional 3D generation over overlapping spatial chunks, lifting posed image features into a generative shape prior via 3D conditioning. As an example prior, we build on Trellis2, and train it such that its reconstruction is pixel aligned and matches from all views. GenRecon achieves unprecedented reconstruction quality from any sparse RGB input sequence, even from a phone capture. The reconstruction also includes PBR materials which facilitates relighting and virtual object insertion. Amazing work by Katharina Schmid, Nicolas von Lützow, Jozef, Angela Dai

Matthias Niessner

18,204 просмотров • 2 месяцев назад

World models hold a lot of promise for robotics, but they're data hungry and often struggle with long horizons. We learn models from a few (< 10) human demos that enable a robot to plan in completely novel scenes! Our key idea is to model *symbols* not pixels 👇
0:30

World models hold a lot of promise for robotics, but they're data hungry and often struggle with long horizons. We learn models from a few (< 10) human demos that enable a robot to plan in completely novel scenes! Our key idea is to model *symbols* not pixels 👇

Nishanth Kumar

82,931 просмотров • 11 месяцев назад

We have officially submitted our project to the Pump.fun Hackathon. Through this initiative, our goal is to test Grok in real world conditions and push it to its full operational limits. We want to explore the complete range of it's capabilities, observe how it performs under continuous and complex decision making scenarios, and clearly understand where it's strengths end and it's boundaries begin. This is not a theoretical experiment. We are applying Grok across hardware, software, and physical systems, using live data and real world constraints. Our long term vision is to scale this into something much bigger a fully automated, real world farm powered by robotics, intelligent systems, and AI driven optimization. By building in public and testing without shortcuts, we aim to learn fast, iterate openly, and discover how far this technology can truly go.
3:26

We have officially submitted our project to the Pump.fun Hackathon. Through this initiative, our goal is to test Grok in real world conditions and push it to its full operational limits. We want to explore the complete range of it's capabilities, observe how it performs under continuous and complex decision making scenarios, and clearly understand where it's strengths end and it's boundaries begin. This is not a theoretical experiment. We are applying Grok across hardware, software, and physical systems, using live data and real world constraints. Our long term vision is to scale this into something much bigger a fully automated, real world farm powered by robotics, intelligent systems, and AI driven optimization. By building in public and testing without shortcuts, we aim to learn fast, iterate openly, and discover how far this technology can truly go.

Grok Potato

32,252 просмотров • 7 месяцев назад

🎉 LOFTIA IS COMING THIS FALL! 🎉 After 4 years of building Loftia, we’re so excited to announce our release window of Fall 2026! Loftia is a life-sim MMO where you can farm, craft, decorate and build a solarpunk world together! We can’t wait to see you in the skies soon 💛🥰🌱
0:57

🎉 LOFTIA IS COMING THIS FALL! 🎉 After 4 years of building Loftia, we’re so excited to announce our release window of Fall 2026! Loftia is a life-sim MMO where you can farm, craft, decorate and build a solarpunk world together! We can’t wait to see you in the skies soon 💛🥰🌱

☁️ Loftia - Wishlist on Steam! ☁️

171,686 просмотров • 2 месяцев назад

"The Covid pandemic showed us the importance of training Africa’s health workforce. New health challenges have continued to arise, since then. We need to lean into advancements in science and technology, and provide better learning opportunities for health professionals. In Rwanda, we aim to quadruple our health workers in the next four years. The WHO Academy will be instrumental in helping us achieve this objective, and we intend to make full use of it. We owe it to our people to deliver consistent, affordable, high-quality health care. And for us, this means creating partnerships, where we can benefit from knowledge transfer, in essential fields like biotechnology." Today, President Kagame virtually addressed the inauguration of World Health Organization (WHO) Academy in Lyon, France.
2:27

"The Covid pandemic showed us the importance of training Africa’s health workforce. New health challenges have continued to arise, since then. We need to lean into advancements in science and technology, and provide better learning opportunities for health professionals. In Rwanda, we aim to quadruple our health workers in the next four years. The WHO Academy will be instrumental in helping us achieve this objective, and we intend to make full use of it. We owe it to our people to deliver consistent, affordable, high-quality health care. And for us, this means creating partnerships, where we can benefit from knowledge transfer, in essential fields like biotechnology." Today, President Kagame virtually addressed the inauguration of World Health Organization (WHO) Academy in Lyon, France.

Presidency | Rwanda

54,480 просмотров • 1 год назад

PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Tracking paper page: introduce PointOdyssey, a large-scale synthetic dataset, and data generation framework, for the training and evaluation of long-term fine-grained tracking algorithms. Our goal is to advance the state-of-the-art by placing emphasis on long videos with naturalistic motion. Toward the goal of naturalism, we animate deformable characters using real-world motion capture data, we build 3D scenes to match the motion capture environments, and we render camera viewpoints using trajectories mined via structure-from-motion on real videos. We create combinatorial diversity by randomizing character appearance, motion profiles, materials, lighting, 3D assets, and atmospheric effects. Our dataset currently includes 104 videos, averaging 2,000 frames long, with orders of magnitude more correspondence annotations than prior work. We show that existing methods can be trained from scratch in our dataset and outperform the published variants. Finally, we introduce modifications to the PIPs point tracking method, greatly widening its temporal receptive field, which improves its performance on PointOdyssey as well as on two real-world benchmarks.
0:33

PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Tracking paper page: introduce PointOdyssey, a large-scale synthetic dataset, and data generation framework, for the training and evaluation of long-term fine-grained tracking algorithms. Our goal is to advance the state-of-the-art by placing emphasis on long videos with naturalistic motion. Toward the goal of naturalism, we animate deformable characters using real-world motion capture data, we build 3D scenes to match the motion capture environments, and we render camera viewpoints using trajectories mined via structure-from-motion on real videos. We create combinatorial diversity by randomizing character appearance, motion profiles, materials, lighting, 3D assets, and atmospheric effects. Our dataset currently includes 104 videos, averaging 2,000 frames long, with orders of magnitude more correspondence annotations than prior work. We show that existing methods can be trained from scratch in our dataset and outperform the published variants. Finally, we introduce modifications to the PIPs point tracking method, greatly widening its temporal receptive field, which improves its performance on PointOdyssey as well as on two real-world benchmarks.

AK

122,560 просмотров • 3 лет назад

Just a few months after releasing Scoot, which we feel redefined motion generation quality, our team has made substantial improvements in speed, quality, subtlety, and instruction following. This comes in concert with our newly scaled data collection and labeling efforts, compute increase, substantial architectural improvements, and more stable / scalable training dynamics. Swing is our new flagship movement model. It's live today in Cartwheel studio with infinite batch generation coming soon to our API. Treating Movement as a fundamentally new data type has really unlocked our ability to rapidly make improvements. As it turns out there are far more use cases than you might imagine from entertainment to robotics.
0:26

Just a few months after releasing Scoot, which we feel redefined motion generation quality, our team has made substantial improvements in speed, quality, subtlety, and instruction following. This comes in concert with our newly scaled data collection and labeling efforts, compute increase, substantial architectural improvements, and more stable / scalable training dynamics. Swing is our new flagship movement model. It's live today in Cartwheel studio with infinite batch generation coming soon to our API. Treating Movement as a fundamentally new data type has really unlocked our ability to rapidly make improvements. As it turns out there are far more use cases than you might imagine from entertainment to robotics.

Andrew Carr 🤸

150,661 просмотров • 6 месяцев назад