Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

HY-World 2.0 A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds paper:

_akhaliq's profile picture

AK

508,735 subscribers

13,879 Aufrufe • vor 5 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!
2:41

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!

Santiago

65,446 Aufrufe • vor 5 Monaten

Google's Genie 3 was just announced. This is a world model capable of generating fully interactive 3D worlds. This has major implications for video games and giving agents infinite self-play environments.
12:05

Google's Genie 3 was just announced. This is a world model capable of generating fully interactive 3D worlds. This has major implications for video games and giving agents infinite self-play environments.

Matthew Berman

76,362 Aufrufe • vor 1 Jahr

Excited to share our #ICML2023 paper ✨LIV✨! Extending VIP, LIV is at once a pre-training, fine-tuning, and (zero-shot!) multi-modal reward method for (real-world!) language-conditioned robotic control. Project: Code & Model: 🧵:
0:29

Excited to share our #ICML2023 paper ✨LIV✨! Extending VIP, LIV is at once a pre-training, fine-tuning, and (zero-shot!) multi-modal reward method for (real-world!) language-conditioned robotic control. Project: Code & Model: 🧵:

Jason Ma

55,068 Aufrufe • vor 3 Jahren

We are thrilled to announce a major upgrade to our open-source 3D generation model, introducing two groundbreaking new versions: 3D 2.0 MV (Multi-View Generation) and 3D 2.0 Mini! 3D 2.0 MV : 3D 2.0Mini:
0:39

We are thrilled to announce a major upgrade to our open-source 3D generation model, introducing two groundbreaking new versions: 3D 2.0 MV (Multi-View Generation) and 3D 2.0 Mini! 3D 2.0 MV : 3D 2.0Mini:

Tencent HY

134,410 Aufrufe • vor 1 Jahr

Today, we are open-sourcing Hunyuan World 1.1 (WorldMirror), a universal feed-forward 3D reconstruction model. 🚀🚀🚀 While our previously released Hunyuan World 1.0 (open-sourced, lite version deployable on consumer GPUs) focused on generating 3D worlds from text or single-view images, Hunyuan World 1.1 significantly expands the input scope by unlocking video-to-3D and multi-view-to-3D world creation. Highlights: 🔹Any Input, Maximized Flexibility and Fidelity: Flexibly integrates diverse geometric priors (camera poses, intrinsics, depth maps) to resolve structural ambiguities and ensure geometrically consistent 3D outputs. 🔹Any Output, SOTA Results：This elegant architecture simultaneously generates multiple 3D representations: dense point clouds, multi-view depth maps, camera parameters, surface normals, and 3D Gaussian Splattings. 🔹Single-GPU & Fast Inference: As an all-in-one, feed-forward model, Hunyuan World 1.1 runs on a single GPU and delivers all 3D attributes in a single forward pass, within seconds. 🌐Project Page: 🔗Github： 🤗Hugging Face： ✨Demo: 📄Technical Report:
1:20

Today, we are open-sourcing Hunyuan World 1.1 (WorldMirror), a universal feed-forward 3D reconstruction model. 🚀🚀🚀 While our previously released Hunyuan World 1.0 (open-sourced, lite version deployable on consumer GPUs) focused on generating 3D worlds from text or single-view images, Hunyuan World 1.1 significantly expands the input scope by unlocking video-to-3D and multi-view-to-3D world creation. Highlights: 🔹Any Input, Maximized Flexibility and Fidelity: Flexibly integrates diverse geometric priors (camera poses, intrinsics, depth maps) to resolve structural ambiguities and ensure geometrically consistent 3D outputs. 🔹Any Output, SOTA Results：This elegant architecture simultaneously generates multiple 3D representations: dense point clouds, multi-view depth maps, camera parameters, surface normals, and 3D Gaussian Splattings. 🔹Single-GPU & Fast Inference: As an all-in-one, feed-forward model, Hunyuan World 1.1 runs on a single GPU and delivers all 3D attributes in a single forward pass, within seconds. 🌐Project Page: 🔗Github： 🤗Hugging Face： ✨Demo: 📄Technical Report:

Tencent Hy

168,848 Aufrufe • vor 11 Monaten

Map2World. turns text descriptions and sketch maps into full 3D worlds. -multi-diffusion in SLAT latent space for global consistency; - beaats SynCity - supports arbitrary world sizes.
0:40

Map2World. turns text descriptions and sketch maps into full 3D worlds. -multi-diffusion in SLAT latent space for global consistency; - beaats SynCity - supports arbitrary world sizes.

Wildminder

15,679 Aufrufe • vor 4 Monaten

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.
0:20

Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Video Contribution quote from the paper: In summary, our main contributions are • a comprehensive pipeline for reconstructing the shape, appearance, and behavior of real-world garments using Gaussian splatting, • an algorithm for registering garment meshes to multi- view videos with an optimization procedure based on Gaussian splatting, and • a Gaussian Garment representation that combines triangle meshes with Gaussian textures to capture photorealistic appearance and can be used as a fully controllable 3D asset.

MrNeRF

27,354 Aufrufe • vor 2 Jahren

⚡️ Tencent HY-World 2.1 is HERE! Not a video. A world. 🪐 3 months just after 2.0, we've supercharged everything: ✨ Cleaner geometry ✨ Sharper rendering ✨ Larger explorable range It's a REAL 3D world you can Walk through and Interact with.
0:20

⚡️ Tencent HY-World 2.1 is HERE! Not a video. A world. 🪐 3 months just after 2.0, we've supercharged everything: ✨ Cleaner geometry ✨ Sharper rendering ✨ Larger explorable range It's a REAL 3D world you can Walk through and Interact with.

Tengfei Wang

58,410 Aufrufe • vor 2 Monaten

ByteDance has released Seed3D 2.0, a model capable of generating 3D objects from a single image or a text prompt.
0:57

ByteDance has released Seed3D 2.0, a model capable of generating 3D objects from a single image or a text prompt.

Kashberg

165,485 Aufrufe • vor 4 Monaten

Introducing Cube 2.0, a significant step towards controllable 3D game-world and video generation from any input. Powered by: 🌟 Image-to-3D in seconds w/ a new foundation model 🐎 Text-to-animation 🌎 AI rendering to create beautiful worlds (mesh+splats) Web app → Discord → Blog →
1:11

Introducing Cube 2.0, a significant step towards controllable 3D game-world and video generation from any input. Powered by: 🌟 Image-to-3D in seconds w/ a new foundation model 🐎 Text-to-animation 🌎 AI rendering to create beautiful worlds (mesh+splats) Web app → Discord → Blog →

Common Sense Machines

411,413 Aufrufe • vor 2 Jahren

Marble is the first product from World Labs and is powered by our multimodal world model, which lets anyone create high-fidelity, persistent 3D worlds from just a single image, video, text prompt, or 3D layout. Read more at
0:51

Marble is the first product from World Labs and is powered by our multimodal world model, which lets anyone create high-fidelity, persistent 3D worlds from just a single image, video, text prompt, or 3D layout. Read more at

World Labs

117,381 Aufrufe • vor 10 Monaten

SAM 3D enables accurate 3D reconstruction from a single image, supporting real-world applications in editing, robotics, and interactive scene generation. Matt, a SAM 3D researcher, explains how the two-model design makes this possible for both people and complex environments. 🔗 Read the SAM 3D Objects research paper: 🔗 Read the SAM 3D Body research paper:
1:54

SAM 3D enables accurate 3D reconstruction from a single image, supporting real-world applications in editing, robotics, and interactive scene generation. Matt, a SAM 3D researcher, explains how the two-model design makes this possible for both people and complex environments. 🔗 Read the SAM 3D Objects research paper: 🔗 Read the SAM 3D Body research paper:

AI at Meta

18,031 Aufrufe • vor 10 Monaten

Introducing Agora-1, a multi-agent world model. Multiple participants—human or AI—can now interact inside the same world simulation, all in real-time. Try our playable research preview today, with Agora-1 simulating a multiplayer GoldenEye deathmatch!
1:39

Introducing Agora-1, a multi-agent world model. Multiple participants—human or AI—can now interact inside the same world simulation, all in real-time. Try our playable research preview today, with Agora-1 simulating a multiplayer GoldenEye deathmatch!

Odyssey

917,646 Aufrufe • vor 4 Monaten

Building TikTok for 3D worlds We just reached our 1000th world generated!
0:28

Building TikTok for 3D worlds We just reached our 1000th world generated!

tamrat

26,406 Aufrufe • vor 7 Monaten

Robbyant released LingBot-World 2.0 (Infinity), a new open-source World model capable of generating hour-long experiences. > No quality decay, stable 720p / 60 fps real-time output. > Users can interact with the world via Actions. > The world is dynamic, with built-in agents generating new events in real time. > Multiplayer is supported within the same world. Testing time 👀
0:47

Robbyant released LingBot-World 2.0 (Infinity), a new open-source World model capable of generating hour-long experiences. > No quality decay, stable 720p / 60 fps real-time output. > Users can interact with the world via Actions. > The world is dynamic, with built-in agents generating new events in real time. > Multiplayer is supported within the same world. Testing time 👀

🚨 AI News | TestingCatalog

15,272 Aufrufe • vor 2 Monaten

Did you try Tencent HY World model on fal?
0:20

Did you try Tencent HY World model on fal?

Aykut

14,373 Aufrufe • vor 1 Jahr

Multi-modal #LLMs understand a lot about humans. But do they understand our 3D pose? We train #PoseGPT to estimate, generate, and reason about 3D human pose (#SMPL) in images and text. This is the first true foundation model for understanding 3D humans.
0:37

Multi-modal #LLMs understand a lot about humans. But do they understand our 3D pose? We train #PoseGPT to estimate, generate, and reason about 3D human pose (#SMPL) in images and text. This is the first true foundation model for understanding 3D humans.

Michael Black

81,430 Aufrufe • vor 2 Jahren

Microsoft presents World-R1 Reinforcing 3D Constraints for Text-to-Video Generation paper:
1:11

Microsoft presents World-R1 Reinforcing 3D Constraints for Text-to-Video Generation paper:

AK

24,600 Aufrufe • vor 4 Monaten

NEWS: Waymo has introduced the Waymo World Model, "a frontier generative model built on Google DeepMind’s Genie 3 that sets a new bar for large-scale, hyper-realistic autonomous driving simulation." "By simulating the “impossible”, we proactively prepare the Waymo Driver for some of the most rare and complex scenarios—from tornadoes to planes landing on freeways—long before it encounters them in the real world. The model’s architecture offers high controllability, allowing our engineers to modify simulations with simple language prompts, driving inputs, and scene layouts. Notably, the Waymo World Model generates high-fidelity, multi-sensor outputs that include both camera and lidar data. This combination of broad world knowledge, fine-grained controllability, and multi-modal realism enhances Waymo’s ability to safely scale our service across more places and new driving environments. In the following sections we showcase the Waymo World Model in action, featuring simulations of the Waymo Driver navigating diverse rare edge-case scenarios." More info below.
1:03

NEWS: Waymo has introduced the Waymo World Model, "a frontier generative model built on Google DeepMind’s Genie 3 that sets a new bar for large-scale, hyper-realistic autonomous driving simulation." "By simulating the “impossible”, we proactively prepare the Waymo Driver for some of the most rare and complex scenarios—from tornadoes to planes landing on freeways—long before it encounters them in the real world. The model’s architecture offers high controllability, allowing our engineers to modify simulations with simple language prompts, driving inputs, and scene layouts. Notably, the Waymo World Model generates high-fidelity, multi-sensor outputs that include both camera and lidar data. This combination of broad world knowledge, fine-grained controllability, and multi-modal realism enhances Waymo’s ability to safely scale our service across more places and new driving environments. In the following sections we showcase the Waymo World Model in action, featuring simulations of the Waymo Driver navigating diverse rare edge-case scenarios." More info below.

Sawyer Merritt

133,325 Aufrufe • vor 7 Monaten

Our Puffin-World technical paper is now available. From one image or text prompt, it generates camera-controlled views with appearance, geometry and physical grounding, then reconstructs them into an explorable 3D world—all in one unified model. Paper: Blog: Dataset: Code:
1:56

Our Puffin-World technical paper is now available. From one image or text prompt, it generates camera-controlled views with appearance, geometry and physical grounding, then reconstructs them into an explorable 3D world—all in one unified model. Paper: Blog: Dataset: Code:

Chen Change Loy

10,208 Aufrufe • vor 14 Tagen