Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

🌟Your static 3D world models are now alive and interactable! 🚀Introducing NeuROK, a neural simulation framework that turns any static 3D object into an interactive 4D asset — no per-category physics, no physical annotations for training. 📄 🧵 1/n

Chen Geng

1,416 subscribers

32,887 views • 2 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

🚀 Introducing Articulate Anymesh – now open-sourced! An automated framework behind our Genesis simulator, capable of transforming any rigid 3D mesh into its articulated counterpart using an open-vocabulary manner! Given a 3D mesh, our framework uses VLMs + visual prompting to extract rich semantics — enabling part segmentation and functional joint construction automatically! 🔗 Code: 📄 Paper: 🌐 Project: #EmbodiedAI #3D #OpenSource #VLM #MeshProcessing

🚀 Introducing Articulate Anymesh – now open-sourced! An automated framework behind our Genesis simulator, capable of transforming any rigid 3D mesh into its articulated counterpart using an open-vocabulary manner! Given a 3D mesh, our framework uses VLMs + visual prompting to extract rich semantics — enabling part segmentation and functional joint construction automatically! 🔗 Code: 📄 Paper: 🌐 Project: #EmbodiedAI #3D #OpenSource #VLM #MeshProcessing

Chuang Gan

35,936 views • 1 year ago

We’re open-sourcing HY-World 2.0, a multimodal world model that generates, reconstructs, and simulates interactive *3D worlds* from text, images, and videos. Outputs can be integrated into game engines and embodied simulation pipelines. Key highlights: 🔹 One-click world generation Turn text or image into interactive 3D worlds automatically. 🔹 Pipeline-ready 3D outputs Editable 3D worlds for Unity and Unreal Engine, with standard 3D exports including mesh, 3DGS, and point clouds. 🔹 Unified world model system One model family for world generation and reconstruction across synthetic and real-world scenes. 🔹 Interactive character mode Explore generated 3D worlds in real time with physics-aware movement and collision support. ✨ Apply for access: 🔗 GitHub: 🤗 Hugging Face: 📄 Technical Report:

We’re open-sourcing HY-World 2.0, a multimodal world model that generates, reconstructs, and simulates interactive 3D worlds from text, images, and videos. Outputs can be integrated into game engines and embodied simulation pipelines. Key highlights: 🔹 One-click world generation Turn text or image into interactive 3D worlds automatically. 🔹 Pipeline-ready 3D outputs Editable 3D worlds for Unity and Unreal Engine, with standard 3D exports including mesh, 3DGS, and point clouds. 🔹 Unified world model system One model family for world generation and reconstruction across synthetic and real-world scenes. 🔹 Interactive character mode Explore generated 3D worlds in real time with physics-aware movement and collision support. ✨ Apply for access: 🔗 GitHub: 🤗 Hugging Face: 📄 Technical Report:

Tencent Hy

371,581 views • 4 months ago

Everything you love about generative models — now powered by real physics! Announcing the Genesis project — after a 24-month large-scale research collaboration involving over 20 research labs — a generative physics engine able to generate 4D dynamical worlds powered by a physics simulation platform designed for general-purpose robotics and physical AI applications. Genesis's physics engine is developed in pure Python, while being 10-80x faster than existing GPU-accelerated stacks like Isaac Gym and MJX. It delivers a simulation speed ~430,000 faster than in real-time, and takes only 26 seconds to train a robotic locomotion policy transferrable to the real world on a single RTX4090 (see tutorial: The Genesis physics engine and simulation platform is fully open source at We'll gradually roll out access to our generative framework in the near future. Genesis implements a unified simulation framework all from scratch, integrating a wide spectrum of state-of-the-art physics solvers, allowing simulation of the whole physical world in a virtual realm with the highest realism. We aim to build a universal data engine that leverages an upper-level generative framework to autonomously create physical worlds, together with various modes of data, including environments, camera motions, robotic task proposals, reward functions, robot policies, character motions, fully interactive 3D scenes, open-world articulated assets, and more, aiming towards fully automated data generation for robotics, physical AI and other applications. Open Source Code: Project webpage: Documentation: 1/n

Everything you love about generative models — now powered by real physics! Announcing the Genesis project — after a 24-month large-scale research collaboration involving over 20 research labs — a generative physics engine able to generate 4D dynamical worlds powered by a physics simulation platform designed for general-purpose robotics and physical AI applications. Genesis's physics engine is developed in pure Python, while being 10-80x faster than existing GPU-accelerated stacks like Isaac Gym and MJX. It delivers a simulation speed ~430,000 faster than in real-time, and takes only 26 seconds to train a robotic locomotion policy transferrable to the real world on a single RTX4090 (see tutorial: The Genesis physics engine and simulation platform is fully open source at We'll gradually roll out access to our generative framework in the near future. Genesis implements a unified simulation framework all from scratch, integrating a wide spectrum of state-of-the-art physics solvers, allowing simulation of the whole physical world in a virtual realm with the highest realism. We aim to build a universal data engine that leverages an upper-level generative framework to autonomously create physical worlds, together with various modes of data, including environments, camera motions, robotic task proposals, reward functions, robot policies, character motions, fully interactive 3D scenes, open-world articulated assets, and more, aiming towards fully automated data generation for robotics, physical AI and other applications. Open Source Code: Project webpage: Documentation: 1/n

Zhou Xian

3,819,325 views • 1 year ago

“This took less than an hour." Interactive 3D is becoming essential across industries - but for a lot of teams, it’s still out of reach. That’s why we built Unity Studio - an intuitive, web-based, no-code editor that helps teams across industries, from manufacturing to retail, turn existing 3D assets into interactive experiences, straight from the browser. Check out what it looks like to go from a static 3D file to a fully interactive demo in under an hour. 🔗 Try it out yourself with a free 30 day Unity Studio trial:

“This took less than an hour." Interactive 3D is becoming essential across industries - but for a lot of teams, it’s still out of reach. That’s why we built Unity Studio - an intuitive, web-based, no-code editor that helps teams across industries, from manufacturing to retail, turn existing 3D assets into interactive experiences, straight from the browser. Check out what it looks like to go from a static 3D file to a fully interactive demo in under an hour. 🔗 Try it out yourself with a free 30 day Unity Studio trial:

Unity

10,408 views • 3 months ago

3D-LLM: Injecting the 3D World into Large Language Models paper page: Large language models (LLMs) and Vision-Language Models (VLMs) have been proven to excel at multiple tasks, such as commonsense reasoning. Powerful as these models can be, they are not grounded in the 3D physical world, which involves richer concepts such as spatial relationships, affordances, physics, layout, and so on. In this work, we propose to inject the 3D world into large language models and introduce a whole new family of 3D-LLMs. Specifically, 3D-LLMs can take 3D point clouds and their features as input and perform a diverse set of 3D-related tasks, including captioning, dense captioning, 3D question answering, task decomposition, 3D grounding, 3D-assisted dialog, navigation, and so on. Using three types of prompting mechanisms that we design, we are able to collect over 300k 3D-language data covering these tasks. To efficiently train 3D-LLMs, we first utilize a 3D feature extractor that obtains 3D features from rendered multi- view images. Then, we use 2D VLMs as our backbones to train our 3D-LLMs. By introducing a 3D localization mechanism, 3D-LLMs can better capture 3D spatial information. Experiments on ScanQA show that our model outperforms state-of-the-art baselines by a large margin (e.g., the BLEU-1 score surpasses state-of-the-art score by 9%). Furthermore, experiments on our held-in datasets for 3D captioning, task composition, and 3D-assisted dialogue show that our model outperforms 2D VLMs. Qualitative examples also show that our model could perform more tasks beyond the scope of existing LLMs and VLMs.

3D-LLM: Injecting the 3D World into Large Language Models paper page: Large language models (LLMs) and Vision-Language Models (VLMs) have been proven to excel at multiple tasks, such as commonsense reasoning. Powerful as these models can be, they are not grounded in the 3D physical world, which involves richer concepts such as spatial relationships, affordances, physics, layout, and so on. In this work, we propose to inject the 3D world into large language models and introduce a whole new family of 3D-LLMs. Specifically, 3D-LLMs can take 3D point clouds and their features as input and perform a diverse set of 3D-related tasks, including captioning, dense captioning, 3D question answering, task decomposition, 3D grounding, 3D-assisted dialog, navigation, and so on. Using three types of prompting mechanisms that we design, we are able to collect over 300k 3D-language data covering these tasks. To efficiently train 3D-LLMs, we first utilize a 3D feature extractor that obtains 3D features from rendered multi- view images. Then, we use 2D VLMs as our backbones to train our 3D-LLMs. By introducing a 3D localization mechanism, 3D-LLMs can better capture 3D spatial information. Experiments on ScanQA show that our model outperforms state-of-the-art baselines by a large margin (e.g., the BLEU-1 score surpasses state-of-the-art score by 9%). Furthermore, experiments on our held-in datasets for 3D captioning, task composition, and 3D-assisted dialogue show that our model outperforms 2D VLMs. Qualitative examples also show that our model could perform more tasks beyond the scope of existing LLMs and VLMs.

AK

249,798 views • 3 years ago

THIS GUY VIBE CODED A TOOL THAT TURNS ANY SVG INTO A 3D OBJECT YOU CAN SPIN, ANIMATE, AND EMBED drag in an SVG, type some text, or draw pixel art. it becomes a 3D object instantly. spin it around, animate it, and embed it on your site. export as 4K image or video. runs entirely in your browser and nothing gets uploaded to any server with no account needed. 100% free AND its open source. this is one of those tools you didn't know you needed until you see it

THIS GUY VIBE CODED A TOOL THAT TURNS ANY SVG INTO A 3D OBJECT YOU CAN SPIN, ANIMATE, AND EMBED drag in an SVG, type some text, or draw pixel art. it becomes a 3D object instantly. spin it around, animate it, and embed it on your site. export as 4K image or video. runs entirely in your browser and nothing gets uploaded to any server with no account needed. 100% free AND its open source. this is one of those tools you didn't know you needed until you see it

Om Patel

230,757 views • 4 months ago

someone open-sourced a tool that turns any phone video into a full 3D world in real time. you record a walk around your house, drop the mp4 in, and the entire scene comes back as a walkable 996k-point world at 60fps on your local GPU. no cloud. no subscription. runs 100% locally. 100% open source.

someone open-sourced a tool that turns any phone video into a full 3D world in real time. you record a walk around your house, drop the mp4 in, and the entire scene comes back as a walkable 996k-point world at 60fps on your local GPU. no cloud. no subscription. runs 100% locally. 100% open source.

Superman

817,010 views • 1 month ago

Microsoft open-sourced a 4B model that turns any image into a production-ready 3D asset in 3 seconds. It’s called TRELLIS.2, a fully textured, physically accurate 3D models with PBR textures out of the box. → Full PBR (base color, roughness, metallic, opacity) → Handles hair, cloth, glass, non-manifold geometry → Exports .glb ready for Unity/Unreal/Blender → Runs locally, ships in 3 seconds It's not a demo or a research preview. The full training codebase is public. You can fine-tune it on your own asset library and get a model that generates in your studio's exact style. 100% Open Source

Microsoft open-sourced a 4B model that turns any image into a production-ready 3D asset in 3 seconds. It’s called TRELLIS.2, a fully textured, physically accurate 3D models with PBR textures out of the box. → Full PBR (base color, roughness, metallic, opacity) → Handles hair, cloth, glass, non-manifold geometry → Exports .glb ready for Unity/Unreal/Blender → Runs locally, ships in 3 seconds It's not a demo or a research preview. The full training codebase is public. You can fine-tune it on your own asset library and get a model that generates in your studio's exact style. 100% Open Source

Superman

281,306 views • 22 days ago

Today, we’re launching a new capability that connects everything we’ve been building directly to the robotics world: free USDZ export. Turn any real-world space into a robot training ground. For FREE. Capture with your smartphone or a 360 cam → get a simulation-ready USDZ (Gaussian splat + aligned mesh) → drop it straight into NVIDIA Isaac Sim. No LiDAR rig. No sales call. 🧵👇

Today, we’re launching a new capability that connects everything we’ve been building directly to the robotics world: free USDZ export. Turn any real-world space into a robot training ground. For FREE. Capture with your smartphone or a 360 cam → get a simulation-ready USDZ (Gaussian splat + aligned mesh) → drop it straight into NVIDIA Isaac Sim. No LiDAR rig. No sales call. 🧵👇

Over the Reality 🌐

29,245 views • 1 month ago

🚀 Announcing Echo — our new frontier model for 3D world generation. Echo turns a simple text prompt or image into a fully explorable, 3D-consistent world. Instead of disconnected views, the result is a single, coherent spatial representation you can move through freely. This is part of a bigger shift in AI: from generating pixels and tokens to generating spaces. Echo predicts a geometry-grounded 3D scene at metric scale, meaning every novel view, depth map, and interaction comes from the same underlying world — not independent hallucinations. Once generated, the world is interactive in real time. You control the camera, explore from any angle, and render instantly — even on low-end hardware, directly in the browser. High-quality 3D world exploration is no longer gated by expensive equipment. Under the hood, Echo infers a physically grounded 3D representation and converts it into a renderable format. For our web demo, we use 3D Gaussian Splatting (3DGS) for fast, GPU-friendly rendering — but the representation itself is flexible and can be easily adapted. Why this matters: consistent 3D worlds unlock real workflows — digital twins, 3D design, game environments, robotics simulation, and more. From a single photo or a line of text, Echo builds worlds that are reliable, editable, and spatially faithful. Echo also enables scene editing and restyling. Change materials, remove or add objects, explore design variations — all while preserving global 3D consistency. Editing no longer breaks the world. This is only the beginning. Echo is the foundation for future world models with dynamics, physical reasoning, and richer interaction — environments that don’t just look right, but behave right. Explore the generated worlds on our website and sign up for the closed beta. The era of spatial intelligence starts here. 🌍 #Echo #WorldModels #SpatialAI #3DFoundationModels Check it out:

🚀 Announcing Echo — our new frontier model for 3D world generation. Echo turns a simple text prompt or image into a fully explorable, 3D-consistent world. Instead of disconnected views, the result is a single, coherent spatial representation you can move through freely. This is part of a bigger shift in AI: from generating pixels and tokens to generating spaces. Echo predicts a geometry-grounded 3D scene at metric scale, meaning every novel view, depth map, and interaction comes from the same underlying world — not independent hallucinations. Once generated, the world is interactive in real time. You control the camera, explore from any angle, and render instantly — even on low-end hardware, directly in the browser. High-quality 3D world exploration is no longer gated by expensive equipment. Under the hood, Echo infers a physically grounded 3D representation and converts it into a renderable format. For our web demo, we use 3D Gaussian Splatting (3DGS) for fast, GPU-friendly rendering — but the representation itself is flexible and can be easily adapted. Why this matters: consistent 3D worlds unlock real workflows — digital twins, 3D design, game environments, robotics simulation, and more. From a single photo or a line of text, Echo builds worlds that are reliable, editable, and spatially faithful. Echo also enables scene editing and restyling. Change materials, remove or add objects, explore design variations — all while preserving global 3D consistency. Editing no longer breaks the world. This is only the beginning. Echo is the foundation for future world models with dynamics, physical reasoning, and richer interaction — environments that don’t just look right, but behave right. Explore the generated worlds on our website and sign up for the closed beta. The era of spatial intelligence starts here. 🌍 #Echo #WorldModels #SpatialAI #3DFoundationModels Check it out:

SpAItial AI

176,105 views • 8 months ago

An interactive world model developed by NVIDIA in collaboration with academic partners. - DreamDojo turns egocentric human video data into physical intelligence. - Human data is more scalable than robotics data but lacks action labels. - To solve this, a dedicated action model extracts latent actions by identifying physics and motion deltas between frames. Training - A massive 44k hours of video data are used for pre-training. - Post-training on small-scale robot datasets maps human physics to specific robot embodiments. - An additional distillation stage converts the model into an autoregressive, few-step diffusion model, enabling real-time, action-controllable simulation. Primary Use Cases - Live Teleoperation: Controlling a robot inside a world simulation in real-time. - Model-based Planning: Previewing and curating the best actions for improved success. - Policy Evaluation: Testing robot policies in realistic, out-of-distribution scenarios. Everything that's open-sourced: weights, code, post-training dataset, eval set, and details to reproduce.

An interactive world model developed by NVIDIA in collaboration with academic partners. - DreamDojo turns egocentric human video data into physical intelligence. - Human data is more scalable than robotics data but lacks action labels. - To solve this, a dedicated action model extracts latent actions by identifying physics and motion deltas between frames. Training - A massive 44k hours of video data are used for pre-training. - Post-training on small-scale robot datasets maps human physics to specific robot embodiments. - An additional distillation stage converts the model into an autoregressive, few-step diffusion model, enabling real-time, action-controllable simulation. Primary Use Cases - Live Teleoperation: Controlling a robot inside a world simulation in real-time. - Model-based Planning: Previewing and curating the best actions for improved success. - Policy Evaluation: Testing robot policies in realistic, out-of-distribution scenarios. Everything that's open-sourced: weights, code, post-training dataset, eval set, and details to reproduce.

The Humanoid Hub

11,575 views • 5 months ago

More and more design studios are showcasing interactive tools in their case studies, and I’m here for it. We went from static PDFs to motion, and now we’re letting people actually play with the brand. It’s no longer just a bunch of rules, the constraints are built into the brand itself. Here’s an example from the recent Stack Overflow rebrand by Koto, featuring various interactive elements. The future of brand design looks good.

Fons Mans

124,288 views • 1 month ago

THIS GUY VIBE CODED A TRUE 3D PROPERTY TOUR TOOL WITH CLAUDE CODE not the fake 360 photo stitching that matterport does, actual 3D right now if you're a real estate agent and want a property tour you need: > a matterport camera ($3000+) > a photographer who knows how to use it > matterport's monthly subscription > and you still get a glorified panorama, not real 3D this guy built a tool that takes your existing captures (camera files, drone shots, 360 photos, EVEN phone captures) and turns them into a real interactive 3D tour in one workflow no specialized hardware, no photographer, no switching between 5 different tools real estate agents, property managers, airbnb hosts, architects, interior designers all of them are paying hundreds per property for something this tool does from captures they already have the painful part was never understanding the end result. everyone knows what a 3D tour looks like. the pain is going from a pile of messy capture files to something usable without it turning into a technical project this solves that with one workflow you dump your files in and get a 3D tour out insane what you can do with vibe coding

THIS GUY VIBE CODED A TRUE 3D PROPERTY TOUR TOOL WITH CLAUDE CODE not the fake 360 photo stitching that matterport does, actual 3D right now if you're a real estate agent and want a property tour you need: > a matterport camera ($3000+) > a photographer who knows how to use it > matterport's monthly subscription > and you still get a glorified panorama, not real 3D this guy built a tool that takes your existing captures (camera files, drone shots, 360 photos, EVEN phone captures) and turns them into a real interactive 3D tour in one workflow no specialized hardware, no photographer, no switching between 5 different tools real estate agents, property managers, airbnb hosts, architects, interior designers all of them are paying hundreds per property for something this tool does from captures they already have the painful part was never understanding the end result. everyone knows what a 3D tour looks like. the pain is going from a pile of messy capture files to something usable without it turning into a technical project this solves that with one workflow you dump your files in and get a 3D tour out insane what you can do with vibe coding

Om Patel

157,824 views • 3 months ago

best performing static ads of the month (from ~$30k–$250k spend campaigns) different niches same exact structure 1 strong hook at the top 1 clear product visual almost zero design clutter no crazy editing no complex layouts just readability and clarity example breakdown from the ads above left side: curiosity hook quiz-style angle that makes people stop simple object on a desk one question that creates intrigue right side: clean health positioning product in hand clear benefit immediately visible headline → visual → simple action that’s the whole formula most winning static ads right now follow this structure: hook in first 2 seconds 1 product focus <3 visual elements total static ads aren’t dying overdesigned ads are rt + comment “static” and i’ll send the full list (follow for dm)

best performing static ads of the month (from ~$30k–$250k spend campaigns) different niches same exact structure 1 strong hook at the top 1 clear product visual almost zero design clutter no crazy editing no complex layouts just readability and clarity example breakdown from the ads above left side: curiosity hook quiz-style angle that makes people stop simple object on a desk one question that creates intrigue right side: clean health positioning product in hand clear benefit immediately visible headline → visual → simple action that’s the whole formula most winning static ads right now follow this structure: hook in first 2 seconds 1 product focus <3 visual elements total static ads aren’t dying overdesigned ads are rt + comment “static” and i’ll send the full list (follow for dm)

Zed

16,130 views • 5 months ago

A 10-minute walk. That's all it takes to transform a real-world neighborhood into a machine-readable digital twin. Captured with an Insta360 X5 and reconstructed by Over the Reality, this environment is no longer just a place on a map. It's spatial data that can power Visual AI, Robotics localization, VPS, XR experiences, and next-generation world models. Today, the OVER community has already created more than 270,000 machine-readable locations like this, forming one of the world's largest 3D datasets for Physical AI, an increasingly valuable asset as demand for high quality real-world data continues to grow.

A 10-minute walk. That's all it takes to transform a real-world neighborhood into a machine-readable digital twin. Captured with an Insta360 X5 and reconstructed by Over the Reality, this environment is no longer just a place on a map. It's spatial data that can power Visual AI, Robotics localization, VPS, XR experiences, and next-generation world models. Today, the OVER community has already created more than 270,000 machine-readable locations like this, forming one of the world's largest 3D datasets for Physical AI, an increasingly valuable asset as demand for high quality real-world data continues to grow.

Over the Reality 🌐

16,724 views • 1 month ago

Introducing Cline (formerly Claude Dev), an AI assistant that can use your CLI aNd Editor. v2.0 brings exciting updates: responses are now streamed into your editor, a cancel button for better control over tasks, a new XML-based tool calling prompt resulting in ~40% fewer requests per task + better performance from non-Claude models, search and use any model on OpenRouter (search “free” for no-cost options). More details and benchmarks in the release notes:

Introducing Cline (formerly Claude Dev), an AI assistant that can use your CLI aNd Editor. v2.0 brings exciting updates: responses are now streamed into your editor, a cancel button for better control over tasks, a new XML-based tool calling prompt resulting in ~40% fewer requests per task + better performance from non-Claude models, search and use any model on OpenRouter (search “free” for no-cost options). More details and benchmarks in the release notes:

Saoud Rizwan

54,723 views • 1 year ago

2D is what the camera sees.👀 3D is what the world is. 🌍 Today, we’re proudly open-sourcing QuerySplat — an open-source feed-forward 3D model that turns a few unposed images into a navigable 3D scene in seconds (run on 4090🪶). Your input: a few unposed images Our output: a sharp, navigable 3D scene — generated in seconds! 🚀 🧠 organize scenes with 3D queries, not pixel-bound Gaussians 📷 no camera poses or manual calibration required ⚡ reconstruct new scenes in a single forward pass ✨ preserve sharp geometry and high-frequency appearance 🏆 achieve state-of-the-art results on DL3DV-Evaluation 🔓 code and model weights are now open-source From pixels to scenes, we are making 3D generation scalable. Try our free iOS app — it’s a lot of fun! 😆 🔗 Try it on the Web: 🔗 Paper: 🔗 Code & weights: 🔗 Project page: 🔗 #AIGC #3DGS #AI #Computervision #3D #artist #3dartist #3d

2D is what the camera sees.👀 3D is what the world is. 🌍 Today, we’re proudly open-sourcing QuerySplat — an open-source feed-forward 3D model that turns a few unposed images into a navigable 3D scene in seconds (run on 4090🪶). Your input: a few unposed images Our output: a sharp, navigable 3D scene — generated in seconds! 🚀 🧠 organize scenes with 3D queries, not pixel-bound Gaussians 📷 no camera poses or manual calibration required ⚡ reconstruct new scenes in a single forward pass ✨ preserve sharp geometry and high-frequency appearance 🏆 achieve state-of-the-art results on DL3DV-Evaluation 🔓 code and model weights are now open-source From pixels to scenes, we are making 3D generation scalable. Try our free iOS app — it’s a lot of fun! 😆 🔗 Try it on the Web: 🔗 Paper: 🔗 Code & weights: 🔗 Project page: 🔗 #AIGC #3DGS #AI #Computervision #3D #artist #3dartist #3d

InSpatio｜影溯

29,262 views • 16 days ago