Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

🚨 A SINGLE IMAGE can now become an entire 3D WORLD. I’m talking about Hyper3D WorldGen. It follows a structured method where EVERY OBJECT is an individual editable 3D asset. It also reconstructs: → Spatial positions & relationships → Object arrangements → Collisions → Mass → Friction etc... On... show more

SARAH

223,239 subscribers

87,307 Aufrufe • vor 1 Tag •via X (Twitter)

Wissenschaft & Technologie Bildung

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

🚨 A single image → a fully editable UE5 world. Introducing Lumera: a turnkey pipeline that reconstructs an engine-native 3D scene directly from ONE image — not just pixels, point clouds, or Gaussians. It gives you: → object-level 3D meshes → editable 3D layouts → engine-native lights → HDR environment lighting → a scene ready for Unreal Engine 5 In other words: Image → 3D world → UE5. We believe the future of image-to-3D is not “generate something that looks 3D.” It is generate the actual world project. 🌐 📄

🚨 A single image → a fully editable UE5 world. Introducing Lumera: a turnkey pipeline that reconstructs an engine-native 3D scene directly from ONE image — not just pixels, point clouds, or Gaussians. It gives you: → object-level 3D meshes → editable 3D layouts → engine-native lights → HDR environment lighting → a scene ready for Unreal Engine 5 In other words: Image → 3D world → UE5. We believe the future of image-to-3D is not “generate something that looks 3D.” It is generate the actual world project. 🌐 📄

Hao Zhao

49,886 Aufrufe • vor 5 Tagen

How about one image straight to an editable UE5 or Blender scene? Lumera just dropped paper - Engine-Native Editable 3D World Reconstruction with Objects & Lighting. You give it an image. It figures out what's in the scene, rebuilds every object as a separate mesh, then recreates the lighting as actual engine lights you can move and tweak. Even pulls an HDR environment out of the shot. The lighting part is the big deal here. Every other image-to-3D approach bakes it in. Lumera keeps it a parameter, like the scene was built in the engine from the start. Code and weights marked as "Soon". Paper -

How about one image straight to an editable UE5 or Blender scene? Lumera just dropped paper - Engine-Native Editable 3D World Reconstruction with Objects & Lighting. You give it an image. It figures out what's in the scene, rebuilds every object as a separate mesh, then recreates the lighting as actual engine lights you can move and tweak. Even pulls an HDR environment out of the shot. The lighting part is the big deal here. Every other image-to-3D approach bakes it in. Lumera keeps it a parameter, like the scene was built in the engine from the start. Code and weights marked as "Soon". Paper -

Stefan 3D AI

46,085 Aufrufe • vor 5 Tagen

Another city. Another full 3D Gaussian Splat reconstruction. This entire neighborhood was captured while walking with an Insta360 X5, then processed with our GPU pipeline and transformed into a high-fidelity, machine-readable 3D environment with Over the Reality. What you’re seeing is not an isolated virtual world. It’s a 3D digital twin of a real-world location, built from structured spatial data where every building, street, and detail can become usable by AI, robotics, and XR. And it’s happening at scale, across cities in more than 180 countries every day. Have an Insta360 X5 and want to become a mapper? Apply here: Want to build a 3D Gaussian Splat from a video you already recorded? Do it for free at powered by Over the Reality.

Another city. Another full 3D Gaussian Splat reconstruction. This entire neighborhood was captured while walking with an Insta360 X5, then processed with our GPU pipeline and transformed into a high-fidelity, machine-readable 3D environment with Over the Reality. What you’re seeing is not an isolated virtual world. It’s a 3D digital twin of a real-world location, built from structured spatial data where every building, street, and detail can become usable by AI, robotics, and XR. And it’s happening at scale, across cities in more than 180 countries every day. Have an Insta360 X5 and want to become a mapper? Apply here: Want to build a 3D Gaussian Splat from a video you already recorded? Do it for free at powered by Over the Reality.

Over the Reality 🌐

400,258 Aufrufe • vor 4 Monaten

📢 OneCanvas: 3D Scene Understanding via Panoramic Reprojection We extract features from video frames and reproject them into one occlusion-free view of the whole scene that a 2D VLM reads just like a normal image. We can center this view on any viewpoint, including an agent's own pose for situated reasoning. The same projection lets us create spatial training tasks with no human annotation, solvable only by reasoning over the 3D positions of real object features placed on an otherwise empty canvas. The result is a stock 2D VLM that reasons in 3D, setting a new state of the art across spatial benchmarks at far less compute. 🌐 ▶️ Great work by Bartłomiej Baranowski & Dave Zhenyu Chen

📢 OneCanvas: 3D Scene Understanding via Panoramic Reprojection We extract features from video frames and reproject them into one occlusion-free view of the whole scene that a 2D VLM reads just like a normal image. We can center this view on any viewpoint, including an agent's own pose for situated reasoning. The same projection lets us create spatial training tasks with no human annotation, solvable only by reasoning over the 3D positions of real object features placed on an otherwise empty canvas. The result is a stock 2D VLM that reasons in 3D, setting a new state of the art across spatial benchmarks at far less compute. 🌐 ▶️ Great work by Bartłomiej Baranowski & Dave Zhenyu Chen

Matthias Niessner

25,329 Aufrufe • vor 2 Monaten

💫It's fascinating that a single feed-forward pass through an LLM can replace a complex rendering pipeline, like Blender! Just feed it 3D shapes, xyz positions, and poses as tokens, and it spits out the image token-by-token. The dual, aka scene reconstruction, is also possible! 👇

💫It's fascinating that a single feed-forward pass through an LLM can replace a complex rendering pipeline, like Blender! Just feed it 3D shapes, xyz positions, and poses as tokens, and it spits out the image token-by-token. The dual, aka scene reconstruction, is also possible! 👇

Georgia Gkioxari

44,636 Aufrufe • vor 1 Jahr

HOLY SHIT! Sparc 3D is INSANE! All they need to do now is enable PBR texture support, object separation and decimation and this in my opinion completely replaces photogrammetry. The quality of the reconstruction of these 3D objects from a single image is mind blowing to me. Yes, the model is insanely dense to allow all of this detail but the fact that AI can generate with this level of fidelity is CRAZY!!! You can try it for free on Huggingface

HOLY SHIT! Sparc 3D is INSANE! All they need to do now is enable PBR texture support, object separation and decimation and this in my opinion completely replaces photogrammetry. The quality of the reconstruction of these 3D objects from a single image is mind blowing to me. Yes, the model is insanely dense to allow all of this detail but the fact that AI can generate with this level of fidelity is CRAZY!!! You can try it for free on Huggingface

Travis Davids

18,230 Aufrufe • vor 1 Jahr

Is this a 3D model? look man, it's like, i advanced my shader engine in the time it took you to reply. would have probably taken an entire team of AAA gaming's best idiots to do this before. now we can do it in two prompts. WeEeEeeEeE! 3D models WeeEee! 😂

Is this a 3D model? look man, it's like, i advanced my shader engine in the time it took you to reply. would have probably taken an entire team of AAA gaming's best idiots to do this before. now we can do it in two prompts. WeEeEeeEeE! 3D models WeeEee! 😂

Satoshi Nakamoto, Andrew Rulnick

244,935 Aufrufe • vor 9 Monaten

Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fields paper page: Editing a local region or a specific object in a 3D scene represented by a NeRF is challenging, mainly due to the implicit nature of the scene representation. Consistently blending a new realistic object into the scene adds an additional level of difficulty. We present Blended-NeRF, a robust and flexible framework for editing a specific region of interest in an existing NeRF scene, based on text prompts or image patches, along with a 3D ROI box. Our method leverages a pretrained language-image model to steer the synthesis towards a user-provided text prompt or image patch, along with a 3D MLP model initialized on an existing NeRF scene to generate the object and blend it into a specified region in the original scene. We allow local editing by localizing a 3D ROI box in the input scene, and seamlessly blend the content synthesized inside the ROI with the existing scene using a novel volumetric blending technique. To obtain natural looking and view-consistent results, we leverage existing and new geometric priors and 3D augmentations for improving the visual fidelity of the final result. We test our framework both qualitatively and quantitatively on a variety of real 3D scenes and text prompts, demonstrating realistic multi-view consistent results with much flexibility and diversity compared to the baselines. Finally, we show the applicability of our framework for several 3D editing applications, including adding new objects to a scene, removing/replacing/altering existing objects, and texture conversion.

Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fields paper page: Editing a local region or a specific object in a 3D scene represented by a NeRF is challenging, mainly due to the implicit nature of the scene representation. Consistently blending a new realistic object into the scene adds an additional level of difficulty. We present Blended-NeRF, a robust and flexible framework for editing a specific region of interest in an existing NeRF scene, based on text prompts or image patches, along with a 3D ROI box. Our method leverages a pretrained language-image model to steer the synthesis towards a user-provided text prompt or image patch, along with a 3D MLP model initialized on an existing NeRF scene to generate the object and blend it into a specified region in the original scene. We allow local editing by localizing a 3D ROI box in the input scene, and seamlessly blend the content synthesized inside the ROI with the existing scene using a novel volumetric blending technique. To obtain natural looking and view-consistent results, we leverage existing and new geometric priors and 3D augmentations for improving the visual fidelity of the final result. We test our framework both qualitatively and quantitatively on a variety of real 3D scenes and text prompts, demonstrating realistic multi-view consistent results with much flexibility and diversity compared to the baselines. Finally, we show the applicability of our framework for several 3D editing applications, including adding new objects to a scene, removing/replacing/altering existing objects, and texture conversion.

AK

62,768 Aufrufe • vor 3 Jahren

I wrote about "vibeworking" and what it means to be an expert in a world where you can create things by just asking for them... until you hit the limits of what AI systems can do. I also vibecoded my own little 3D town creation/ firetruck game in four prompts. Link in replies.

I wrote about "vibeworking" and what it means to be an expert in a world where you can create things by just asking for them... until you hit the limits of what AI systems can do. I also vibecoded my own little 3D town creation/ firetruck game in four prompts. Link in replies.

Ethan Mollick

24,901 Aufrufe • vor 1 Jahr

This is the latest Google research on XR Interaction: World Mouse. Instead of using hand rays or gestures to point at things in the physical space, you move a cursor with a mouse and the system figures out where that cursor should sit in the 3D world. It works in two main ways: - On an object, the cursor follows the surface, so you can move precisely across walls, screens, furniture, or virtual objects. - Between objects, the system creates a smooth bridge through space, so the cursor can travel from one surface to another. That means you can go from a 2D panel to a 3D object, place content on a real wall, manipulate virtual objects, or interact with physical devices through digital proxies. This is the type of news, tools and product updates I share weekly in my newsletter. If you are into 3D XR and AI make sure to check it out (link on top of my profile). Based on “World Mouse: Exploring Interactions with a Cross-Reality Cursor” by Esen K. Tütüncü, Mar Gonzalez-Franco, Khushman Patel, and Eric J. Gonzalez

Gabriele Romagnoli

28,945 Aufrufe • vor 5 Monaten

Here's my first surprise to you to kick off QuakeCon's 30th anniversary! (Go Grab this ASAP!!!) A spiritual successor to Wolfenstein... Darkenstein 3D 100% FREE playable now!!! [Link included below] It’s a pure love letter to the classic franchise rebuilt for modern PC's with awesome physics and an incredible soundtrack! It pulls no punches and its an absolute blast every needs to play!!! All this is the incredible work of a single developer Rowye | Darkenstein 3D

Here's my first surprise to you to kick off QuakeCon's 30th anniversary! (Go Grab this ASAP!!!) A spiritual successor to Wolfenstein... Darkenstein 3D 100% FREE playable now!!! [Link included below] It’s a pure love letter to the classic franchise rebuilt for modern PC's with awesome physics and an incredible soundtrack! It pulls no punches and its an absolute blast every needs to play!!! All this is the incredible work of a single developer Rowye | Darkenstein 3D

TiredAndOnFire-HD Remasters/Gamedev

33,841 Aufrufe • vor 1 Monat

Apple Maps 3d is insanely impressive now (see video below) Google on the other hand decided to build an insanely clunky solution to display 3d maps to avoid using mobile GPUs: A Google server streams (!) a live video of its 3d rendered map to you, the result is a disastrous: a super laggy and clunky 3d view full of video compression artefacts with a response time of 2-3 seconds for every movement And I know WHY they built that, someone felt it was not inclusive to only have 3d maps that are high performing on iOS because Apple's GPUs are insanely fast and can deal with it (as you can see below in Apple Maps) but they wanted to support inferior phones, I get it But then they also decided to worsen the experience for iOS users who could easily run 3d natively on its GPU It's just an insane product decision, there's no way to cut it: they could have super smooth 3d like Apple Maps but neutered it with a clunky live stream Even more insane because Google does have native 3d on iOS in a completely different app that nobody uses: Google Earth Is 3d important? Not rly for nav no but it shows again something about Google's engineering decisions, like the redesign of the Google OAuth Login screen that made zero sense Nobody is speaking up against bad ideas in Google meetings, everyone's too scared of HR maybe, it's the opposite of a meritocracy and it's just super visible from using Google products right now

Apple Maps 3d is insanely impressive now (see video below) Google on the other hand decided to build an insanely clunky solution to display 3d maps to avoid using mobile GPUs: A Google server streams (!) a live video of its 3d rendered map to you, the result is a disastrous: a super laggy and clunky 3d view full of video compression artefacts with a response time of 2-3 seconds for every movement And I know WHY they built that, someone felt it was not inclusive to only have 3d maps that are high performing on iOS because Apple's GPUs are insanely fast and can deal with it (as you can see below in Apple Maps) but they wanted to support inferior phones, I get it But then they also decided to worsen the experience for iOS users who could easily run 3d natively on its GPU It's just an insane product decision, there's no way to cut it: they could have super smooth 3d like Apple Maps but neutered it with a clunky live stream Even more insane because Google does have native 3d on iOS in a completely different app that nobody uses: Google Earth Is 3d important? Not rly for nav no but it shows again something about Google's engineering decisions, like the redesign of the Google OAuth Login screen that made zero sense Nobody is speaking up against bad ideas in Google meetings, everyone's too scared of HR maybe, it's the opposite of a meritocracy and it's just super visible from using Google products right now

@levelsio

1,489,214 Aufrufe • vor 2 Jahren

🚀 Announcing Echo — our new frontier model for 3D world generation. Echo turns a simple text prompt or image into a fully explorable, 3D-consistent world. Instead of disconnected views, the result is a single, coherent spatial representation you can move through freely. This is part of a bigger shift in AI: from generating pixels and tokens to generating spaces. Echo predicts a geometry-grounded 3D scene at metric scale, meaning every novel view, depth map, and interaction comes from the same underlying world — not independent hallucinations. Once generated, the world is interactive in real time. You control the camera, explore from any angle, and render instantly — even on low-end hardware, directly in the browser. High-quality 3D world exploration is no longer gated by expensive equipment. Under the hood, Echo infers a physically grounded 3D representation and converts it into a renderable format. For our web demo, we use 3D Gaussian Splatting (3DGS) for fast, GPU-friendly rendering — but the representation itself is flexible and can be easily adapted. Why this matters: consistent 3D worlds unlock real workflows — digital twins, 3D design, game environments, robotics simulation, and more. From a single photo or a line of text, Echo builds worlds that are reliable, editable, and spatially faithful. Echo also enables scene editing and restyling. Change materials, remove or add objects, explore design variations — all while preserving global 3D consistency. Editing no longer breaks the world. This is only the beginning. Echo is the foundation for future world models with dynamics, physical reasoning, and richer interaction — environments that don’t just look right, but behave right. Explore the generated worlds on our website and sign up for the closed beta. The era of spatial intelligence starts here. 🌍 #Echo #WorldModels #SpatialAI #3DFoundationModels Check it out:

🚀 Announcing Echo — our new frontier model for 3D world generation. Echo turns a simple text prompt or image into a fully explorable, 3D-consistent world. Instead of disconnected views, the result is a single, coherent spatial representation you can move through freely. This is part of a bigger shift in AI: from generating pixels and tokens to generating spaces. Echo predicts a geometry-grounded 3D scene at metric scale, meaning every novel view, depth map, and interaction comes from the same underlying world — not independent hallucinations. Once generated, the world is interactive in real time. You control the camera, explore from any angle, and render instantly — even on low-end hardware, directly in the browser. High-quality 3D world exploration is no longer gated by expensive equipment. Under the hood, Echo infers a physically grounded 3D representation and converts it into a renderable format. For our web demo, we use 3D Gaussian Splatting (3DGS) for fast, GPU-friendly rendering — but the representation itself is flexible and can be easily adapted. Why this matters: consistent 3D worlds unlock real workflows — digital twins, 3D design, game environments, robotics simulation, and more. From a single photo or a line of text, Echo builds worlds that are reliable, editable, and spatially faithful. Echo also enables scene editing and restyling. Change materials, remove or add objects, explore design variations — all while preserving global 3D consistency. Editing no longer breaks the world. This is only the beginning. Echo is the foundation for future world models with dynamics, physical reasoning, and richer interaction — environments that don’t just look right, but behave right. Explore the generated worlds on our website and sign up for the closed beta. The era of spatial intelligence starts here. 🌍 #Echo #WorldModels #SpatialAI #3DFoundationModels Check it out:

SpAItial AI

176,524 Aufrufe • vor 8 Monaten

📢📢GenRecon: Bridging Generative Priors for Multi-View 3D Scene Reconstruction📢📢 Reconstructing high-fidelity 3D scenes from sparse RGB input is hard. It needs a strong 3D prior! We reformulate multi-view scene reconstruction as conditional 3D generation over overlapping spatial chunks, lifting posed image features into a generative shape prior via 3D conditioning. As an example prior, we build on Trellis2, and train it such that its reconstruction is pixel aligned and matches from all views. GenRecon achieves unprecedented reconstruction quality from any sparse RGB input sequence, even from a phone capture. The reconstruction also includes PBR materials which facilitates relighting and virtual object insertion. Amazing work by Katharina Schmid, Nicolas von Lützow, Jozef, Angela Dai

📢📢GenRecon: Bridging Generative Priors for Multi-View 3D Scene Reconstruction📢📢 Reconstructing high-fidelity 3D scenes from sparse RGB input is hard. It needs a strong 3D prior! We reformulate multi-view scene reconstruction as conditional 3D generation over overlapping spatial chunks, lifting posed image features into a generative shape prior via 3D conditioning. As an example prior, we build on Trellis2, and train it such that its reconstruction is pixel aligned and matches from all views. GenRecon achieves unprecedented reconstruction quality from any sparse RGB input sequence, even from a phone capture. The reconstruction also includes PBR materials which facilitates relighting and virtual object insertion. Amazing work by Katharina Schmid, Nicolas von Lützow, Jozef, Angela Dai

Matthias Niessner

18,267 Aufrufe • vor 3 Monaten

Do we need to build a Photoshop-like image rotation feature in ComfyUI? Tried to recreate PS’s image rotation feature inside ComfyUI. The tech itself isn’t anything special — it uses Qwen multi-angle, runs 32 angle variations of the image, then throws them onto a simple Canvas. The result obviously can’t compete with PS. Theirs clearly uses some kind of 3D technique under the hood. On top of that, a single run on my local 5090 takes 320 seconds — which is nowhere near an acceptable turnaround time. Just playing around with it for now. We’ll see if we can improve it later by switching to a 3D-based approach.

Do we need to build a Photoshop-like image rotation feature in ComfyUI? Tried to recreate PS’s image rotation feature inside ComfyUI. The tech itself isn’t anything special — it uses Qwen multi-angle, runs 32 angle variations of the image, then throws them onto a simple Canvas. The result obviously can’t compete with PS. Theirs clearly uses some kind of 3D technique under the hood. On top of that, a single run on my local 5090 takes 320 seconds — which is nowhere near an acceptable turnaround time. Just playing around with it for now. We’ll see if we can improve it later by switching to a 3D-based approach.

jtydhr88

14,749 Aufrufe • vor 5 Monaten

A GUY PUT GPT-LEVEL AI INSIDE A 3D PRINTED ROBOT AND RELEASED THE ENTIRE THING FOR FREE Most people look at a 3D printer and see plastic toys This guy printed a robot with expressive eyes, object tracking, image recognition, support for ChatGPT, Qwen and offline models, then uploaded the STL files, code and hardware designs for anyone to build themselves The interesting part isn't the robot It's how fast the gap between "I have an idea" and "I built a working product" is disappearing A few years ago this required a team of engineers Now one person with a printer, open-source software and enough curiosity can build something that looks like it came from a robotics startup We're getting very close to a world where manufacturing, AI and robotics stop being separate industries and start becoming the same thing

A GUY PUT GPT-LEVEL AI INSIDE A 3D PRINTED ROBOT AND RELEASED THE ENTIRE THING FOR FREE Most people look at a 3D printer and see plastic toys This guy printed a robot with expressive eyes, object tracking, image recognition, support for ChatGPT, Qwen and offline models, then uploaded the STL files, code and hardware designs for anyone to build themselves The interesting part isn't the robot It's how fast the gap between "I have an idea" and "I built a working product" is disappearing A few years ago this required a team of engineers Now one person with a printer, open-source software and enough curiosity can build something that looks like it came from a robotics startup We're getting very close to a world where manufacturing, AI and robotics stop being separate industries and start becoming the same thing

lagerskoy

57,099 Aufrufe • vor 2 Monaten