(1/3) Can we turn text-to-image models into photorealistic 3D... generators? ViewDiff (#CVPR2024) produces realistic, multi-view consistent images of real-world 3D objects in authentic surroundings. Website Video How does it work?show more

this is the future of CGI this new OpenMagic... AI can add image, video or 3D product into real life video seamlessly with one click and.. it can even turn product image into 3D model automatically 10 wild examples:show more

Meshy has arrived on MakerWorld! 🪩 Turn images into... high-quality, print-ready 3D models directly within MakerLab Image-to-3D. Our mission with Bambu Lab is simple: democratize 3D modeling so anyone can create and print in one click.show more

Wonderland: Navigating 3D Scenes from a Single Image Contributions:... • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.show more

🤩Video world models are cool, but it is cooler... if they can simulate any 3D physical actions in real time! Introducing RealWonder⚡️: Now you can simulate 3D physical action (robot actions, 3D forces, force fields, etc.) consequences from a single image in real time! 🧵1/6show more

CSM 3D AI: New image-to-3D AI program AI is... reshaping the future of 3D design. This amazing tool transforms still images into 3D models, and the best part? You can animate them effortlessly using AI. Link in comment!show more

Introducing Objaverse, a massive open dataset of text-paired 3D... objects! Nearly 1 million annotated 3D objects to pave the way to build incredible large-scale 3D generative models: 🧵👇 🤗 Hugging Face: 📝ArXiv: #CVPR2023show more

.Tencent Hy HY-World 2.0 has landed,fully OPEN SOURCE !... We kept hearing the same thing: world models look great, but you can't use the output. So we made one you can, real 3D assets you can edit, rearrange, and ship into production. Prompt to engine-ready 3D. For real this time： ✨Directly outputs editable, production-ready 3D assets ✨Seamlessly plugs into existing game pipelines ✨Multimodal input: text, image, videos 🪄Character mode: freely explore streets, buildings, and open worlds with realistic physics, collisions, and no time limits 🔗GitHub:show more

What if a SINGLE IMAGE could become a fully... editable 3D WORLD? 🤯 I tried Hyper3D WorldGen, and honestly… I wasn’t expecting this. It didn’t just look at the image and turn it into a 3D object. It actually figured out what was happening in the scene — where the objects were, how they were positioned, and how everything fit together — then rebuilt the whole thing as a 3D world. And this is where it gets REALLY interesting. The objects you actually want to work with become individual 3D assets, while the surrounding environment keeps its detail through 3D Gaussian Splatting. So instead of getting one giant 3D model that you can barely do anything with… You get a whole scene that you can actually mess around with. 👇show more

We are happy to announce that ComfyUI now natively... supports toad Hunyuan3D 2.0 and Hunyuan3D 2.0 MV (Multi-View) model series! 3 workflows to get started: 🔹Hunyuan3D-2 mv: multi-view to 3D 🔹Hunyuan3D-2 mv Turbo: accelerated multi-view 🔹Hunyuan3D-2: single image to 3Dshow more

🚀 Tencent 𝗛𝗬-𝗪𝗼𝗿𝗹𝗱 𝟮.𝟬 just dropped Text or image... → 3D world (3DGS + Mesh). Fully automatic. Video world models let you 𝘄𝗮𝘁𝗰𝗵. We let you 𝗲𝘅𝗽𝗹𝗼𝗿𝗲. #worldmodel #HYWorldshow more

🚨 This changes how 3D worlds get made. Upload... a single image, and Hyper3D WorldGen transforms the scene into an immersive, editable 3D world. The important objects don’t just become part of the environment — they become independent 3D assets you can edit and manipulate. ✨show more

wait… this might be the coolest thing we’ve shipped... all year. you upload ONE image and WorldGen doesn’t just give you a pretty 3D copy. it reads the scene — the objects, their positions, scale, orientation, and how they relate to each other. then it turns the key objects into separate 3D assets you can actually work with.show more

ViewCrafter can generate high-quality 3D views from single or... few images using a video diffusion model! It allows for precise camera control and is useful for real-time rendering and turning text into 3D scenes. Links ⬇️show more

We introduce TurboEdit -- simple text-based image editing in... 1/2 sec! We leverage few-step diffusion models, mapping real images into noise with an encoder. Please see our #ECCV2024 paper: Work w/ Zongze Wu, Nick Kolkin, Jon Brandt, Eli Shechtman 1/show more

Hunyuan 3D-2.1 turns any flat image into studio-quality 3D... models. And you can do it on this Hugging Face space for free.show more

3d world abilities of AI models keep getting better,... this is Kling AI 1.5 It can move around a space in 3d and you can steer its camera movements All based on a single input imageshow more

(1/2) Check out 𝐆𝐚𝐮𝐬𝐬𝐢𝐚𝐧𝐀𝐯𝐚𝐭𝐚𝐫𝐬: Photorealistic Head Avatars with Rigged... 3D Gaussians! We create photorealistic head avatars by animating 3D Gaussians on a parametric face model - edited and rendered in *real-time*!show more