Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Having fun with computer vision! 👁️ Converted 🤗 image → 3D, then dragged to AA's 3d model playground

apolinario 🌐

15,627 subscribers

20,193 Aufrufe • vor 1 Jahr •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

5 Kommentare

Profilbild von apolinario 🌐

apolinario 🌐vor 1 Jahr

Play with it here

Profilbild von AA

AAvor 1 Jahr

thanks for sharing my work 🙇‍♂️ the HF logo looks very happy to be here :)

Profilbild von merve

mervevor 1 Jahr

@measure_plan I love this 🤩

Profilbild von Himanshu Kumar

Himanshu Kumarvor 1 Jahr

@measure_plan Impressive, is it possible to convert 3D back to a perfect image?

Profilbild von Andres Franco

Andres Francovor 1 Jahr

@measure_plan This is so cool, using so many different tools and making a fun little experiment.

Ähnliche Videos

p.o.v: you're watching willy's 3D but you tunnel vision to shuca 👁️👁️💜💛

Sensitive content

p.o.v: you're watching willy's 3D but you tunnel vision to shuca 👁️👁️💜💛

Krey 🌱

44,310 Aufrufe • vor 10 Monaten

Having fun with Codename's 3D features

Sensitive content

Having fun with Codename's 3D features

stryk!

51,381 Aufrufe • vor 5 Monaten

oh my.. hows this even possible Meta just dropped SAM 3D, you can auto select any object in still image and.. turn them into high quality 3D model the model is free to download and test in playground link in comments

oh my.. hows this even possible Meta just dropped SAM 3D, you can auto select any object in still image and.. turn them into high quality 3D model the model is free to download and test in playground link in comments

el.cine

794,504 Aufrufe • vor 7 Monaten

Rodin Gen-2 API node, Rodin’s most powerful image-to-3D tool, is now live in ComfyUI! Turn any image into a 3D model with one click. It supports 4× Mesh Quality, T/A Pose, PBR textures, and Multiview to 3D model. 👇 Try it now in ComfyUI!

Rodin Gen-2 API node, Rodin’s most powerful image-to-3D tool, is now live in ComfyUI! Turn any image into a 3D model with one click. It supports 4× Mesh Quality, T/A Pose, PBR textures, and Multiview to 3D model. 👇 Try it now in ComfyUI!

ComfyUI

19,076 Aufrufe • vor 9 Monaten

🌟Transform an image into a 3D model in just 5 easy steps! 1️⃣Visit the Hunyuan 3D website and log in: 2️⃣Navigate to the "3D Creation" page 3️⃣Choose the "Image to 3D" feature 🎨 4️⃣Upload your image and click "Generate Immediately" 5️⃣Wait a moment , and voilà—your stunning 3D model is ready! ⏳✨ Watch our tutorial video to get started! 😸🎥

🌟Transform an image into a 3D model in just 5 easy steps! 1️⃣Visit the Hunyuan 3D website and log in: 2️⃣Navigate to the "3D Creation" page 3️⃣Choose the "Image to 3D" feature 🎨 4️⃣Upload your image and click "Generate Immediately" 5️⃣Wait a moment , and voilà—your stunning 3D model is ready! ⏳✨ Watch our tutorial video to get started! 😸🎥

Hunyuan

101,468 Aufrufe • vor 1 Jahr

3D controllable video generation works well now and pixel alignment is impressive! We took our new 3D sculpt model, generated a blender scene and then asked a video-to-video model to render. Image to 3D sculpt: Common Sense Machines Synthetic rendering: Blender 🔶 Video-to-Video: Runway

3D controllable video generation works well now and pixel alignment is impressive! We took our new 3D sculpt model, generated a blender scene and then asked a video-to-video model to render. Image to 3D sculpt: Common Sense Machines Synthetic rendering: Blender 🔶 Video-to-Video: Runway

Common Sense Machines

18,714 Aufrufe • vor 1 Jahr

Christian Rupprecht explains their interpretability research in 3D computer vision, testing if (and where in the model) multi-view transformers like VGGT, DepthAnything 3, and DUSt3R use point/patch correspondences to make sense of 3D scene geometry.

Christian Rupprecht explains their interpretability research in 3D computer vision, testing if (and where in the model) multi-view transformers like VGGT, DepthAnything 3, and DUSt3R use point/patch correspondences to make sense of 3D scene geometry.

Chris Offner

74,225 Aufrufe • vor 3 Monaten

Love these old meets new vfx workflows 1. extract a still of the object you want to augment 2. use image-to-3d to make a 3d model of the object 3. use that 3d geometry for classical object tracking Then you can go wild with complete control

Love these old meets new vfx workflows 1. extract a still of the object you want to augment 2. use image-to-3d to make a 3d model of the object 3. use that 3d geometry for classical object tracking Then you can go wild with complete control

Bilawal Sidhu

33,824 Aufrufe • vor 1 Jahr

3d pencil tool + real-time generative previews + 3d model gen = powerfully fun way to iterate.

3d pencil tool + real-time generative previews + 3d model gen = powerfully fun way to iterate.

Unbound

10,815 Aufrufe • vor 1 Monat

I'm having fun adding a low poly car generated with Hunyuan 3D on Pinokio and applying my AI image projection shader to it, just to see the result.

I'm having fun adding a low poly car generated with Hunyuan 3D on Pinokio and applying my AI image projection shader to it, just to see the result.

Alex

25,040 Aufrufe • vor 5 Monaten

Phidias A Generative Model for Creating 3D Content from Text, Image, and 3D Conditions with Reference-Augmented Diffusion discuss: In 3D modeling, designers often use an existing 3D model as a reference to create new ones. This practice has inspired the development of Phidias, a novel generative model that uses diffusion for reference-augmented 3D generation. Given an image, our method leverages a retrieved or user-provided 3D reference model to guide the generation process, thereby enhancing the generation quality, generalization ability, and controllability. Our model integrates three key components: 1) meta-ControlNet that dynamically modulates the conditioning strength, 2) dynamic reference routing that mitigates misalignment between the input image and 3D reference, and 3) self-reference augmentations that enable self-supervised training with a progressive curriculum. Collectively, these designs result in a clear improvement over existing methods. Phidias establishes a unified framework for 3D generation using text, image, and 3D conditions with versatile applications.

Phidias A Generative Model for Creating 3D Content from Text, Image, and 3D Conditions with Reference-Augmented Diffusion discuss: In 3D modeling, designers often use an existing 3D model as a reference to create new ones. This practice has inspired the development of Phidias, a novel generative model that uses diffusion for reference-augmented 3D generation. Given an image, our method leverages a retrieved or user-provided 3D reference model to guide the generation process, thereby enhancing the generation quality, generalization ability, and controllability. Our model integrates three key components: 1) meta-ControlNet that dynamically modulates the conditioning strength, 2) dynamic reference routing that mitigates misalignment between the input image and 3D reference, and 3) self-reference augmentations that enable self-supervised training with a progressive curriculum. Collectively, these designs result in a clear improvement over existing methods. Phidias establishes a unified framework for 3D generation using text, image, and 3D conditions with versatile applications.

AK

25,120 Aufrufe • vor 1 Jahr

✨ Made a new mini feature on Photo AI: [ Grab from 3d model ] So the problem is we're at that stage in time (typical for AI) where image-to-3d models are not good enough but are fun to play with, but we know they'll be good enough in 1-2 years With [ Make 3d model ] you already can turn any Photo AI pic into a 3d model but it still looks hyper clunky and deformed, but it works! One cool idea I had to make that more useful and made now: Let people make a 3d model then change the view of the it with the 3d viewer, then press [ o ] and it grabs a frame of the 3d That image you can then [ Remix ] (img2img), and it becomes a real photo again and that in turn you can then turn into a video again with [ Make video ] So that essentially gives you a fully freeform camera position control to take photos with One thing I need to fix is the background/skybox, I kinda need to take the original photo and remove the person and just get the background for the 3d model viewer, in this case it should be white, but it's a start!

✨ Made a new mini feature on Photo AI: [ Grab from 3d model ] So the problem is we're at that stage in time (typical for AI) where image-to-3d models are not good enough but are fun to play with, but we know they'll be good enough in 1-2 years With [ Make 3d model ] you already can turn any Photo AI pic into a 3d model but it still looks hyper clunky and deformed, but it works! One cool idea I had to make that more useful and made now: Let people make a 3d model then change the view of the it with the 3d viewer, then press [ o ] and it grabs a frame of the 3d That image you can then [ Remix ] (img2img), and it becomes a real photo again and that in turn you can then turn into a video again with [ Make video ] So that essentially gives you a fully freeform camera position control to take photos with One thing I need to fix is the background/skybox, I kinda need to take the original photo and remove the person and just get the background for the 3d model viewer, in this case it should be white, but it's a start!

@levelsio

119,210 Aufrufe • vor 1 Jahr

3D editing is hard: you need to ground an image + instruction and generate a faithful 3D shape in one forward pass -- no test-time optimization. So, we steer pretrained image-to-3D representations to do text-guided 3D edits; no massive 3D edit-pair dataset needed. Key trap: the “no-edit” solution is a nasty local minimum. We fix it with preference optimization, pushing the model to actually edit. Steer3D is the second work that adapts alignment ideas from LLMs to the 3D modality. SAM 3D also used DPO to improve its 3D generations.

3D editing is hard: you need to ground an image + instruction and generate a faithful 3D shape in one forward pass -- no test-time optimization. So, we steer pretrained image-to-3D representations to do text-guided 3D edits; no massive 3D edit-pair dataset needed. Key trap: the “no-edit” solution is a nasty local minimum. We fix it with preference optimization, pushing the model to actually edit. Steer3D is the second work that adapts alignment ideas from LLMs to the 3D modality. SAM 3D also used DPO to improve its 3D generations.

Georgia Gkioxari

116,061 Aufrufe • vor 6 Monaten

Hitem3D V2.0 just launched. It's an AI 3D model generation tool that does three things: - Photo or image to full 3D model - Model segmentation so you can isolate and refine parts - Image to STL for 3D printing Combine this with Google Nano Banana and you can build game assets, product prototypes, and printable designs in minutes. Here's what I tested. Sponsored by Hi3D 1/4

Hitem3D V2.0 just launched. It's an AI 3D model generation tool that does three things: - Photo or image to full 3D model - Model segmentation so you can isolate and refine parts - Image to STL for 3D printing Combine this with Google Nano Banana and you can build game assets, product prototypes, and printable designs in minutes. Here's what I tested. Sponsored by Hi3D 1/4

AshutoshShrivastava

19,574 Aufrufe • vor 3 Monaten

Image to 3D, now in ANY pose! 🤸‍♂️ Simply upload your image + a pose reference photo. Meshy generates the model to match it perfectly. No complex rigging needed. Create 3D characters your way.

Image to 3D, now in ANY pose! 🤸‍♂️ Simply upload your image + a pose reference photo. Meshy generates the model to match it perfectly. No complex rigging needed. Create 3D characters your way.

MeshyAI

103,295 Aufrufe • vor 5 Monaten

3D-VLA A 3D Vision-Language-Action Generative World Model Recent vision-language-action (VLA) models rely on 2D inputs, lacking integration with the broader realm of the 3D physical world. Furthermore, they perform action prediction by learning a direct mapping from

3D-VLA A 3D Vision-Language-Action Generative World Model Recent vision-language-action (VLA) models rely on 2D inputs, lacking integration with the broader realm of the 3D physical world. Furthermore, they perform action prediction by learning a direct mapping from

AK

85,570 Aufrufe • vor 2 Jahren

LLaVA-3D A Simple yet Effective Pathway to Empowering LMMs with 3D-awareness Recent advancements in Large Multimodal Models (LMMs) have greatly enhanced their proficiency in 2D visual understanding tasks, enabling them to effectively process and understand images and videos. However, the development of LMMs with 3D-awareness for 3D scene understanding has been hindered by the lack of large-scale 3D vision-language datasets and powerful 3D encoders. In this paper, we introduce a simple yet effective framework called LLaVA-3D. Leveraging the strong 2D understanding priors from LLaVA, our LLaVA-3D efficiently adapts LLaVA for 3D scene understanding without compromising 2D understanding capabilities. To achieve this, we employ a simple yet effective representation, 3D Patch, which connects 2D CLIP patch features with their corresponding positions in 3D space. By integrating the 3D Patches into 2D LMMs and employing joint 2D and 3D vision-language instruction tuning, we establish a unified architecture for both 2D image understanding and 3D scene understanding. Experimental results show that LLaVA-3D converges 3.5x faster than existing 3D LMMs when trained on 3D vision-language datasets. Moreover, LLaVA-3D not only achieves state-of-the-art performance across various 3D tasks but also maintains comparable 2D image understanding and vision-language conversation capabilities with LLaVA.

LLaVA-3D A Simple yet Effective Pathway to Empowering LMMs with 3D-awareness Recent advancements in Large Multimodal Models (LMMs) have greatly enhanced their proficiency in 2D visual understanding tasks, enabling them to effectively process and understand images and videos. However, the development of LMMs with 3D-awareness for 3D scene understanding has been hindered by the lack of large-scale 3D vision-language datasets and powerful 3D encoders. In this paper, we introduce a simple yet effective framework called LLaVA-3D. Leveraging the strong 2D understanding priors from LLaVA, our LLaVA-3D efficiently adapts LLaVA for 3D scene understanding without compromising 2D understanding capabilities. To achieve this, we employ a simple yet effective representation, 3D Patch, which connects 2D CLIP patch features with their corresponding positions in 3D space. By integrating the 3D Patches into 2D LMMs and employing joint 2D and 3D vision-language instruction tuning, we establish a unified architecture for both 2D image understanding and 3D scene understanding. Experimental results show that LLaVA-3D converges 3.5x faster than existing 3D LMMs when trained on 3D vision-language datasets. Moreover, LLaVA-3D not only achieves state-of-the-art performance across various 3D tasks but also maintains comparable 2D image understanding and vision-language conversation capabilities with LLaVA.

AK

41,713 Aufrufe • vor 1 Jahr

You can now generate, edit, and convert a reference image into 3D inside one tool. Tripo's Image Generation runs Nano Banana and GPT to build the reference, then turns it into a model. Text or photo in, 3D out. One pipeline, zero handoffs.

You can now generate, edit, and convert a reference image into 3D inside one tool. Tripo's Image Generation runs Nano Banana and GPT to build the reference, then turns it into a model. Text or photo in, 3D out. One pipeline, zero handoffs.

Alvaro Cintas

56,156 Aufrufe • vor 25 Tagen

Making 3D assets just got stupidly easy. Tripo turns a sentence or a single image into a full 3d model, ready for blender, games, printing, whatever. Idea → image → 3D asset. Full workflow below 🧵

Making 3D assets just got stupidly easy. Tripo turns a sentence or a single image into a full 3d model, ready for blender, games, printing, whatever. Idea → image → 3D asset. Full workflow below 🧵

Farhan

44,468 Aufrufe • vor 20 Tagen