正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

LERF: Language Embedded Radiance Fields TL;DR: Grounding CLIP vectors volumetrically inside a NeRF allows flexible natural language queries in 3D abs: project page:

AK

506,772 subscribers

251,233 次观看 • 3 年前 •via X (Twitter)

科学技术教育

Anya Rossi• Live Now

Private livecam show

9 条评论

Fabien Benetou 的头像

Fabien Benetou3 年前

Damn...

Allknight 的头像

Allknight2 年前

@zenstyle Now do Sarah Connor >:D

potatoruning 的头像

potatoruning3 年前

looks good

David Asem 的头像

David Asem3 年前

For a sex maybe 🤔 fix the @AR15COM has a fix

Viho 的头像

Viho3 年前

🤩

MoonGotArt 的头像

MoonGotArt3 年前

Will this be open source?

Bill Xue 的头像

Bill Xue3 年前

@SaveToNotion #tweet

Guruprasad Venkataraghavan 的头像

Guruprasad Venkataraghavan3 年前

@memdotai mem it

$maczter 的头像

$maczter2 年前

@icreatelife 🤯🤯🤯

相关视频

3D-aware Conditional Image Synthesis abs: project page:

3D-aware Conditional Image Synthesis abs: project page:

AK

301,457 次观看 • 3 年前

Towards Realistic Generative 3D Face Models abs: project page:

Towards Realistic Generative 3D Face Models abs: project page:

AK

48,089 次观看 • 3 年前

Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior abs: project page:

Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior abs: project page:

AK

163,868 次观看 • 3 年前

Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion abs: project page:

Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion abs: project page:

AK

262,963 次观看 • 3 年前

Microsoft released Trellis! Trellis is a new 3D model that generates high-quality 3D assets in formats like Radiance Fields, 3D Gaussians, and meshes.

Microsoft released Trellis! Trellis is a new 3D model that generates high-quality 3D assets in formats like Radiance Fields, 3D Gaussians, and meshes.

Dreaming Tulpa 🥓👑

85,115 次观看 • 1 年前

Generative Novel View Synthesis with 3D-Aware Diffusion Models abs: project page:

Generative Novel View Synthesis with 3D-Aware Diffusion Models abs: project page:

AK

304,708 次观看 • 3 年前

How can we learn 3D visual grounding with natural supervision—only looking at QA pairs, without ground truth bounding boxes or object classification labels? We inject explicit language priors, e.g., the symmetric property that A near B ⇒ B near A, in structured vision models.

How can we learn 3D visual grounding with natural supervision—only looking at QA pairs, without ground truth bounding boxes or object classification labels? We inject explicit language priors, e.g., the symmetric property that A near B ⇒ B near A, in structured vision models.

Joy Hsu

14,843 次观看 • 2 年前

SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collections abs: project page:

SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collections abs: project page:

AK

317,619 次观看 • 3 年前

A clip of Dr. Liaquat Sani's Brahui language class in an institute in Japan. Sadly,Brahui language is classified as Vulnerable by the #UNESCO Atlas of the World's Languages in Danger.Each little contribution made in order to preserve this language, counts!

A clip of Dr. Liaquat Sani's Brahui language class in an institute in Japan. Sadly,Brahui language is classified as Vulnerable by the #UNESCO Atlas of the World's Languages in Danger.Each little contribution made in order to preserve this language, counts!

Nimra Pirkani

13,650 次观看 • 3 年前

Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fields paper page: Editing a local region or a specific object in a 3D scene represented by a NeRF is challenging, mainly due to the implicit nature of the scene representation. Consistently blending a new realistic object into the scene adds an additional level of difficulty. We present Blended-NeRF, a robust and flexible framework for editing a specific region of interest in an existing NeRF scene, based on text prompts or image patches, along with a 3D ROI box. Our method leverages a pretrained language-image model to steer the synthesis towards a user-provided text prompt or image patch, along with a 3D MLP model initialized on an existing NeRF scene to generate the object and blend it into a specified region in the original scene. We allow local editing by localizing a 3D ROI box in the input scene, and seamlessly blend the content synthesized inside the ROI with the existing scene using a novel volumetric blending technique. To obtain natural looking and view-consistent results, we leverage existing and new geometric priors and 3D augmentations for improving the visual fidelity of the final result. We test our framework both qualitatively and quantitatively on a variety of real 3D scenes and text prompts, demonstrating realistic multi-view consistent results with much flexibility and diversity compared to the baselines. Finally, we show the applicability of our framework for several 3D editing applications, including adding new objects to a scene, removing/replacing/altering existing objects, and texture conversion.

Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fields paper page: Editing a local region or a specific object in a 3D scene represented by a NeRF is challenging, mainly due to the implicit nature of the scene representation. Consistently blending a new realistic object into the scene adds an additional level of difficulty. We present Blended-NeRF, a robust and flexible framework for editing a specific region of interest in an existing NeRF scene, based on text prompts or image patches, along with a 3D ROI box. Our method leverages a pretrained language-image model to steer the synthesis towards a user-provided text prompt or image patch, along with a 3D MLP model initialized on an existing NeRF scene to generate the object and blend it into a specified region in the original scene. We allow local editing by localizing a 3D ROI box in the input scene, and seamlessly blend the content synthesized inside the ROI with the existing scene using a novel volumetric blending technique. To obtain natural looking and view-consistent results, we leverage existing and new geometric priors and 3D augmentations for improving the visual fidelity of the final result. We test our framework both qualitatively and quantitatively on a variety of real 3D scenes and text prompts, demonstrating realistic multi-view consistent results with much flexibility and diversity compared to the baselines. Finally, we show the applicability of our framework for several 3D editing applications, including adding new objects to a scene, removing/replacing/altering existing objects, and texture conversion.

AK

62,768 次观看 • 3 年前

Vision-Language Foundation model should go to 3D for robotics!🤖 CoRL23 Oral: GNFactor learns Generalizable Neural Feature Fields for language conditioned manipulation on diverse scenes. It unifies 3D➕Stable Diffusion features using generalizable NeRFs.

Vision-Language Foundation model should go to 3D for robotics!🤖 CoRL23 Oral: GNFactor learns Generalizable Neural Feature Fields for language conditioned manipulation on diverse scenes. It unifies 3D➕Stable Diffusion features using generalizable NeRFs.

Xiaolong Wang

56,268 次观看 • 2 年前

🔥Character AI in VR Space🔥 We present #SOLAMI, a social vision-language-action (VLA) model that enables 3D autonomous characters with *speech and body language* interaction - Project: - Paper Hugging Face : . Thanks AK !

🔥Character AI in VR Space🔥 We present #SOLAMI, a social vision-language-action (VLA) model that enables 3D autonomous characters with speech and body language interaction - Project: - Paper Hugging Face : . Thanks AK !

Ziwei Liu

27,957 次观看 • 1 年前

Accurate and controllable scene generation has been difficult with natural language alone. You instead need a language for scenes. Introducing the Scene Language — a visual representation for high-quality 3D/4D generation by integrating programs, words, and embeddings — 🧵(1/6)

Accurate and controllable scene generation has been difficult with natural language alone. You instead need a language for scenes. Introducing the Scene Language — a visual representation for high-quality 3D/4D generation by integrating programs, words, and embeddings — 🧵(1/6)

Yunzhi Zhang

63,813 次观看 • 1 年前

Synthesia research releases HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motion a 4D dynamic neural scene representation that captures full-body appearance in motion from multi-view video input, and enables playback from novel, unseen viewpoints project page: paper page:

Synthesia research releases HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motion a 4D dynamic neural scene representation that captures full-body appearance in motion from multi-view video input, and enables playback from novel, unseen viewpoints project page: paper page:

AK

160,702 次观看 • 3 年前

DreamBooth3D: Subject-Driven Text-to-3D Generation Personalized 3D models from just a few casual photos, with text-driven modifications abs: project page:

DreamBooth3D: Subject-Driven Text-to-3D Generation Personalized 3D models from just a few casual photos, with text-driven modifications abs: project page:

AK

107,503 次观看 • 3 年前

Meet Houston, your AI data engineer. Run natural language queries with prompt-to-SQL and generate instant charts and dashboards. Build a data pipeline in seconds with our OpenAI chatbot. 🚀#MeetHouston

Meet Houston, your AI data engineer. Run natural language queries with prompt-to-SQL and generate instant charts and dashboards. Build a data pipeline in seconds with our OpenAI chatbot. 🚀#MeetHouston

Space and Time

141,637 次观看 • 3 年前

it's always the zoom in on love language soobin abs

it's always the zoom in on love language soobin abs

jaz 🐰🍀

165,235 次观看 • 6 个月前

Kalesh b/w a Girl and Bengali Speaking Family over language issues inside Metro Lift (Full Context in the clip)

Kalesh b/w a Girl and Bengali Speaking Family over language issues inside Metro Lift (Full Context in the clip)

Ghar Ke Kalesh

362,235 次观看 • 1 年前

Kinda makes sense that natural language is the final programming language?

Kinda makes sense that natural language is the final programming language?

Sara Dietschy 🍑y

15,333 次观看 • 9 个月前

LookCloser🔍: Frequency-aware Radiance Field for Tiny-Detail Scene TL;DR: FA-NeRF:l frequency-aware framework for view synthesis that simultaneously captures the overall scene structure and high-definition details within a single NeRF model.

LookCloser🔍: Frequency-aware Radiance Field for Tiny-Detail Scene TL;DR: FA-NeRF:l frequency-aware framework for view synthesis that simultaneously captures the overall scene structure and high-definition details within a single NeRF model.

Alexandre Morgand

16,201 次观看 • 1 年前