正在加载视频...

视频加载失败

返回首页

4D LangSplat 4D Language Gaussian Splatting via Multimodal Large Language Models

_akhaliq's profile picture

AK

504,320 subscribers

30,848 次观看 • 1 年前 •via X (Twitter)

教育科学技术新闻政治
LIVE

Anya Rossi• Live Now

Private livecam show

3 条评论

AK 的头像
AK1 年前

discuss:

AssemblyAI 的头像
AssemblyAI1 年前

Announcing: Our most advanced speech-to-text model goes beyond accuracy to capture the real-world complexity of human conversation and deliver reliable, source-of-truth audio data. Explore Universal-2 updates 👇

Universa 的头像
Universa1 年前

Exciting to see advancements in 4D language Gaussian splatting via multimodal large language models! The intersection of AI and language processing is a key area of focus for Universa, and initiatives like Universa Earth aim to drive innovation in this space.

相关视频

4D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Models Contributions: • We introduce 4D LangSplat for open-vocabulary 4D spatial-temporal queries. To the best of our knowledge, we are the first to construct 4D language fields with object textual captions generated by MLLMs. • To model smooth transitions across states for objects in 4D scenes, we propose a status deformable network to capture continuous temporal changes. • Experiential results show that our method attains state-of-the-art performance for both time-agnostic and time-sensitive open-vocabulary queries.
0:29

4D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Models Contributions: • We introduce 4D LangSplat for open-vocabulary 4D spatial-temporal queries. To the best of our knowledge, we are the first to construct 4D language fields with object textual captions generated by MLLMs. • To model smooth transitions across states for objects in 4D scenes, we propose a status deformable network to capture continuous temporal changes. • Experiential results show that our method attains state-of-the-art performance for both time-agnostic and time-sensitive open-vocabulary queries.

MrNeRF

10,953 次观看 • 1 年前

a one minute explanation of 4d gaussian splatting
0:52

a one minute explanation of 4d gaussian splatting

dylan

186,592 次观看 • 2 年前

Long live bullet time. The future of sports is 4d gaussian splatting.
0:32

Long live bullet time. The future of sports is 4d gaussian splatting.

Bilawal Sidhu

127,960 次观看 • 3 个月前

TALKPLAY Multimodal Music Recommendation with Large Language Models
1:36

TALKPLAY Multimodal Music Recommendation with Large Language Models

AK

20,864 次观看 • 1 年前

Wow! 4D Gaussian Splatting on Apple Vision Pro looks INSANE 🤯 This feels like the future
0:30

Wow! 4D Gaussian Splatting on Apple Vision Pro looks INSANE 🤯 This feels like the future

Ben Geskin

27,539 次观看 • 1 年前

Wow! 4DV releases new examples of their 4D Gaussian Splatting tech. The renderer used is @PlayCanvas.
0:44

Wow! 4DV releases new examples of their 4D Gaussian Splatting tech. The renderer used is @PlayCanvas.

Will Eastcott

44,017 次观看 • 6 个月前

LangSplatV2 High-dimensional 3D Language Gaussian Splatting with 450+ FPS
2:57

LangSplatV2 High-dimensional 3D Language Gaussian Splatting with 450+ FPS

AK

46,826 次观看 • 1 年前

🤩Apple opensources MGIE! Now one can take random pictures w. iPhone & edit w. language! Guiding Instruction-based Image Editing via Multimodal Large Language Models #ICLR2024 spotlight: Apple repo Gradio
0:34

🤩Apple opensources MGIE! Now one can take random pictures w. iPhone & edit w. language! Guiding Instruction-based Image Editing via Multimodal Large Language Models #ICLR2024 spotlight: Apple repo Gradio

William Wang

125,022 次观看 • 2 年前

4D Gaussian Splatting on the web just leveled up. ✨ Announcing the integration of Gracia with the open-source @PlayCanvas Engine. 🧵
1:02

4D Gaussian Splatting on the web just leveled up. ✨ Announcing the integration of Gracia with the open-source @PlayCanvas Engine. 🧵

Will Eastcott

151,370 次观看 • 4 个月前

4D Gaussian Splatting is mindblowing. How is this level of fidelity and realism able to run so flawlessly on a web browser?
1:16

4D Gaussian Splatting is mindblowing. How is this level of fidelity and realism able to run so flawlessly on a web browser?

NikTek

278,850 次观看 • 4 个月前

Oh we talking 4D gaussian splats? 4DV.ai
0:30

Oh we talking 4D gaussian splats? 4DV.ai

Wren

340,157 次观看 • 5 个月前

The Blender 4D Gaussian Splatting project by Zhi Wang is now live on Blender's Demo Files page, complete with two preconfigured scenes. Download here:
0:20

The Blender 4D Gaussian Splatting project by Zhi Wang is now live on Blender's Demo Files page, complete with two preconfigured scenes. Download here:

80 LEVEL

32,860 次观看 • 8 个月前

3D gaussian splatting + time (video) = 4D gaussian splatting is now possible This means in the near future you'll be able to fly around on your phone in any video you recorded A lot like the "braindance" in Cyberpunk 2077
0:29

3D gaussian splatting + time (video) = 4D gaussian splatting is now possible This means in the near future you'll be able to fly around on your phone in any video you recorded A lot like the "braindance" in Cyberpunk 2077

@levelsio

590,061 次观看 • 1 年前

RynnWorld-4D 4D Embodied World Models for Robotic Manipulation
1:41

RynnWorld-4D 4D Embodied World Models for Robotic Manipulation

AK

33,467 次观看 • 23 天前

omg.. this cant be real China’s 4DV AI just dropped 4D Gaussian Splatting, you can turn 2D video into 4D with sound.. imagine.. we will be able to change camera angle, zoom in/out while watching movies 5 examples:
0:25

omg.. this cant be real China’s 4DV AI just dropped 4D Gaussian Splatting, you can turn 2D video into 4D with sound.. imagine.. we will be able to change camera angle, zoom in/out while watching movies 5 examples:

el.cine

3,611,895 次观看 • 1 年前

Large language models:
0:46

Large language models:

Liv

91,909 次观看 • 7 个月前

Large Language Models Visualized
1:06

Large Language Models Visualized

ₕₐₘₚₜₒₙ

85,984 次观看 • 1 年前

LangSplatV2: High-dimensional 3D Language Gaussian Splatting with 450+ FPS Contributions: • LangSplatV2 achieves real-time performance with 476.2 FPS for high-dimensional feature splatting and 384.6 FPS for 3D open-vocabulary text querying. • Delivers a 42× speedup and 47× boost in performance compared to LangSplat. • Improves query accuracy while drastically reducing inference time. • Replaces the heavyweight decoder in LangSplat with a sparse coefficient field, removing the main performance bottleneck. • Introduces a CUDA-optimized sparse coefficient splatting method, enabling fast and high-quality rendering of high-dimensional features. • Enables scalable 3D language interaction in complex scenes, opening up real-time applications previously not possible with LangSplat.
1:13

LangSplatV2: High-dimensional 3D Language Gaussian Splatting with 450+ FPS Contributions: • LangSplatV2 achieves real-time performance with 476.2 FPS for high-dimensional feature splatting and 384.6 FPS for 3D open-vocabulary text querying. • Delivers a 42× speedup and 47× boost in performance compared to LangSplat. • Improves query accuracy while drastically reducing inference time. • Replaces the heavyweight decoder in LangSplat with a sparse coefficient field, removing the main performance bottleneck. • Introduces a CUDA-optimized sparse coefficient splatting method, enabling fast and high-quality rendering of high-dimensional features. • Enables scalable 3D language interaction in complex scenes, opening up real-time applications previously not possible with LangSplat.

MrNeRF

14,261 次观看 • 1 年前

Stream-Omni Simultaneous Multimodal Interactions with Large Language-Vision-Speech Model
0:37

Stream-Omni Simultaneous Multimodal Interactions with Large Language-Vision-Speech Model

AK

12,374 次观看 • 1 年前