Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Thinking with Camera A Unified Multimodal Model for Camera-Centric Understanding and Generation

_akhaliq's profile picture

AK

501,194 subscribers

39,318 Aufrufe • vor 8 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Wait, that's JUST a 3B multimodal model understanding and generation model AND apache 2.0 licensed 🔥
0:34

Wait, that's JUST a 3B multimodal model understanding and generation model AND apache 2.0 licensed 🔥

Vaibhav (VB) Srivastav

43,777 Aufrufe • vor 1 Jahr

Introducing Omni, one unified model can support any-to-any multimodal modeling, including multimodal understanding, image/video generation and editing, world modeling and 3D reconstruction. All in one that adopts standard mixture-of-experts arch with only 3B activations.
1:20

Introducing Omni, one unified model can support any-to-any multimodal modeling, including multimodal understanding, image/video generation and editing, world modeling and 3D reconstruction. All in one that adopts standard mixture-of-experts arch with only 3B activations.

Ceyuan Yang

31,091 Aufrufe • vor 2 Monaten

Woah. First person camera view being warped to a third person camera view using a unified flow and matching model.
1:29

Woah. First person camera view being warped to a third person camera view using a unified flow and matching model.

Bilawal Sidhu

339,562 Aufrufe • vor 1 Jahr

(1/10) 🔥Thrilled to introduce OneDiffusion—our latest work in unified diffusion modeling! 🚀 This model bridges the gap between image synthesis and understanding, excelling in a wide range of tasks: T2I, conditional generation, image understanding, identity preservation, multiview generation, and even camera pose estimation. Learn more at: Project: arXiv: Code (on the way):
1:22

(1/10) 🔥Thrilled to introduce OneDiffusion—our latest work in unified diffusion modeling! 🚀 This model bridges the gap between image synthesis and understanding, excelling in a wide range of tasks: T2I, conditional generation, image understanding, identity preservation, multiview generation, and even camera pose estimation. Learn more at: Project: arXiv: Code (on the way):

Jiasen Lu

33,383 Aufrufe • vor 1 Jahr

One image + text + camera trajectory = controllable worlds. All on a single GPU. Our research team just released SANA-WM, a 2.6B open source world model natively trained for 60-second video generation with precise camera control.
0:20

One image + text + camera trajectory = controllable worlds. All on a single GPU. Our research team just released SANA-WM, a 2.6B open source world model natively trained for 60-second video generation with precise camera control.

NVIDIA AI

90,569 Aufrufe • vor 1 Monat

SpatialTrackerV2: unified, end-to-end 3D point tracking model which simultaneously estimates Camera Motion, Consistent Geometry and Pixel-wise 3D Trajectories.
0:35

SpatialTrackerV2: unified, end-to-end 3D point tracking model which simultaneously estimates Camera Motion, Consistent Geometry and Pixel-wise 3D Trajectories.

Bilawal Sidhu

20,346 Aufrufe • vor 11 Monaten

"YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splatting" TL;DR: a unified 3D Gaussian splatting model that reconstructs high-quality scene geometry and camera poses from unposed/uncalibrated images in a single forward pass.
0:38

"YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splatting" TL;DR: a unified 3D Gaussian splatting model that reconstructs high-quality scene geometry and camera poses from unposed/uncalibrated images in a single forward pass.

Alexandre Morgand

14,839 Aufrufe • vor 4 Monaten

Soooo my wonderful roommate @hypnojockCJ took me under last night... on camera. We're thinking of starting a hypno-centric JFF. 👀👀 So... Stay tuned!
0:57

Sensitive content

Soooo my wonderful roommate @hypnojockCJ took me under last night... on camera. We're thinking of starting a hypno-centric JFF. 👀👀 So... Stay tuned!

Leather Canuck™ TeddyHawk

20,570 Aufrufe • vor 2 Jahren

DINO-X: A Unified Vision Model for Open-World Object Detection and Understanding TL;DR: DINO-X Pro: sota model with enhanced perception capabilities for various scenarios; DINO-X Edge: model optimized for faster inference speed and better suited for deployment on edge devices
0:45

DINO-X: A Unified Vision Model for Open-World Object Detection and Understanding TL;DR: DINO-X Pro: sota model with enhanced perception capabilities for various scenarios; DINO-X Edge: model optimized for faster inference speed and better suited for deployment on edge devices

Alexandre Morgand

60,725 Aufrufe • vor 1 Jahr

BulletTime Decoupled Control of Time and Camera Pose for Video Generation
1:36

BulletTime Decoupled Control of Time and Camera Pose for Video Generation

AK

11,745 Aufrufe • vor 6 Monaten

Meta presents TUNA Taming Unified Visual Representations for Native Unified Multimodal Models
1:11

Meta presents TUNA Taming Unified Visual Representations for Native Unified Multimodal Models

AK

32,717 Aufrufe • vor 6 Monaten

🚀UniWorld: a unified model that skips VAEs and uses semantic features from SigLIP! Using just 1% of BAGEL’s data, it outperforms on image editing and excels in understanding & generation. 🌟Now data, model, training & evaluation script are open-source!
2:06

🚀UniWorld: a unified model that skips VAEs and uses semantic features from SigLIP! Using just 1% of BAGEL’s data, it outperforms on image editing and excels in understanding & generation. 🌟Now data, model, training & evaluation script are open-source!

Bin Lin

22,327 Aufrufe • vor 1 Jahr

🚀 We just released LTX-Video 13B – our most powerful open-source video generation model yet. – 13B parameters – Multiscale rendering for better fine details – Better motion and scene understanding – Still fast - runs on local GPUs – Supports keyframes, camera/character motion & multi-shot sequences
2:20

🚀 We just released LTX-Video 13B – our most powerful open-source video generation model yet. – 13B parameters – Multiscale rendering for better fine details – Better motion and scene understanding – Still fast - runs on local GPUs – Supports keyframes, camera/character motion & multi-shot sequences

Yoav HaCohen

182,733 Aufrufe • vor 1 Jahr

Bernini-R is now live on fal! One unified model that both generates and edits video Edit by instruction: swap objects, weather, backgrounds, camera angles or style, scene stays intact Guide it with up to 5 reference images for a consistent look
0:21

Bernini-R is now live on fal! One unified model that both generates and edits video Edit by instruction: swap objects, weather, backgrounds, camera angles or style, scene stays intact Guide it with up to 5 reference images for a consistent look

fal

13,998 Aufrufe • vor 18 Tagen

Introducing Kling O1 World's first unified multimodal video model. Edit anything with creative control, coherent motion, and high-precision detail across every frame Now available on Freepik
0:38

Introducing Kling O1 World's first unified multimodal video model. Edit anything with creative control, coherent motion, and high-precision detail across every frame Now available on Freepik

Magnific

121,558 Aufrufe • vor 6 Monaten

🎥 Take Full Control of the Camera! 🚨 I got early access to the new feature Camera Control with T2V 01 - Director Model by Hailuo AI (MiniMax) the ultimate tool for full camera control in video generation! ✨ What’s exciting? Direct with ease: Use natural language to guide your camera exactly how you want Smooth transitions: Combine multiple moves seamlessly for cinematic perfection Here are 10 sample prompts 🔖Bookmark for later!
1:00

🎥 Take Full Control of the Camera! 🚨 I got early access to the new feature Camera Control with T2V 01 - Director Model by Hailuo AI (MiniMax) the ultimate tool for full camera control in video generation! ✨ What’s exciting? Direct with ease: Use natural language to guide your camera exactly how you want Smooth transitions: Combine multiple moves seamlessly for cinematic perfection Here are 10 sample prompts 🔖Bookmark for later!

MayorkingAI

26,819 Aufrufe • vor 1 Jahr

3D-R1 is out on Hugging Face Enhancing Reasoning in 3D VLMs for Unified Scene Understanding 3D-R1 is an open-source generalist model that enhances the reasoning of 3D VLMs for unified scene understanding
0:30

3D-R1 is out on Hugging Face Enhancing Reasoning in 3D VLMs for Unified Scene Understanding 3D-R1 is an open-source generalist model that enhances the reasoning of 3D VLMs for unified scene understanding

AK

34,729 Aufrufe • vor 10 Monaten

*Why panorama?* Standard video models struggle with object permanence—if a camera pans away and comes back, objects may disappear. With panoramas, the model is forced to generate everything in the scene. This serves as a "working memory" for consistent world generation. (3/N)
0:50

*Why panorama?* Standard video models struggle with object permanence—if a camera pans away and comes back, objects may disappear. With panoramas, the model is forced to generate everything in the scene. This serves as a "working memory" for consistent world generation. (3/N)

Ziyi Wu

22,019 Aufrufe • vor 4 Monaten