Loading video...

Video Failed to Load

Go Home

Thinking with Camera A Unified Multimodal Model for Camera-Centric Understanding and Generation

_akhaliq's profile picture

AK

518,855 subscribers

39,380 views • 10 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Introducing Omni, one unified model can support any-to-any multimodal modeling, including multimodal understanding, image/video generation and editing, world modeling and 3D reconstruction. All in one that adopts standard mixture-of-experts arch with only 3B activations.
1:20

Introducing Omni, one unified model can support any-to-any multimodal modeling, including multimodal understanding, image/video generation and editing, world modeling and 3D reconstruction. All in one that adopts standard mixture-of-experts arch with only 3B activations.

Ceyuan Yang

32,339 views • 4 months ago

Woah. First person camera view being warped to a third person camera view using a unified flow and matching model.
1:29

Woah. First person camera view being warped to a third person camera view using a unified flow and matching model.

Bilawal Sidhu

339,661 views • 1 year ago

(1/10) 🔥Thrilled to introduce OneDiffusion—our latest work in unified diffusion modeling! 🚀 This model bridges the gap between image synthesis and understanding, excelling in a wide range of tasks: T2I, conditional generation, image understanding, identity preservation, multiview generation, and even camera pose estimation. Learn more at: Project: arXiv: Code (on the way):
1:22

(1/10) 🔥Thrilled to introduce OneDiffusion—our latest work in unified diffusion modeling! 🚀 This model bridges the gap between image synthesis and understanding, excelling in a wide range of tasks: T2I, conditional generation, image understanding, identity preservation, multiview generation, and even camera pose estimation. Learn more at: Project: arXiv: Code (on the way):

Jiasen Lu

33,426 views • 1 year ago

One image + text + camera trajectory = controllable worlds. All on a single GPU. Our research team just released SANA-WM, a 2.6B open source world model natively trained for 60-second video generation with precise camera control.
0:20

One image + text + camera trajectory = controllable worlds. All on a single GPU. Our research team just released SANA-WM, a 2.6B open source world model natively trained for 60-second video generation with precise camera control.

NVIDIA AI

93,154 views • 3 months ago

Big ideas deserve a powerful model. MiniMax H3 is now available on Fotor. From cinematic brand films and AI storytelling to ecommerce marketing, animation, and game-inspired visuals, MiniMax H3 is built to handle every stage of your creative workflow. With native multimodal understanding, multi-reference generation, advanced character and camera control, and expressive voice capabilities, turning complex ideas into production-ready content has never been easier. One model. Endless creative possibilities. Try MiniMax H3 on Fotor today.
0:29

Big ideas deserve a powerful model. MiniMax H3 is now available on Fotor. From cinematic brand films and AI storytelling to ecommerce marketing, animation, and game-inspired visuals, MiniMax H3 is built to handle every stage of your creative workflow. With native multimodal understanding, multi-reference generation, advanced character and camera control, and expressive voice capabilities, turning complex ideas into production-ready content has never been easier. One model. Endless creative possibilities. Try MiniMax H3 on Fotor today.

Fotor

81,531 views • 29 days ago

SpatialTrackerV2: unified, end-to-end 3D point tracking model which simultaneously estimates Camera Motion, Consistent Geometry and Pixel-wise 3D Trajectories.
0:35

SpatialTrackerV2: unified, end-to-end 3D point tracking model which simultaneously estimates Camera Motion, Consistent Geometry and Pixel-wise 3D Trajectories.

Bilawal Sidhu

20,346 views • 1 year ago

"YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splatting" TL;DR: a unified 3D Gaussian splatting model that reconstructs high-quality scene geometry and camera poses from unposed/uncalibrated images in a single forward pass.
0:38

"YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splatting" TL;DR: a unified 3D Gaussian splatting model that reconstructs high-quality scene geometry and camera poses from unposed/uncalibrated images in a single forward pass.

Alexandre Morgand

15,035 views • 6 months ago

Soooo my wonderful roommate @hypnojockCJ took me under last night... on camera. We're thinking of starting a hypno-centric JFF. 👀👀 So... Stay tuned!
0:57

Sensitive content

Soooo my wonderful roommate @hypnojockCJ took me under last night... on camera. We're thinking of starting a hypno-centric JFF. 👀👀 So... Stay tuned!

Leather Canuck™ TeddyHawk

20,570 views • 2 years ago

DINO-X: A Unified Vision Model for Open-World Object Detection and Understanding TL;DR: DINO-X Pro: sota model with enhanced perception capabilities for various scenarios; DINO-X Edge: model optimized for faster inference speed and better suited for deployment on edge devices
0:45

DINO-X: A Unified Vision Model for Open-World Object Detection and Understanding TL;DR: DINO-X Pro: sota model with enhanced perception capabilities for various scenarios; DINO-X Edge: model optimized for faster inference speed and better suited for deployment on edge devices

Alexandre Morgand

60,743 views • 1 year ago

BulletTime Decoupled Control of Time and Camera Pose for Video Generation
1:36

BulletTime Decoupled Control of Time and Camera Pose for Video Generation

AK

11,745 views • 8 months ago

Meta presents TUNA Taming Unified Visual Representations for Native Unified Multimodal Models
1:11

Meta presents TUNA Taming Unified Visual Representations for Native Unified Multimodal Models

AK

32,771 views • 9 months ago

🚀UniWorld: a unified model that skips VAEs and uses semantic features from SigLIP! Using just 1% of BAGEL’s data, it outperforms on image editing and excels in understanding & generation. 🌟Now data, model, training & evaluation script are open-source!
2:06

🚀UniWorld: a unified model that skips VAEs and uses semantic features from SigLIP! Using just 1% of BAGEL’s data, it outperforms on image editing and excels in understanding & generation. 🌟Now data, model, training & evaluation script are open-source!

Bin Lin

22,345 views • 1 year ago

🚀 We just released LTX-Video 13B – our most powerful open-source video generation model yet. – 13B parameters – Multiscale rendering for better fine details – Better motion and scene understanding – Still fast - runs on local GPUs – Supports keyframes, camera/character motion & multi-shot sequences
2:20

🚀 We just released LTX-Video 13B – our most powerful open-source video generation model yet. – 13B parameters – Multiscale rendering for better fine details – Better motion and scene understanding – Still fast - runs on local GPUs – Supports keyframes, camera/character motion & multi-shot sequences

Yoav HaCohen

182,944 views • 1 year ago

Bernini-R is now live on fal! One unified model that both generates and edits video Edit by instruction: swap objects, weather, backgrounds, camera angles or style, scene stays intact Guide it with up to 5 reference images for a consistent look
0:21

Bernini-R is now live on fal! One unified model that both generates and edits video Edit by instruction: swap objects, weather, backgrounds, camera angles or style, scene stays intact Guide it with up to 5 reference images for a consistent look

fal

14,434 views • 2 months ago

Introducing Kling O1 World's first unified multimodal video model. Edit anything with creative control, coherent motion, and high-precision detail across every frame Now available on Freepik
0:38

Introducing Kling O1 World's first unified multimodal video model. Edit anything with creative control, coherent motion, and high-precision detail across every frame Now available on Freepik

Magnific

121,573 views • 9 months ago

3D-R1 is out on Hugging Face Enhancing Reasoning in 3D VLMs for Unified Scene Understanding 3D-R1 is an open-source generalist model that enhances the reasoning of 3D VLMs for unified scene understanding
0:30

3D-R1 is out on Hugging Face Enhancing Reasoning in 3D VLMs for Unified Scene Understanding 3D-R1 is an open-source generalist model that enhances the reasoning of 3D VLMs for unified scene understanding

AK

34,729 views • 1 year ago