Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

SCoPE Sightline-Coordinate Positional Encoding for Video Diffusion Transformers model:

_akhaliq's profile picture

AK

530,834 subscribers

24,274 görüntüleme • 2 ay önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

5 Yorum

Jane Austen profil fotoğrafı
Jane Austen2 ay önce

SCoPE looks really interesting for video diffusion. Better positional encoding could make a big difference in how models handle motion and spatial consistency across longer video sequences. Definitely one to watch. 🔥

César Bonilla profil fotoğrafı
César Bonilla2 ay önce

Mamma mia

Michael Yin profil fotoğrafı
Michael Yin2 ay önce

Thanks for sharing SCoPE! The interactive demo is now live with few-step inference. Huggingface Space: TencentARC/scope-camera-video-generation

HU Wenbo profil fotoğrafı
HU Wenbo2 ay önce

Thx for sharing Code and weights are up, Apache-2.0:

dhinna ship .ico profil fotoğrafı
dhinna ship .ico2 ay önce

Does SCoPE's coordinate scheme reduce drift on clips longer than 16 frames?

Benzer Videolar

"Cameras as Relative Positional Encoding" TLDR: comparison for conditioning transformers on cameras: token-level raymap, attention-level relative pose encodings, a (new) relative encoding Projective Positional Encoding -> camera frustums, (int|ext)insics for relative pos encoding
0:30

"Cameras as Relative Positional Encoding" TLDR: comparison for conditioning transformers on cameras: token-level raymap, attention-level relative pose encodings, a (new) relative encoding Projective Positional Encoding -> camera frustums, (int|ext)insics for relative pos encoding

Alexandre Morgand

17,837 görüntüleme • 1 yıl önce

Meta presents Adaptive Caching for Faster Video Generation with Diffusion Transformers
0:50

Meta presents Adaptive Caching for Faster Video Generation with Diffusion Transformers

AK

53,129 görüntüleme • 1 yıl önce

I spent months illustrating how Transformers actually work. Not just what they do, but why they’re built this way. The history, design choices, and intuition behind every layer. From RNNs → Attention → Multi-Head → FFNs → Positional Encoding. Here's everything I wish I knew:
1:16

I spent months illustrating how Transformers actually work. Not just what they do, but why they’re built this way. The history, design choices, and intuition behind every layer. From RNNs → Attention → Multi-Head → FFNs → Positional Encoding. Here's everything I wish I knew:

krupa

251,821 görüntüleme • 1 yıl önce

📢📢📢 𝐀𝐂𝟑𝐃: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers TL;DR: for 3D camera control in generative video, it really helps knowing *which* part of your model you should mess with Internship by Sherwin Bahmani at Snap
0:40

📢📢📢 𝐀𝐂𝟑𝐃: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers TL;DR: for 3D camera control in generative video, it really helps knowing *which* part of your model you should mess with Internship by Sherwin Bahmani at Snap

Andrea Tagliasacchi

23,088 görüntüleme • 1 yıl önce

FasterCache Training-Free Video Diffusion Model Acceleration with High Quality
1:10

FasterCache Training-Free Video Diffusion Model Acceleration with High Quality

AK

91,309 görüntüleme • 2 yıl önce

Epona Autoregressive Diffusion World Model for Autonomous Driving
0:32

Epona Autoregressive Diffusion World Model for Autonomous Driving

AK

18,839 görüntüleme • 1 yıl önce

A new frontier. Project Starlight—the first and only diffusion-based AI model for enhancing video. Launching soon.
0:22

A new frontier. Project Starlight—the first and only diffusion-based AI model for enhancing video. Launching soon.

Topaz Labs

22,375 görüntüleme • 1 yıl önce

We introduce W.A.L.T, a diffusion model for photorealistic video generation. Our model is a transformer trained on image and video generation in a shared latent space. 🧵👇
0:43

We introduce W.A.L.T, a diffusion model for photorealistic video generation. Our model is a transformer trained on image and video generation in a shared latent space. 🧵👇

Agrim Gupta

431,358 görüntüleme • 2 yıl önce

AnyFlow Any-Step Video Diffusion Model with On-Policy Flow Map Distillation
1:17

AnyFlow Any-Step Video Diffusion Model with On-Policy Flow Map Distillation

AK

14,152 görüntüleme • 5 ay önce

Video diffusion models generate high-quality videos but are too slow for interactive applications. We MIT CSAIL Adobe Research introduce CausVid, a fast autoregressive video diffusion model that starts playing the moment you hit "Generate"! A thread 🧵
0:31

Video diffusion models generate high-quality videos but are too slow for interactive applications. We MIT CSAIL Adobe Research introduce CausVid, a fast autoregressive video diffusion model that starts playing the moment you hit "Generate"! A thread 🧵

Tianwei Yin

84,074 görüntüleme • 1 yıl önce

damn,.... this is so incredibly cool use case for discrete diffusion model
0:41

damn,.... this is so incredibly cool use case for discrete diffusion model

Simo Ryu

2,558,114 görüntüleme • 1 yıl önce

📢Excited to be at #ICLR2025 for our paper: VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Poster: Thu 3-5:30 PM (#134) Website: Code: Also check out our #CVPR2025 follow-up AC3D:
0:29

📢Excited to be at #ICLR2025 for our paper: VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Poster: Thu 3-5:30 PM (#134) Website: Code: Also check out our #CVPR2025 follow-up AC3D:

Sherwin Bahmani

11,643 görüntüleme • 1 yıl önce

Today, we are releasing Stable Video Diffusion, our first foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:
0:20

Today, we are releasing Stable Video Diffusion, our first foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:

Stability AI

1,024,881 görüntüleme • 2 yıl önce

🔥Diffusion Masters Transparent Objects in Videos! We introduce #DKT, a foundation model that repurposes video diffusion for zero-shot depth and normal estimation on Transparent and Reflective Objects with Superior Temporal Consistency Demo: Code:
0:57

🔥Diffusion Masters Transparent Objects in Videos! We introduce #DKT, a foundation model that repurposes video diffusion for zero-shot depth and normal estimation on Transparent and Reflective Objects with Superior Temporal Consistency Demo: Code:

Chongjie Ye

28,181 görüntüleme • 10 ay önce

Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion abs: project page:
1:22

Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion abs: project page:

AK

263,035 görüntüleme • 3 yıl önce