Загрузка видео...

Не удалось загрузить видео

На главную

SCoPE Sightline-Coordinate Positional Encoding for Video Diffusion Transformers model:

_akhaliq's profile picture

AK

530,834 subscribers

24,274 просмотров • 2 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 5

Фото профиля Jane Austen
Jane Austen2 месяцев назад

SCoPE looks really interesting for video diffusion. Better positional encoding could make a big difference in how models handle motion and spatial consistency across longer video sequences. Definitely one to watch. 🔥

Фото профиля César Bonilla
César Bonilla2 месяцев назад

Mamma mia

Фото профиля Michael Yin
Michael Yin2 месяцев назад

Thanks for sharing SCoPE! The interactive demo is now live with few-step inference. Huggingface Space: TencentARC/scope-camera-video-generation

Фото профиля HU Wenbo
HU Wenbo2 месяцев назад

Thx for sharing Code and weights are up, Apache-2.0:

Фото профиля dhinna ship .ico
dhinna ship .ico2 месяцев назад

Does SCoPE's coordinate scheme reduce drift on clips longer than 16 frames?

Похожие видео

"Cameras as Relative Positional Encoding" TLDR: comparison for conditioning transformers on cameras: token-level raymap, attention-level relative pose encodings, a (new) relative encoding Projective Positional Encoding -> camera frustums, (int|ext)insics for relative pos encoding
0:30

"Cameras as Relative Positional Encoding" TLDR: comparison for conditioning transformers on cameras: token-level raymap, attention-level relative pose encodings, a (new) relative encoding Projective Positional Encoding -> camera frustums, (int|ext)insics for relative pos encoding

Alexandre Morgand

17,837 просмотров • 1 год назад

Meta presents Adaptive Caching for Faster Video Generation with Diffusion Transformers
0:50

Meta presents Adaptive Caching for Faster Video Generation with Diffusion Transformers

AK

53,129 просмотров • 1 год назад

I spent months illustrating how Transformers actually work. Not just what they do, but why they’re built this way. The history, design choices, and intuition behind every layer. From RNNs → Attention → Multi-Head → FFNs → Positional Encoding. Here's everything I wish I knew:
1:16

I spent months illustrating how Transformers actually work. Not just what they do, but why they’re built this way. The history, design choices, and intuition behind every layer. From RNNs → Attention → Multi-Head → FFNs → Positional Encoding. Here's everything I wish I knew:

krupa

251,821 просмотров • 1 год назад

📢📢📢 𝐀𝐂𝟑𝐃: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers TL;DR: for 3D camera control in generative video, it really helps knowing *which* part of your model you should mess with Internship by Sherwin Bahmani at Snap
0:40

📢📢📢 𝐀𝐂𝟑𝐃: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers TL;DR: for 3D camera control in generative video, it really helps knowing *which* part of your model you should mess with Internship by Sherwin Bahmani at Snap

Andrea Tagliasacchi

23,088 просмотров • 1 год назад

FasterCache Training-Free Video Diffusion Model Acceleration with High Quality
1:10

FasterCache Training-Free Video Diffusion Model Acceleration with High Quality

AK

91,309 просмотров • 2 лет назад

Epona Autoregressive Diffusion World Model for Autonomous Driving
0:32

Epona Autoregressive Diffusion World Model for Autonomous Driving

AK

18,839 просмотров • 1 год назад

A new frontier. Project Starlight—the first and only diffusion-based AI model for enhancing video. Launching soon.
0:22

A new frontier. Project Starlight—the first and only diffusion-based AI model for enhancing video. Launching soon.

Topaz Labs

22,375 просмотров • 1 год назад

We introduce W.A.L.T, a diffusion model for photorealistic video generation. Our model is a transformer trained on image and video generation in a shared latent space. 🧵👇
0:43

We introduce W.A.L.T, a diffusion model for photorealistic video generation. Our model is a transformer trained on image and video generation in a shared latent space. 🧵👇

Agrim Gupta

431,358 просмотров • 2 лет назад

AnyFlow Any-Step Video Diffusion Model with On-Policy Flow Map Distillation
1:17

AnyFlow Any-Step Video Diffusion Model with On-Policy Flow Map Distillation

AK

14,152 просмотров • 5 месяцев назад

Video diffusion models generate high-quality videos but are too slow for interactive applications. We MIT CSAIL Adobe Research introduce CausVid, a fast autoregressive video diffusion model that starts playing the moment you hit "Generate"! A thread 🧵
0:31

Video diffusion models generate high-quality videos but are too slow for interactive applications. We MIT CSAIL Adobe Research introduce CausVid, a fast autoregressive video diffusion model that starts playing the moment you hit "Generate"! A thread 🧵

Tianwei Yin

84,074 просмотров • 1 год назад

damn,.... this is so incredibly cool use case for discrete diffusion model
0:41

damn,.... this is so incredibly cool use case for discrete diffusion model

Simo Ryu

2,558,114 просмотров • 1 год назад

📢Excited to be at #ICLR2025 for our paper: VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Poster: Thu 3-5:30 PM (#134) Website: Code: Also check out our #CVPR2025 follow-up AC3D:
0:29

📢Excited to be at #ICLR2025 for our paper: VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Poster: Thu 3-5:30 PM (#134) Website: Code: Also check out our #CVPR2025 follow-up AC3D:

Sherwin Bahmani

11,643 просмотров • 1 год назад

Today, we are releasing Stable Video Diffusion, our first foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:
0:20

Today, we are releasing Stable Video Diffusion, our first foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:

Stability AI

1,024,881 просмотров • 2 лет назад

🔥Diffusion Masters Transparent Objects in Videos! We introduce #DKT, a foundation model that repurposes video diffusion for zero-shot depth and normal estimation on Transparent and Reflective Objects with Superior Temporal Consistency Demo: Code:
0:57

🔥Diffusion Masters Transparent Objects in Videos! We introduce #DKT, a foundation model that repurposes video diffusion for zero-shot depth and normal estimation on Transparent and Reflective Objects with Superior Temporal Consistency Demo: Code:

Chongjie Ye

28,181 просмотров • 10 месяцев назад

Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion abs: project page:
1:22

Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion abs: project page:

AK

263,035 просмотров • 3 лет назад