Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

SCoPE Sightline-Coordinate Positional Encoding for Video Diffusion Transformers model:

_akhaliq's profile picture

AK

530,834 subscribers

24,274 Aufrufe • vor 2 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

5 Kommentare

Profilbild von Jane Austen
Jane Austenvor 2 Monaten

SCoPE looks really interesting for video diffusion. Better positional encoding could make a big difference in how models handle motion and spatial consistency across longer video sequences. Definitely one to watch. 🔥

Profilbild von César Bonilla
César Bonillavor 2 Monaten

Mamma mia

Profilbild von Michael Yin
Michael Yinvor 2 Monaten

Thanks for sharing SCoPE! The interactive demo is now live with few-step inference. Huggingface Space: TencentARC/scope-camera-video-generation

Profilbild von HU Wenbo
HU Wenbovor 2 Monaten

Thx for sharing Code and weights are up, Apache-2.0:

Profilbild von dhinna ship .ico
dhinna ship .icovor 2 Monaten

Does SCoPE's coordinate scheme reduce drift on clips longer than 16 frames?

Ähnliche Videos

"Cameras as Relative Positional Encoding" TLDR: comparison for conditioning transformers on cameras: token-level raymap, attention-level relative pose encodings, a (new) relative encoding Projective Positional Encoding -> camera frustums, (int|ext)insics for relative pos encoding
0:30

"Cameras as Relative Positional Encoding" TLDR: comparison for conditioning transformers on cameras: token-level raymap, attention-level relative pose encodings, a (new) relative encoding Projective Positional Encoding -> camera frustums, (int|ext)insics for relative pos encoding

Alexandre Morgand

17,837 Aufrufe • vor 1 Jahr

Meta presents Adaptive Caching for Faster Video Generation with Diffusion Transformers
0:50

Meta presents Adaptive Caching for Faster Video Generation with Diffusion Transformers

AK

53,129 Aufrufe • vor 1 Jahr

I spent months illustrating how Transformers actually work. Not just what they do, but why they’re built this way. The history, design choices, and intuition behind every layer. From RNNs → Attention → Multi-Head → FFNs → Positional Encoding. Here's everything I wish I knew:
1:16

I spent months illustrating how Transformers actually work. Not just what they do, but why they’re built this way. The history, design choices, and intuition behind every layer. From RNNs → Attention → Multi-Head → FFNs → Positional Encoding. Here's everything I wish I knew:

krupa

251,821 Aufrufe • vor 1 Jahr

📢📢📢 𝐀𝐂𝟑𝐃: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers TL;DR: for 3D camera control in generative video, it really helps knowing *which* part of your model you should mess with Internship by Sherwin Bahmani at Snap
0:40

📢📢📢 𝐀𝐂𝟑𝐃: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers TL;DR: for 3D camera control in generative video, it really helps knowing *which* part of your model you should mess with Internship by Sherwin Bahmani at Snap

Andrea Tagliasacchi

23,088 Aufrufe • vor 1 Jahr

FasterCache Training-Free Video Diffusion Model Acceleration with High Quality
1:10

FasterCache Training-Free Video Diffusion Model Acceleration with High Quality

AK

91,309 Aufrufe • vor 2 Jahren

Epona Autoregressive Diffusion World Model for Autonomous Driving
0:32

Epona Autoregressive Diffusion World Model for Autonomous Driving

AK

18,839 Aufrufe • vor 1 Jahr

A new frontier. Project Starlight—the first and only diffusion-based AI model for enhancing video. Launching soon.
0:22

A new frontier. Project Starlight—the first and only diffusion-based AI model for enhancing video. Launching soon.

Topaz Labs

22,375 Aufrufe • vor 1 Jahr

We introduce W.A.L.T, a diffusion model for photorealistic video generation. Our model is a transformer trained on image and video generation in a shared latent space. 🧵👇
0:43

We introduce W.A.L.T, a diffusion model for photorealistic video generation. Our model is a transformer trained on image and video generation in a shared latent space. 🧵👇

Agrim Gupta

431,358 Aufrufe • vor 2 Jahren

AnyFlow Any-Step Video Diffusion Model with On-Policy Flow Map Distillation
1:17

AnyFlow Any-Step Video Diffusion Model with On-Policy Flow Map Distillation

AK

14,152 Aufrufe • vor 5 Monaten

Video diffusion models generate high-quality videos but are too slow for interactive applications. We MIT CSAIL Adobe Research introduce CausVid, a fast autoregressive video diffusion model that starts playing the moment you hit "Generate"! A thread 🧵
0:31

Video diffusion models generate high-quality videos but are too slow for interactive applications. We MIT CSAIL Adobe Research introduce CausVid, a fast autoregressive video diffusion model that starts playing the moment you hit "Generate"! A thread 🧵

Tianwei Yin

84,074 Aufrufe • vor 1 Jahr

damn,.... this is so incredibly cool use case for discrete diffusion model
0:41

damn,.... this is so incredibly cool use case for discrete diffusion model

Simo Ryu

2,558,114 Aufrufe • vor 1 Jahr

📢Excited to be at #ICLR2025 for our paper: VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Poster: Thu 3-5:30 PM (#134) Website: Code: Also check out our #CVPR2025 follow-up AC3D:
0:29

📢Excited to be at #ICLR2025 for our paper: VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Poster: Thu 3-5:30 PM (#134) Website: Code: Also check out our #CVPR2025 follow-up AC3D:

Sherwin Bahmani

11,643 Aufrufe • vor 1 Jahr

Today, we are releasing Stable Video Diffusion, our first foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:
0:20

Today, we are releasing Stable Video Diffusion, our first foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:

Stability AI

1,024,881 Aufrufe • vor 2 Jahren

🔥Diffusion Masters Transparent Objects in Videos! We introduce #DKT, a foundation model that repurposes video diffusion for zero-shot depth and normal estimation on Transparent and Reflective Objects with Superior Temporal Consistency Demo: Code:
0:57

🔥Diffusion Masters Transparent Objects in Videos! We introduce #DKT, a foundation model that repurposes video diffusion for zero-shot depth and normal estimation on Transparent and Reflective Objects with Superior Temporal Consistency Demo: Code:

Chongjie Ye

28,181 Aufrufe • vor 10 Monaten

Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion abs: project page:
1:22

Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion abs: project page:

AK

263,035 Aufrufe • vor 3 Jahren