Loading video...

Video Failed to Load

Go Home

"Cameras as Relative Positional Encoding" TLDR: comparison for conditioning transformers on cameras: token-level raymap, attention-level relative pose encodings, a (new) relative encoding Projective Positional Encoding -> camera frustums, (int|ext)insics for relative pos encoding

Almorgand's profile picture

Alexandre Morgand

2,302 subscribers

17,837 views • 1 year ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

3 Comments

Alexandre Morgand's profile picture
Alexandre Morgand1 year ago

1,2*, @brenthyi 1*, @JunchenLiu77 1*, @hangg70 1, @YiMaTweets 1,3, @akanazawa 1 ( *Equal contribution ) 1 @UCBerkeley 2 @nvidia 3 @HKUniversity Project page: Paper: Source code:

Ruilong Li's profile picture
Ruilong Li1 year ago

thanks for sharing!

Alexandre Morgand's profile picture
Alexandre Morgand1 year ago

Anytime!

Related Videos

SCoPE Sightline-Coordinate Positional Encoding for Video Diffusion Transformers model:
2:00

SCoPE Sightline-Coordinate Positional Encoding for Video Diffusion Transformers model:

AK

24,274 views • 2 months ago

I spent months illustrating how Transformers actually work. Not just what they do, but why they’re built this way. The history, design choices, and intuition behind every layer. From RNNs → Attention → Multi-Head → FFNs → Positional Encoding. Here's everything I wish I knew:
1:16

I spent months illustrating how Transformers actually work. Not just what they do, but why they’re built this way. The history, design choices, and intuition behind every layer. From RNNs → Attention → Multi-Head → FFNs → Positional Encoding. Here's everything I wish I knew:

krupa

251,821 views • 1 year ago

Announcing: a new interactive tool for a quick and simple start of encoding or encoding: 🧠 fMRI, EEG, MEG, iEEG, spikes… preprocessing 💬 text 🔊 audio ▶️ video 🏞️ image… embeddings 📦 pip install neuralset 🔍 #NeuroAI #OpenSource
0:28

Announcing: a new interactive tool for a quick and simple start of encoding or encoding: 🧠 fMRI, EEG, MEG, iEEG, spikes… preprocessing 💬 text 🔊 audio ▶️ video 🏞️ image… embeddings 📦 pip install neuralset 🔍 #NeuroAI #OpenSource

Jean-Rémi King

10,745 views • 5 months ago

How to use Burp Suite's "Decoder" for URL-encoding. (plus a much easier way to do it)
0:28

How to use Burp Suite's "Decoder" for URL-encoding. (plus a much easier way to do it)

Web Security Academy

31,375 views • 1 year ago

Burp Suite's "Decoder" is great for URL encoding - but there is a much faster way to do it!
0:28

Burp Suite's "Decoder" is great for URL encoding - but there is a much faster way to do it!

Web Security Academy

23,262 views • 6 months ago

"Catherine Cherono is a relative of William Ruto" ~ Riggy G Gachagua reveals that NTSA fines from the Highway cameras are being paid to a Kalenjin woman in the name of Catherine Jerono, a family relative of William Ruto.
1:03

"Catherine Cherono is a relative of William Ruto" ~ Riggy G Gachagua reveals that NTSA fines from the Highway cameras are being paid to a Kalenjin woman in the name of Catherine Jerono, a family relative of William Ruto.

Murage Ngunjiri

151,475 views • 4 months ago

The teaser video for our latest Science Robotics paper. Full video will be out soon. Paper: Attention-based map encoding for learning generalized legged locomotion Link:
0:54

The teaser video for our latest Science Robotics paper. Full video will be out soon. Paper: Attention-based map encoding for learning generalized legged locomotion Link:

Junzhe (JJ) He

14,760 views • 1 year ago

Buy relative strength on weakness
3:03

Buy relative strength on weakness

Sean trades

37,549 views • 6 months ago

Best Tradingview Indicator for Swing Trading _ Relative Strength
10:25

Best Tradingview Indicator for Swing Trading _ Relative Strength

JayneshKasliwal

26,560 views • 1 year ago

mouse relative smooth zoom, mouse dragging, and... crazy camera rotation.
0:50

mouse relative smooth zoom, mouse dragging, and... crazy camera rotation.

Bananaft

25,650 views • 1 month ago

GB Interceptor v1.2.0 is out now! - MJPEG encoding - Full MacOS support - 60fps mode (almost the same as the last beta)
0:52

GB Interceptor v1.2.0 is out now! - MJPEG encoding - Full MacOS support - 60fps mode (almost the same as the last beta)

Sebastian Staacks

74,659 views • 3 years ago

DATA AVAILABILITY SAMPLING EXPLAINED! learn about -Modular Blockchains -probabilistic sampling techniques -Erasure Encoding Full vid below👇
0:44

DATA AVAILABILITY SAMPLING EXPLAINED! learn about -Modular Blockchains -probabilistic sampling techniques -Erasure Encoding Full vid below👇

gogoDiego

93,143 views • 2 years ago

Reminded me of our older NeurIPS 2021 paper where we removed the positional encoding entirely, and by doing so, an agent can process an arbitrarily long list of noisy, sensory inputs, in an arbitrary order. I even made a fun browser demo to play with it:
0:52

Reminded me of our older NeurIPS 2021 paper where we removed the positional encoding entirely, and by doing so, an agent can process an arbitrarily long list of noisy, sensory inputs, in an arbitrary order. I even made a fun browser demo to play with it:

hardmaru

23,625 views • 9 months ago

How to buy relative strength on weakness
7:15

How to buy relative strength on weakness

Sean trades

28,338 views • 5 months ago

Everyone has this relative
1:33

Everyone has this relative

Bryan Andrews

103,802 views • 6 months ago

Miss him like a dead relative
1:22

Miss him like a dead relative

Mariah

422,377 views • 3 months ago

Interloper's long lost relative
0:39

Interloper's long lost relative

Otto

16,306 views • 9 days ago