Loading video...

Video Failed to Load

Go Home

Epona Autoregressive Diffusion World Model for Autonomous Driving

_akhaliq's profile picture

AK

463,800 subscribers

18,839 views • 11 months ago •via X (Twitter)

Science & TechnologyNews & Politics
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

DiffusionDrive Truncated Diffusion Model for End-to-End Autonomous Driving
0:50

DiffusionDrive Truncated Diffusion Model for End-to-End Autonomous Driving

AK

17,797 views • 1 year ago

Block Diffusion Interpolating Between Autoregressive and Diffusion Language Models
0:23

Block Diffusion Interpolating Between Autoregressive and Diffusion Language Models

AK

160,553 views • 1 year ago

MotionStreamer announced on Hugging Face Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Space
0:40

MotionStreamer announced on Hugging Face Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Space

AK

43,387 views • 1 year ago

🪄 Magi-1: The Autoregressive Diffusion Video Generation Model - Now available at 🥇 The first autoregressive video model with top-tier quality output 🔓 100% open-source & tech report 📊 Exceptional performance on major benchmarks ⏳ 1/5
1:38

🪄 Magi-1: The Autoregressive Diffusion Video Generation Model - Now available at 🥇 The first autoregressive video model with top-tier quality output 🔓 100% open-source & tech report 📊 Exceptional performance on major benchmarks ⏳ 1/5

Sand.ai

914,198 views • 1 year ago

MinerU-Diffusion A 2.5B diffusion-based OCR model that replaces slow autoregressive decoding with parallel block-wise diffusion, achieving up to 3.2x faster inference while improving robustness on complex documents with tables, formulas, and layouts.
0:22

MinerU-Diffusion A 2.5B diffusion-based OCR model that replaces slow autoregressive decoding with parallel block-wise diffusion, achieving up to 3.2x faster inference while improving robustness on complex documents with tables, formulas, and layouts.

DailyPapers

15,304 views • 3 months ago

Rolling Forcing Autoregressive Long Video Diffusion in Real Time
2:00

Rolling Forcing Autoregressive Long Video Diffusion in Real Time

AK

30,507 views • 9 months ago

We're moving beyond autoregressive LLMs! Autoregressive LLMs generate text word-by-word, which can be slow and affect quality, while diffusion models refine noise step-by-step, allowing for faster iterations and error correction. Here's Gemini Diffusion running at 857 tokens/s:
0:40

We're moving beyond autoregressive LLMs! Autoregressive LLMs generate text word-by-word, which can be slow and affect quality, while diffusion models refine noise step-by-step, allowing for faster iterations and error correction. Here's Gemini Diffusion running at 857 tokens/s:

Akshay 🚀

34,524 views • 1 year ago

Pay very close attention to what the NIO World Model can do, this is next level autonomous driving experience. $NIO
2:41

Pay very close attention to what the NIO World Model can do, this is next level autonomous driving experience. $NIO

Jason

23,650 views • 9 months ago

SongBloom Coherent Song Generation via Interleaved Autoregressive Sketching and Diffusion Refinement
2:07

SongBloom Coherent Song Generation via Interleaved Autoregressive Sketching and Diffusion Refinement

AK

28,118 views • 1 year ago

XPENG is thrilled to introduce X-World, our controllable multi-view generative world model powered by video diffusion technology. Pushing the boundaries of smart mobility, X-World delivers real-time response and continuous multi-view generation to simulate complex driving environments. Xianming Liu, Head of XPENG’s General AI Center, emphasizes: "Beyond generation, X-World serves as the scalable infrastructure critical for training and validating the next leap in autonomous driving." $XPEV
1:36

XPENG is thrilled to introduce X-World, our controllable multi-view generative world model powered by video diffusion technology. Pushing the boundaries of smart mobility, X-World delivers real-time response and continuous multi-view generation to simulate complex driving environments. Xianming Liu, Head of XPENG’s General AI Center, emphasizes: "Beyond generation, X-World serves as the scalable infrastructure critical for training and validating the next leap in autonomous driving." $XPEV

XPENG

4,070,681 views • 3 months ago

🚨ELON: FULLY AUTONOMOUS DRIVING IN TEXAS AND CALIFORNIA BY NEXT YEAR "We expect to start fully autonomous, unsupervised full self-driving (FSD) in Texas and California next year with the Model 3 and Model Y. As for the CyberCab, which is highly optimized for autonomous transport, we expect it to be in production by 2026—well, before 2027." Source: Tesla
0:44

🚨ELON: FULLY AUTONOMOUS DRIVING IN TEXAS AND CALIFORNIA BY NEXT YEAR "We expect to start fully autonomous, unsupervised full self-driving (FSD) in Texas and California next year with the Model 3 and Model Y. As for the CyberCab, which is highly optimized for autonomous transport, we expect it to be in production by 2026—well, before 2027." Source: Tesla

Mario Nawfal

211,268 views • 1 year ago

This is a new diffusion-based language model from Inception. I don't know how well it works compared to an autoregressive LM of a similar size, but the inference process looks badass:
0:29

This is a new diffusion-based language model from Inception. I don't know how well it works compared to an autoregressive LM of a similar size, but the inference process looks badass:

BURKOV

58,434 views • 1 year ago

🚀 We’re excited to announce LingBot-VA, a new state-of-the-art robot policy model from Robbyant ! LingBot-VA is built on a causal, autoregressive video-action world model for generalist robot control. Highlights: (1) First unified autoregressive video-action world model for robot control (2) Low-latency inference with a new asynchronous execution pipeline (3) SOTA on RoboTwin (92.9%, firstever > 90%) and LIBERO (98.5%) (4) +20% over π0.5 on challenging real-world long-horizon & high-precision tasks
1:51

🚀 We’re excited to announce LingBot-VA, a new state-of-the-art robot policy model from Robbyant ! LingBot-VA is built on a causal, autoregressive video-action world model for generalist robot control. Highlights: (1) First unified autoregressive video-action world model for robot control (2) Low-latency inference with a new asynchronous execution pipeline (3) SOTA on RoboTwin (92.9%, firstever > 90%) and LIBERO (98.5%) (4) +20% over π0.5 on challenging real-world long-horizon & high-precision tasks

Yinghao Xu

46,962 views • 5 months ago

Stable Diffusion generates beautiful images, but can it be used for open-world recognition? Try Demo! Our #CVPR2023 paper shows that the pre-trained diffusion model indeed is a good image parser, allows for open-vocabulary segmentation and detection.
2:19

Stable Diffusion generates beautiful images, but can it be used for open-world recognition? Try Demo! Our #CVPR2023 paper shows that the pre-trained diffusion model indeed is a good image parser, allows for open-vocabulary segmentation and detection.

Xiaolong Wang

241,225 views • 3 years ago

Super excited to introduce Pandora, a generative video World Model interactively controllable by language. #Sora and #GPT4 are both powerful. How about fusing them in a single model? 💥 Pandora gives a preview:🔭 > Build a General World Model (GWM) super efficiently by integrating pretrained autoregressive LLM and diffusion Video Model, aligning them in the representation space. > Let the LLM control the VM on-the-fly. Instruction tuning maximizes the controllability. > Autoregressive LLM empowers VM to generate indefinitely long videos: Starting with a VM for 2-second videos, Pandora extends it for 8-second videos. Would #Sora+#GPT4 under Pandora produce hours-long videos? 📽️ > World Model is beyond just video generation. It’s sensory-level information processing + concept-level reasoning and reflection. Pandora bridges both, with the concept- / language-level backbone (LLM) managing & steering the sensory-level VM functionalities. 👁️🧠 Check out for a bunch of interesting results:
1:35

Super excited to introduce Pandora, a generative video World Model interactively controllable by language. #Sora and #GPT4 are both powerful. How about fusing them in a single model? 💥 Pandora gives a preview:🔭 > Build a General World Model (GWM) super efficiently by integrating pretrained autoregressive LLM and diffusion Video Model, aligning them in the representation space. > Let the LLM control the VM on-the-fly. Instruction tuning maximizes the controllability. > Autoregressive LLM empowers VM to generate indefinitely long videos: Starting with a VM for 2-second videos, Pandora extends it for 8-second videos. Would #Sora+#GPT4 under Pandora produce hours-long videos? 📽️ > World Model is beyond just video generation. It’s sensory-level information processing + concept-level reasoning and reflection. Pandora bridges both, with the concept- / language-level backbone (LLM) managing & steering the sensory-level VM functionalities. 👁️🧠 Check out for a bunch of interesting results:

Zhiting Hu

63,456 views • 2 years ago

DeepFires Autonomous Launcher Raytheon 🇺🇸 Fully autonomous capabilities - for driving - firing - and resupply reducing soldier exposure in high-risk zones.
1:06

DeepFires Autonomous Launcher Raytheon 🇺🇸 Fully autonomous capabilities - for driving - firing - and resupply reducing soldier exposure in high-risk zones.

DefenseTrends

43,960 views • 5 months ago

A heavy truck starts moving--without anyone driving it. In Xi'an, autonomous trucking is entering real-world operations.
1:34

A heavy truck starts moving--without anyone driving it. In Xi'an, autonomous trucking is entering real-world operations.

China Xinhua News

15,433 views • 14 days ago

Comedians preparing the public for autonomous vehicles: “I’m so excited for self-driving cars…”
1:31

Comedians preparing the public for autonomous vehicles: “I’m so excited for self-driving cars…”

Cern Basher

729,189 views • 3 months ago

And you thought autonomous driving won’t be possible in India ? Here is classic indian driving in Bhopal by autonomous vehicle.
2:18

And you thought autonomous driving won’t be possible in India ? Here is classic indian driving in Bhopal by autonomous vehicle.

Vijay Shekhar Sharma

202,113 views • 4 months ago

RTFM can be seen as a learned renderer: it is an autoregressive diffusion transformer trained end-to-end on large-scale video data, and it learns to model 3D geometry, reflections, shadows and more just by observing them in its training set.
0:24

RTFM can be seen as a learned renderer: it is an autoregressive diffusion transformer trained end-to-end on large-scale video data, and it learns to model 3D geometry, reflections, shadows and more just by observing them in its training set.

World Labs

15,870 views • 8 months ago