正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Epona Autoregressive Diffusion World Model for Autonomous Driving

AK

463,800 subscribers

18,839 次观看 • 11 个月前 •via X (Twitter)

科学技术新闻政治

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Block Diffusion Interpolating Between Autoregressive and Diffusion Language Models

Block Diffusion Interpolating Between Autoregressive and Diffusion Language Models

AK

160,553 次观看 • 1 年前

MotionStreamer announced on Hugging Face Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Space

MotionStreamer announced on Hugging Face Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Space

AK

43,415 次观看 • 1 年前

🪄 Magi-1: The Autoregressive Diffusion Video Generation Model - Now available at 🥇 The first autoregressive video model with top-tier quality output 🔓 100% open-source & tech report 📊 Exceptional performance on major benchmarks ⏳ 1/5

🪄 Magi-1: The Autoregressive Diffusion Video Generation Model - Now available at 🥇 The first autoregressive video model with top-tier quality output 🔓 100% open-source & tech report 📊 Exceptional performance on major benchmarks ⏳ 1/5

Sand.ai

914,198 次观看 • 1 年前

MinerU-Diffusion A 2.5B diffusion-based OCR model that replaces slow autoregressive decoding with parallel block-wise diffusion, achieving up to 3.2x faster inference while improving robustness on complex documents with tables, formulas, and layouts.

MinerU-Diffusion A 2.5B diffusion-based OCR model that replaces slow autoregressive decoding with parallel block-wise diffusion, achieving up to 3.2x faster inference while improving robustness on complex documents with tables, formulas, and layouts.

DailyPapers

15,304 次观看 • 3 个月前

Rolling Forcing Autoregressive Long Video Diffusion in Real Time

Rolling Forcing Autoregressive Long Video Diffusion in Real Time

AK

30,507 次观看 • 9 个月前

We're moving beyond autoregressive LLMs! Autoregressive LLMs generate text word-by-word, which can be slow and affect quality, while diffusion models refine noise step-by-step, allowing for faster iterations and error correction. Here's Gemini Diffusion running at 857 tokens/s:

We're moving beyond autoregressive LLMs! Autoregressive LLMs generate text word-by-word, which can be slow and affect quality, while diffusion models refine noise step-by-step, allowing for faster iterations and error correction. Here's Gemini Diffusion running at 857 tokens/s:

Akshay 🚀

34,524 次观看 • 1 年前

Pay very close attention to what the NIO World Model can do, this is next level autonomous driving experience. $NIO

Pay very close attention to what the NIO World Model can do, this is next level autonomous driving experience. $NIO

Jason

23,650 次观看 • 9 个月前

SongBloom Coherent Song Generation via Interleaved Autoregressive Sketching and Diffusion Refinement

SongBloom Coherent Song Generation via Interleaved Autoregressive Sketching and Diffusion Refinement

AK

28,118 次观看 • 1 年前

XPENG is thrilled to introduce X-World, our controllable multi-view generative world model powered by video diffusion technology. Pushing the boundaries of smart mobility, X-World delivers real-time response and continuous multi-view generation to simulate complex driving environments. Xianming Liu, Head of XPENG’s General AI Center, emphasizes: "Beyond generation, X-World serves as the scalable infrastructure critical for training and validating the next leap in autonomous driving." $XPEV

XPENG is thrilled to introduce X-World, our controllable multi-view generative world model powered by video diffusion technology. Pushing the boundaries of smart mobility, X-World delivers real-time response and continuous multi-view generation to simulate complex driving environments. Xianming Liu, Head of XPENG’s General AI Center, emphasizes: "Beyond generation, X-World serves as the scalable infrastructure critical for training and validating the next leap in autonomous driving." $XPEV

XPENG

4,070,681 次观看 • 3 个月前

This is a new diffusion-based language model from Inception. I don't know how well it works compared to an autoregressive LM of a similar size, but the inference process looks badass:

This is a new diffusion-based language model from Inception. I don't know how well it works compared to an autoregressive LM of a similar size, but the inference process looks badass:

BURKOV

58,434 次观看 • 1 年前

🚀 We’re excited to announce LingBot-VA, a new state-of-the-art robot policy model from Robbyant ! LingBot-VA is built on a causal, autoregressive video-action world model for generalist robot control. Highlights: (1) First unified autoregressive video-action world model for robot control (2) Low-latency inference with a new asynchronous execution pipeline (3) SOTA on RoboTwin (92.9%, firstever > 90%) and LIBERO (98.5%) (4) +20% over π0.5 on challenging real-world long-horizon & high-precision tasks

🚀 We’re excited to announce LingBot-VA, a new state-of-the-art robot policy model from Robbyant ! LingBot-VA is built on a causal, autoregressive video-action world model for generalist robot control. Highlights: (1) First unified autoregressive video-action world model for robot control (2) Low-latency inference with a new asynchronous execution pipeline (3) SOTA on RoboTwin (92.9%, firstever > 90%) and LIBERO (98.5%) (4) +20% over π0.5 on challenging real-world long-horizon & high-precision tasks

Yinghao Xu

46,962 次观看 • 5 个月前

Stable Diffusion generates beautiful images, but can it be used for open-world recognition? Try Demo! Our #CVPR2023 paper shows that the pre-trained diffusion model indeed is a good image parser, allows for open-vocabulary segmentation and detection.

Stable Diffusion generates beautiful images, but can it be used for open-world recognition? Try Demo! Our #CVPR2023 paper shows that the pre-trained diffusion model indeed is a good image parser, allows for open-vocabulary segmentation and detection.

Xiaolong Wang

241,225 次观看 • 3 年前

Super excited to introduce Pandora, a generative video World Model interactively controllable by language. #Sora and #GPT4 are both powerful. How about fusing them in a single model? 💥 Pandora gives a preview:🔭 > Build a General World Model (GWM) super efficiently by integrating pretrained autoregressive LLM and diffusion Video Model, aligning them in the representation space. > Let the LLM control the VM on-the-fly. Instruction tuning maximizes the controllability. > Autoregressive LLM empowers VM to generate indefinitely long videos: Starting with a VM for 2-second videos, Pandora extends it for 8-second videos. Would #Sora+#GPT4 under Pandora produce hours-long videos? 📽️ > World Model is beyond just video generation. It’s sensory-level information processing + concept-level reasoning and reflection. Pandora bridges both, with the concept- / language-level backbone (LLM) managing & steering the sensory-level VM functionalities. 👁️🧠 Check out for a bunch of interesting results:

Super excited to introduce Pandora, a generative video World Model interactively controllable by language. #Sora and #GPT4 are both powerful. How about fusing them in a single model? 💥 Pandora gives a preview:🔭 > Build a General World Model (GWM) super efficiently by integrating pretrained autoregressive LLM and diffusion Video Model, aligning them in the representation space. > Let the LLM control the VM on-the-fly. Instruction tuning maximizes the controllability. > Autoregressive LLM empowers VM to generate indefinitely long videos: Starting with a VM for 2-second videos, Pandora extends it for 8-second videos. Would #Sora+#GPT4 under Pandora produce hours-long videos? 📽️ > World Model is beyond just video generation. It’s sensory-level information processing + concept-level reasoning and reflection. Pandora bridges both, with the concept- / language-level backbone (LLM) managing & steering the sensory-level VM functionalities. 👁️🧠 Check out for a bunch of interesting results:

Zhiting Hu

63,456 次观看 • 2 年前

DeepFires Autonomous Launcher Raytheon 🇺🇸 Fully autonomous capabilities - for driving - firing - and resupply reducing soldier exposure in high-risk zones.

DeepFires Autonomous Launcher Raytheon 🇺🇸 Fully autonomous capabilities - for driving - firing - and resupply reducing soldier exposure in high-risk zones.

DefenseTrends

43,960 次观看 • 5 个月前

A heavy truck starts moving--without anyone driving it. In Xi'an, autonomous trucking is entering real-world operations.

A heavy truck starts moving--without anyone driving it. In Xi'an, autonomous trucking is entering real-world operations.

China Xinhua News

15,433 次观看 • 17 天前

Comedians preparing the public for autonomous vehicles: “I’m so excited for self-driving cars…”

Comedians preparing the public for autonomous vehicles: “I’m so excited for self-driving cars…”

Cern Basher

729,392 次观看 • 3 个月前

And you thought autonomous driving won’t be possible in India ? Here is classic indian driving in Bhopal by autonomous vehicle.

And you thought autonomous driving won’t be possible in India ? Here is classic indian driving in Bhopal by autonomous vehicle.

Vijay Shekhar Sharma

202,113 次观看 • 4 个月前

RTFM can be seen as a learned renderer: it is an autoregressive diffusion transformer trained end-to-end on large-scale video data, and it learns to model 3D geometry, reflections, shadows and more just by observing them in its training set.

RTFM can be seen as a learned renderer: it is an autoregressive diffusion transformer trained end-to-end on large-scale video data, and it learns to model 3D geometry, reflections, shadows and more just by observing them in its training set.

World Labs

15,870 次观看 • 8 个月前