正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

DMax Aggressive Parallel Decoding for dLLMs paper:

AK

514,034 subscribers

23,524 次观看 • 5 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

We are excited to introduce Mercury, the first commercial-grade diffusion large language model (dLLM)! dLLMs push the frontier of intelligence and speed with parallel, coarse-to-fine text generation.

We are excited to introduce Mercury, the first commercial-grade diffusion large language model (dLLM)! dLLMs push the frontier of intelligence and speed with parallel, coarse-to-fine text generation.

Inception

1,917,263 次观看 • 1 年前

In the Mean While #Soundariya In Parallel Universe Be like !! Same Answer For Two Different Question paper 😂😂 #BiggBossTamil8 #BiggBossSeason8Tamil #BiggBossSeason8Tamil

In the Mean While #Soundariya In Parallel Universe Be like !! Same Answer For Two Different Question paper 😂😂 #BiggBossTamil8 #BiggBossSeason8Tamil #BiggBossSeason8Tamil

Joe Michael Praveen

100,519 次观看 • 1 年前

Can $300 RTX3060 be faster than $10,000 A100 for LLM decoding?🧐Yes Introduce EAGLE-2: - 4.26x🚀vanilla (13B) - 1.4x🚀EAGLE (13B) - No extra training than EAGLE - Maintain distribution Paper: Code: Demo:

Can $300 RTX3060 be faster than $10,000 A100 for LLM decoding?🧐Yes Introduce EAGLE-2: - 4.26x🚀vanilla (13B) - 1.4x🚀EAGLE (13B) - No extra training than EAGLE - Maintain distribution Paper: Code: Demo:

Hongyang Zhang

35,696 次观看 • 2 年前

DECODING FOR "ARIRANG" LOCKED RECORDINGS ON SPOTIFY STARTED.. ( #BTS_ARIRANG #BTSxSpotify

DECODING FOR "ARIRANG" LOCKED RECORDINGS ON SPOTIFY STARTED.. ( #BTS_ARIRANG #BTSxSpotify

BTS Updates, News & Charts ⁷

116,299 次观看 • 5 个月前

Added context to my tiny diffusion model to enable sequential generation of longer outputs! Currently the context is a quarter of the sequence length (seq_len=256, context_len=64). I have a theory that the less semantic-value-per-token, the worse the “curse of parallel decoding” is. With parallel decoding, we independently predict multiple tokens in one step. With the sentence “My poker hand was a ___ ___”, two valid predictions are “two pair” and “straight flush”. Because each token prediction is independent though, we can end up with a nonsensical output like “two flush”. This seems to be exacerbated with low semantic-value-per-token, as now you need more tokens to express the same concept. Instead of needing to independently predict two tokens, we might need to predict 10 instead (which is of course much harder). The model currently has noticeably worse output compared to nanogpt (similar size) and I believe this is a main reason. I’ll try adding confidence-aware parallel decoding (from NVIDIA’s Fast-dLLM paper) and other tricks and see how much they improve generation quality.

Added context to my tiny diffusion model to enable sequential generation of longer outputs! Currently the context is a quarter of the sequence length (seq_len=256, context_len=64). I have a theory that the less semantic-value-per-token, the worse the “curse of parallel decoding” is. With parallel decoding, we independently predict multiple tokens in one step. With the sentence “My poker hand was a _ _”, two valid predictions are “two pair” and “straight flush”. Because each token prediction is independent though, we can end up with a nonsensical output like “two flush”. This seems to be exacerbated with low semantic-value-per-token, as now you need more tokens to express the same concept. Instead of needing to independently predict two tokens, we might need to predict 10 instead (which is of course much harder). The model currently has noticeably worse output compared to nanogpt (similar size) and I believe this is a main reason. I’ll try adding confidence-aware parallel decoding (from NVIDIA’s Fast-dLLM paper) and other tricks and see how much they improve generation quality.

Nathan Barry

89,040 次观看 • 10 个月前

Achieving 3,000 tokens/s with 16-parallel inference of Qwen3.6 35B-A3B NVFP4 on a single RTX PRO 6000 WorkStation Edition. I am using ParallelHue—a tool I am developing—to color-code the tokens generated simultaneously via speculative decoding.

Achieving 3,000 tokens/s with 16-parallel inference of Qwen3.6 35B-A3B NVFP4 on a single RTX PRO 6000 WorkStation Edition. I am using ParallelHue—a tool I am developing—to color-code the tokens generated simultaneously via speculative decoding.

Hikari∣LocalLLM⚡

27,434 次观看 • 1 个月前

Parallel Community Airdrop 🪂 All Parallel users will be eligible for an upcoming points airdrop! More details to be announced soon.

Parallel Community Airdrop 🪂 All Parallel users will be eligible for an upcoming points airdrop! More details to be announced soon.

Parallel

180,800 次观看 • 2 年前

BU meets Parallel Web Systems! We're collaborating with Parallel Web Systems for our web search on BU app! Read our blogpost! 👇

BU meets Parallel Web Systems! We're collaborating with Parallel Web Systems for our web search on BU app! Read our blogpost! 👇

Browser Use

12,237 次观看 • 7 个月前

Origami horse animated by Parallel Studio for Cheval Blanc hotels.

Origami horse animated by Parallel Studio for Cheval Blanc hotels.

Catsuka

53,486 次观看 • 7 个月前

Press 𝐘 for aggressive catch. 🎮 #STP

Press 𝐘 for aggressive catch. 🎮 #STP

Mizzou Football

66,311 次观看 • 3 年前

Aggressive protest in #Kota ! NEET aspirants and their parents held a protest against alleged irregularities & paper leak in #NEET-UG exam results in #Kota, Rajasthan, #NEET_परीक्षा_परिणाम Congress BJP #NEET_पेपर_रद्द_करो #RENEET

Aggressive protest in #Kota ! NEET aspirants and their parents held a protest against alleged irregularities & paper leak in #NEET-UG exam results in #Kota, Rajasthan, #NEET_परीक्षा_परिणाम Congress BJP #NEET_पेपर_रद्द_करो #RENEET

Indian Doctor🇮🇳

22,947 次观看 • 2 年前

Revised landing screen for Parallel mobile as per feedback. Cycles different factions. //

Revised landing screen for Parallel mobile as per feedback. Cycles different factions. //

//Kalos

19,055 次观看 • 5 个月前

New paper with Kenneth Stanley ! We built a scalable fluid engine for artificial life 🧬 Paper:

New paper with Kenneth Stanley ! We built a scalable fluid engine for artificial life 🧬 Paper:

Ciaran@ALIFE🇨🇦

40,926 次观看 • 2 个月前

Frog paper craft ideas for kids

Frog paper craft ideas for kids

Craft Gallery

34,378 次观看 • 9 天前

Paper Cup Bunny Craft for Kids

Paper Cup Bunny Craft for Kids

Craft Gallery

233,352 次观看 • 1 年前

Easy Craft for Kids- Paper Firework

Easy Craft for Kids- Paper Firework

Do It Yourself

38,377 次观看 • 3 年前

MMaDA-Parallel Multimodal Large Diffusion Language Models for Thinking-Aware Editing and Generation

MMaDA-Parallel Multimodal Large Diffusion Language Models for Thinking-Aware Editing and Generation

AK

66,158 次观看 • 9 个月前

there is an us the series parallel for everything DONT TOUCH DONT KISS #MoonshadowSeriesEP2

there is an us the series parallel for everything DONT TOUCH DONT KISS #MoonshadowSeriesEP2

rome

16,728 次观看 • 19 天前