Loading video...

Video Failed to Load

Go Home

With Gemini diffusion you can 'vibe code' so fast that it feels almost instant:

36,513 views • 1 year ago •via X (Twitter)

5 Comments

Brendan O'Donoghue's profile picture
Brendan O'Donoghue1 year ago

Excited to share what my team has been working on lately - Gemini diffusion! We bring diffusion to language modeling, yielding more power and blazing speeds! 🚀🚀🚀 Gemini diffusion is especially strong at coding. In this example the model generates at 2000 tokens/sec, including overheads like tokenization, prefill, safety filters etc.

Brendan O'Donoghue's profile picture
Brendan O'Donoghue1 year ago

Lightning speeds are not the only advantage. Unlike autoregressive models that are restricted to generating one token at a time, diffusion can do non-causal reasoning within the generation. Take this example: "What is (√(81) * (2/3))^2 + (15 - 3) / (2^2)). First provide the answer and then derive the solution." This is a very hard prompt for AR models because they can't reason about the solution before generating it, but diffusion models can reason non-causally to get it right (ans: 39). GPT-4o fails this problem:

Brendan O'Donoghue's profile picture
Brendan O'Donoghue1 year ago

A similar one inspired by the 'Sparks of AGI paper' by @SebastienBubeck et al: "How many primes are there between 150 and 250? The first thing you should output is the total number, then print the exact list inside [ ] brackets." (ans: 18) GPT-4o fails this one too:

Brendan O'Donoghue's profile picture
Brendan O'Donoghue1 year ago

For more details, and to get access, see here:

Sterling Cooley's profile picture
Sterling Cooley1 year ago

Hey! I wanted to make sure you saw we're doing a Live Webinar for the Ultra Skool Learn how to use Ultrasound Vagus Nerve Stimulation - people are having absolutely WILD experiences on this

Related Videos