Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

With Gemini diffusion you can 'vibe code' so fast that it feels almost instant:

36,513 Aufrufe • vor 1 Jahr •via X (Twitter)

5 Kommentare

Profilbild von Brendan O'Donoghue
Brendan O'Donoghuevor 1 Jahr

Excited to share what my team has been working on lately - Gemini diffusion! We bring diffusion to language modeling, yielding more power and blazing speeds! 🚀🚀🚀 Gemini diffusion is especially strong at coding. In this example the model generates at 2000 tokens/sec, including overheads like tokenization, prefill, safety filters etc.

Profilbild von Brendan O'Donoghue
Brendan O'Donoghuevor 1 Jahr

Lightning speeds are not the only advantage. Unlike autoregressive models that are restricted to generating one token at a time, diffusion can do non-causal reasoning within the generation. Take this example: "What is (√(81) * (2/3))^2 + (15 - 3) / (2^2)). First provide the answer and then derive the solution." This is a very hard prompt for AR models because they can't reason about the solution before generating it, but diffusion models can reason non-causally to get it right (ans: 39). GPT-4o fails this problem:

Profilbild von Brendan O'Donoghue
Brendan O'Donoghuevor 1 Jahr

A similar one inspired by the 'Sparks of AGI paper' by @SebastienBubeck et al: "How many primes are there between 150 and 250? The first thing you should output is the total number, then print the exact list inside [ ] brackets." (ans: 18) GPT-4o fails this one too:

Profilbild von Brendan O'Donoghue
Brendan O'Donoghuevor 1 Jahr

For more details, and to get access, see here:

Profilbild von Sterling Cooley
Sterling Cooleyvor 1 Jahr

Hey! I wanted to make sure you saw we're doing a Live Webinar for the Ultra Skool Learn how to use Ultrasound Vagus Nerve Stimulation - people are having absolutely WILD experiences on this

Ähnliche Videos