Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

opensource community while discovering ssms work better than transformers Soon you may not even need gpus for long context portable ai.

289,020 Aufrufe • vor 2 Jahren •via X (Twitter)

9 Kommentare

Profilbild von nisten - e/acc
nisten - e/accvor 2 Jahren

As far as I’ve heard from openai folk they’re “looking into it”. So this is new to them too. No one knows how well it’ll perform at scale, but a 0.79B and 2.9B model trained on just 300m tokens (because of being gpupoor) coming within ballpark of llama7B is pretty cray cray.

Profilbild von nisten - e/acc
nisten - e/accvor 2 Jahren

If anyone has spare compute to donate the skunkworks kitchen is ready to outcook openai with it just saying

Profilbild von The Highly Automated Cat — e/acc ⏩
The Highly Automated Cat — e/acc ⏩vor 2 Jahren

sexting sms?

Profilbild von nisten - e/acc
nisten - e/accvor 2 Jahren

structured state space models

Profilbild von 𝔠ɣ𝔟ε𝓇 𝕙ιε𝕣øթ𝕙𐊀ητ //daniel//
𝔠ɣ𝔟ε𝓇 𝕙ιε𝕣øթ𝕙𐊀ητ //daniel//vor 2 Jahren

Is the tech legit? Transformer-killers have flopped (get it?) in the past…

Profilbild von nisten - e/acc
nisten - e/accvor 2 Jahren

@ddaughertytech lk99 moment

Profilbild von murat 🍥
murat 🍥vor 2 Jahren

wow the deepfates program has really grown

Profilbild von Jamison 🏕️☃️
Jamison 🏕️☃️vor 2 Jahren

banger song

Profilbild von Tyr
Tyrvor 2 Jahren

Whatd I miss?

Ähnliche Videos