Video wird geladen...
Video konnte nicht geladen werden
opensource community while discovering ssms work better than transformers Soon you may not even need gpus for long context portable ai.
289,020 Aufrufe • vor 2 Jahren •via X (Twitter)
9 Kommentare

nisten - e/accvor 2 Jahren
As far as I’ve heard from openai folk they’re “looking into it”. So this is new to them too. No one knows how well it’ll perform at scale, but a 0.79B and 2.9B model trained on just 300m tokens (because of being gpupoor) coming within ballpark of llama7B is pretty cray cray.

nisten - e/accvor 2 Jahren
If anyone has spare compute to donate the skunkworks kitchen is ready to outcook openai with it just saying

The Highly Automated Cat — e/acc ⏩vor 2 Jahren
sexting sms?

nisten - e/accvor 2 Jahren
structured state space models

𝔠ɣ𝔟ε𝓇 𝕙ιε𝕣øթ𝕙𐊀ητ //daniel//vor 2 Jahren
Is the tech legit? Transformer-killers have flopped (get it?) in the past…

nisten - e/accvor 2 Jahren
@ddaughertytech lk99 moment

murat 🍥vor 2 Jahren
wow the deepfates program has really grown

Jamison 🏕️☃️vor 2 Jahren
banger song

Tyrvor 2 Jahren
Whatd I miss?

