Video yükleniyor...
Video Yüklenemedi
opensource community while discovering ssms work better than transformers Soon you may not even need gpus for long context portable ai.
289,020 görüntüleme • 2 yıl önce •via X (Twitter)
9 Yorum

nisten - e/acc2 yıl önce
As far as I’ve heard from openai folk they’re “looking into it”. So this is new to them too. No one knows how well it’ll perform at scale, but a 0.79B and 2.9B model trained on just 300m tokens (because of being gpupoor) coming within ballpark of llama7B is pretty cray cray.

nisten - e/acc2 yıl önce
If anyone has spare compute to donate the skunkworks kitchen is ready to outcook openai with it just saying

The Highly Automated Cat — e/acc ⏩2 yıl önce
sexting sms?

nisten - e/acc2 yıl önce
structured state space models

𝔠ɣ𝔟ε𝓇 𝕙ιε𝕣øթ𝕙𐊀ητ //daniel//2 yıl önce
Is the tech legit? Transformer-killers have flopped (get it?) in the past…

nisten - e/acc2 yıl önce
@ddaughertytech lk99 moment

murat 🍥2 yıl önce
wow the deepfates program has really grown

Jamison 🏕️☃️2 yıl önce
banger song

Tyr2 yıl önce
Whatd I miss?

