正在加载视频...

视频加载失败

opensource community while discovering ssms work better than transformers Soon you may not even need gpus for long context portable ai.

289,020 次观看 • 2 年前 •via X (Twitter)

9 条评论

nisten - e/acc 的头像
nisten - e/acc2 年前

As far as I’ve heard from openai folk they’re “looking into it”. So this is new to them too. No one knows how well it’ll perform at scale, but a 0.79B and 2.9B model trained on just 300m tokens (because of being gpupoor) coming within ballpark of llama7B is pretty cray cray.

nisten - e/acc 的头像
nisten - e/acc2 年前

If anyone has spare compute to donate the skunkworks kitchen is ready to outcook openai with it just saying

The Highly Automated Cat — e/acc ⏩ 的头像
The Highly Automated Cat — e/acc ⏩2 年前

sexting sms?

nisten - e/acc 的头像
nisten - e/acc2 年前

structured state space models

𝔠ɣ𝔟ε𝓇 𝕙ιε𝕣øթ𝕙𐊀ητ //daniel// 的头像
𝔠ɣ𝔟ε𝓇 𝕙ιε𝕣øթ𝕙𐊀ητ //daniel//2 年前

Is the tech legit? Transformer-killers have flopped (get it?) in the past…

nisten - e/acc 的头像
nisten - e/acc2 年前

@ddaughertytech lk99 moment

murat 🍥 的头像
murat 🍥2 年前

wow the deepfates program has really grown

Jamison 🏕️☃️ 的头像
Jamison 🏕️☃️2 年前

banger song

Tyr 的头像
Tyr2 年前

Whatd I miss?

相关视频