正在加载视频...

视频加载失败

🚨 ANTHROPIC TRIED TO BAN HIS GITHUB Chinese guy published 70B parameter LLM, 20,000 starts on Github + a lawsuit from big AI companies Here's what it does: > runs on Python > even shitty mac or pc is enough > flat memory > loads a model layer by...

491,467 次观看 • 4 个月前 •via X (Twitter)

29 条评论

Milady 的头像
Milady4 个月前

Github

High Level 的头像
High Level4 个月前

This has been floating around these reposters, the project hasn’t had meaningful updates since 2024. So don’t bother.

Hanzo ㊗️ 的头像
Hanzo ㊗️4 个月前

I run local ai on my phone and it builds me $100k mrr products every day

Vignesh Baskaran 的头像
Vignesh Baskaran4 个月前

Everything is true in this post, other than this Ban thing..

Charlie 的头像
Charlie4 个月前

Sigh... another engagement farmer copying and pasting the exact same regurgitated post.

Bino of Mo Thugs 的头像
Bino of Mo Thugs4 个月前

The only thing disk streaming is good for, is winning a bet that it can be done. Technically, yes, it’ll run… at like one token every 5 seconds or so.

Dustin Böhmer 的头像
Dustin Böhmer4 个月前

Realistische Performance: 0.5–2 tokens/s auf 4GB GPU. Eine 200-Wort-Antwort = 2–8 Minuten Wartezeit. Marketing-Versprechen "70B auf 4GB GPU" ≠ "70B auf 4GB GPU produktiv nutzbar".

vaibhav pratp singh 🇮🇳🇺🇸 的头像
vaibhav pratp singh 🇮🇳🇺🇸4 个月前

Whats layer by layer?

Komal (805) | LFGO 的头像
Komal (805) | LFGO4 个月前

Check out @Vibesterz_

Homeless 的头像
Homeless4 个月前

Chinese are bitchy when it come's to business

I am 的头像
I am4 个月前

Looks super interesting, I will definitely look into adding this to my project

ゆき 的头像
ゆき4 个月前

i literallyy had to watch this 20 times to understand what happened on the reflection

ViceSol 的头像
ViceSol4 个月前

A model requiring 4GB VRAM and a model serving a 200B parameter workload are usually not the same claim. The details tend to matter more than the headline

Peter Dove 的头像
Peter Dove4 个月前

Not a snowballs chance in hell. 5 tokens a second if you are lucky , 13 million tokens and month running flat out 24/7

Arslan Yousaf 的头像
Arslan Yousaf4 个月前

Local AI just got a lot harder to ban.

Sinda | SKatalyst AI 的头像
Sinda | SKatalyst AI4 个月前

The local AI direction is real, but “4GB GPU for 70B” and “200B with ease” needs serious context. Running a model and running it usefully are very different things. The future is local + cloud hybrid, not hype math.

Profexor 的头像
Profexor4 个月前

What’s the coding benchmark like? Probably not good 😬

CryptoAddict 的头像
CryptoAddict4 个月前

@grok true or another scam ?

DigitalNexus 的头像
DigitalNexus3 个月前

that's actually genius.

Stevo Keano 的头像
Stevo Keano4 个月前

Yes local with an augmented knowledge base but by the SME.

simon G 的头像
simon G4 个月前

2024年最后一次更新!?🤣

Vituco 的头像
Vituco4 个月前

Almost 3 years old model. This tweet makes no sense. Pure bullshit.

Ledio Bernstein 的头像
Ledio Bernstein4 个月前

@grok is it true?

Rohit 的头像
Rohit4 个月前

Wow, that's impressive! Love seeing innovation pushing boundaries like this.

Prithvi Jadwani | AI SEO | GEO | REDDIT SEO | GMB 的头像
Prithvi Jadwani | AI SEO | GEO | REDDIT SEO | GMB4 个月前

Sounds like Anthropos is trying to outscale commercial LLMs without paying for compute. Not sure if that's a sustainable model or a clever hack.

Mxrius 的头像
Mxrius4 个月前

0.01-0.03 tokens/s btw

Juan Cruz Giner Pulero 的头像
Juan Cruz Giner Pulero4 个月前

Holy larp

George Zonix 的头像
George Zonix4 个月前

Microsoft is the sponser/ owners of GitHub not anthropic.

Thor 的头像
Thor4 个月前

Ok!!

相关视频