Загрузка видео...

Не удалось загрузить видео

На главную

Demo for the sharded inference engine on: gpt-oss-120b on 4090's, max input context 95k, max output context infinite (tok/s degrades with context) queue of max 12 prompts concurrently, use it wisely

91,357 просмотров • 4 месяцев назад •via X (Twitter)

Комментарии: 37

Фото профиля leyten
leyten4 месяцев назад

for those who doubt: IP's of the nodes are verifiable code for this demo is found in the github:

Фото профиля Moontime
Moontime4 месяцев назад

Running a 120B model split across 4090s over WAN with verifiable receipts and no central server is genuinely unhinged infrastructure. This is what decentralized compute was supposed to mean before everyone got distracted making JPEG coins.

Фото профиля nothingeverhappens
nothingeverhappens4 месяцев назад

@c0mputeAI bro’s hard at work

Фото профиля leyten
leyten4 месяцев назад

@mehdixxxz @c0mputeAI can't change the DeAI space by doing nothing all day

Фото профиля spyzer
spyzer4 месяцев назад

Insane 👏

Фото профиля mohit
mohit4 месяцев назад

this is so fucking cool

Фото профиля leyten
leyten4 месяцев назад

we're pioneers mohit

Фото профиля Naka
Naka4 месяцев назад

Homie grinding hard 24/7

Фото профиля jaylow
jaylow4 месяцев назад

@toly @mert @solana where are you??

Фото профиля Aliaian
Aliaian4 месяцев назад

a ture pioneer, this is sick @leyten doesnt stop building

Фото профиля wawin
wawin4 месяцев назад

@toly @mert @OpenAI Check whats building here

Фото профиля Moontime
Moontime4 месяцев назад

infinite output context is doing a lot of heavy lifting in that sentence. 'tok/s degrades with context' is just 'technically infinite if you have three weeks.'

Фото профиля spdy
spdy4 месяцев назад

this is very cool i wish you would post on the main account, low visibility here :( very cool site and i liked how it answered what i asked wp dev

Фото профиля uncracked
uncracked4 месяцев назад

Bro casually making the next frontier of DeAI a reality

Фото профиля taku
taku4 месяцев назад

few questions why only 4 workers are participating? website says 300+ and who is the user here? website says 0 busy is this a separate experimental demo from what is live currently?

Фото профиля Tz
Tz4 месяцев назад

Good work sir, this could be a real solution to the crazy high server costs in AI inference

Фото профиля 0xTereza
0xTereza4 месяцев назад

@shawmakesmagic u might like this one

Фото профиля Vip
Vip4 месяцев назад

Can you add a chat history rq. shit is cooking bangers

Фото профиля internet nobody 🇪🇸
internet nobody 🇪🇸4 месяцев назад

Probably nothing...

Фото профиля FEiKU
FEiKU4 месяцев назад

Cope and seethe haters! Builders just keep building until there’s no more fud left 🫡

Фото профиля Real ⚡️
Real ⚡️4 месяцев назад

people aren’t yet ready or can imagine

Фото профиля Enkidu
Enkidu4 месяцев назад

This tech is insane! Major props to the dev @leyten @solana @toly

Фото профиля SVR
SVR4 месяцев назад

very easy to see

Фото профиля AdventureNLearn
AdventureNLearn4 месяцев назад

⛓️‍💥

Фото профиля 胡萝卜丨 1000XGEM
胡萝卜丨 1000XGEM4 месяцев назад

这是证明自己?

Фото профиля leyten
leyten4 месяцев назад

by the nodes scattered across the USA

Фото профиля Chrissy from the BLOCKS 🐂🀄️
Chrissy from the BLOCKS 🐂🀄️4 месяцев назад

@c0mputeAI @pmarca @elonmusk @TheRundownAI @rowancheung @mreflow @karpathy @ylecun @sama @emollick @demishassabis @toly @solana @blknoiz06 New AI tech and dev on the solana:So11111111111111111111111111111111111111112 scene the top dogs need to know asap $zero @c0mputeAI

Фото профиля WhiteSugar59 🐂
WhiteSugar59 🐂4 месяцев назад

nice, keep it up. Do you have a timeline for progression of full scale utility from this demo. what will fully working setup look like

Фото профиля Max
Max4 месяцев назад

amazing work

Фото профиля ahmet cetinkaya
ahmet cetinkaya4 месяцев назад

👏

Фото профиля Mr.Will
Mr.Will4 месяцев назад

Respect😍

Фото профиля Ferbin
Ferbin4 месяцев назад

12 concurrent is tight. What's latency under full queue for realtime voice?

Фото профиля Barlo
Barlo4 месяцев назад

@c0mputeAI @toly @NVIDIAAI @nvidia

Фото профиля Lesnar XBT
Lesnar XBT4 месяцев назад

W

Фото профиля NeverQuit
NeverQuit4 месяцев назад

🔥🔥

Фото профиля F
F4 месяцев назад

🌶️🌶️

Фото профиля Todd Zheng
Todd Zheng4 месяцев назад

remarkable work. Can’t wait till the day when people can use your tech to form p2p network and both providers and consumers can benefit from it. Right now it’s still not cost-effective enough though but I truly admire this work!

Похожие видео