Loading video...

Video Failed to Load

Go Home

๐„๐ญ๐ก๐ž๐ซ๐ž๐ฎ๐ฆ ๐ก๐š๐ฌ ๐ฌ๐ฉ๐จ๐ค๐ž๐ง ๐ข๐ญ๐ฌ ๐Ÿ๐ข๐ซ๐ฌ๐ญ ๐ฐ๐จ๐ซ๐! That's right โ€” we have completed the world's 1st ZKP of a 1B+ param LLM inference, before verifying the proof on Ethereum mainnet (block 19427725) ๐Ÿคฏ What did Ethereum say? Learn more in ๐Ÿงต

97,338 views โ€ข 2 years ago โ€ขvia X (Twitter)

10 Comments

Accountable Magic's profile picture
Accountable Magic2 years ago

GPT2-XL is a 1.5B parameter behemoth of an AI model! And to see whether ZKML has finally advanced enough to make proving LLMs feasible at all, we decided to put our proving chops to the test and find out! Oh! It said: "magic", btw <-->

Accountable Magic's profile picture
Accountable Magic2 years ago

This was no easy task ๐Ÿฅต We had to split GPT2-XL's 48 decoder blocks into 144 sub-blocks, before proving on our massive 1TB memory, 128 core CPU cloud clusters for nearly 90 hours! That means that โ€” using generic prover systems โ€” zkLLM overhead is over 1,000,000x!!!

Accountable Magic's profile picture
Accountable Magic2 years ago

So it's possible โ€” nice! But the proving overhead is far from acceptable...for now ๐Ÿ˜‰ As we demonstrate in our latest paper, specialization offer 1,000-10,000x speed-ups for ZKML! In fact, we already have some exciting new updates cooking at the bleeding edge ๐ŸŽ๏ธ

Accountable Magic's profile picture
Accountable Magic2 years ago

In the meantime, check out our blog for what it took to prove a real LLM, why specialization is the future, & the endgame for AI x crypto! Medium blog: Eth block: Follow @ModulusLabs for the latest in ZKML, AI x Crypto, & more ๐Ÿค–

Jason Morton's profile picture
Jason Morton2 years ago

Nice, did you use @ezklxyz for the Halo2 proof or write it directly in Halo2?

Roko ๐Ÿ‰๐Ÿค–๐Ÿ˜‡'s profile picture
Roko ๐Ÿ‰๐Ÿค–๐Ÿ˜‡2 years ago

๐Ÿ‘€

yk's profile picture
yk2 years ago

why is it important to do zkp of LLM inference?

Paul Taylor's profile picture
Paul Taylor2 years ago

Big congrats @realDanielShorr & team! ๐Ÿ”ฅ

Jason Zhao (๊งIP๊ง‚)'s profile picture
Jason Zhao (๊งIP๊ง‚)2 years ago

So sick

Wyatt Benno's profile picture
Wyatt Benno2 years ago

Are you wrapping the final proof in Groth16? Is there any code/ writeup about that? I am interested in how GKR is being used and how it is getting 'onchain'.

Related Videos

Full 2026 EF strategy breakdown from Tomasz K. Staล„czak at EthBoulder ๐Ÿ”ฅ Here's the complete ๐Ÿงต on the future of Ethereum: 1๏ธโƒฃ certification/credential: Clear guidance for institutions on trusted providers, backed by the EF & partners. 2๏ธโƒฃ Post-Quantum Security: A major announcement is on the horizon to make Ethereum quantum-resistant. 3๏ธโƒฃ OIF Interoperability Standard: Becoming the fastest standard to integrate, accelerating development. 4๏ธโƒฃ Devcon 8 | Mumbai, India ๐Ÿ‡ฎ๐Ÿ‡ณ Mumbai: Ethereum is heading to India! A massive event to welcome the global community. 5๏ธโƒฃ Unified 5-Year Roadmap: Merging "LEAN Ethereum" into core dev. Two major workstreams become one. Announcement next week from Ethereum Foundation 6๏ธโƒฃ Agentic Ethereum (DEI): Huge focus on AI agents on Ethereum, leveraging Mainnet & Base to attract new builders. 7๏ธโƒฃ ETHBoulder & ETHDenver: More EF presence at community events for direct engagement. Come say hi! ๐Ÿ‘‹ 8๏ธโƒฃ NYC ETHConf : 6-8k person conference in NYC to welcome institutional players. 9๏ธโƒฃ Global Policy Support: A dedicated team to educate and support policymakers and regulators worldwide. ๐Ÿ”Ÿ DeFi Coordination Team: Launching next week to streamline the DeFi ecosystem. 1๏ธโƒฃ1๏ธโƒฃ Platform Team for L2s: Making Ethereum the ultimate launchpad for Layer 2s. Already hosted a summit for 20+ L2s. 1๏ธโƒฃ2๏ธโƒฃ ECC Roundtable on Culture: An upcoming discussion at ECC dedicated to the culture of Ethereum. The future is bright and BUILT on Ethereum.

Francesco Andreoli แตแต

10,397 views โ€ข 8 months ago

Tom Lee: Ethereum DATs can use ~$500 million in annual staking rewards to fund grants for Ethereum ecosystem โ€œThe Ethereum Treasuries โ€” Bitmine and Sharplink among others โ€” now own 7% of the Ethereum supplyโ€ฆ Treasury stock is essentially supply permanently taken out from the ecosystem, but we also own the yield. The yield is around 3% so today these public treasuries are generating ~$500 million in rewards, and that is what we can use to fund and grant the crypto ecosystem.โ€ Lee believes that the Ethereum Foundation narrowing its focus to CROPs (censorship resistance, openness, privacy and security) is the right decision. โ€œEthereum is a $240 billion network value entity. It has been operating for 11 years without a single day of downtime. Thereโ€™s 11,500 nodes in 89 different countries. And thereโ€™s 15,000 developers. I think this is too big to be coordinated by a single foundation.โ€ As Ethereum continues to scale, he believes the ecosystem will move beyond a foundation-centric model and points to private companies like Etherealize, Optimism, Consensys, Enterprise Ethereum Alliance, and Offchain Labs that represent the Ethereum ecosystem and are already doing enterprise engagement. โ€œThis list doesnโ€™t yet reflect the spinoffs coming from the Ethereum Foundation. Thereโ€™s at least five, and I think Bitmine will play a role in granting and supporting any of those that come out.โ€ โ€œI think Ethereum is in good hands because the foundation is going to be stronger by staying focused. We have a lot of private sector companies already building products and important L2s on Ethereum. And of course, the treasuries are here to help with funding and grantingโ€ฆ If youโ€™re bearish, you are selling at the bottom.โ€

Etherealize

126,158 views โ€ข 4 months ago