Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

I am happy to share FlashProve: our performant open-source prototype for provable inference. We believe that this has significant implications for security, pacing AI development, integrity guarantees, and more. FlashProve allows a provider to commit to model weights, and then prove that replies originate from the committed model. The...

12,157 Aufrufe • vor 3 Tagen •via X (Twitter)

28 Kommentare

Profilbild von Giacomo Fenzi
Giacomo Fenzivor 3 Tagen

FlashProve is a commit-and-prove succinct zero-knowledge argument. The provider commits to the model weights once, and sends the commitment to clients. When a client submits a prompt, the prover attaches a short proof, and the client (on consumer-hardware) can check the proof against the commitment.  The proof cryptographically guarantees that the provider used the model claimed to generate the response, and the provider is assured that it does not leak information about the weights. Further, the proof is succinct: it is short and the verifier can efficiently check it on consumer hardware.

Profilbild von Giacomo Fenzi
Giacomo Fenzivor 3 Tagen

To build FlashProve, we rely on battle-tested cryptography: interactive oracle proofs and cryptographic hash functions. An interactive oracle proof is an interactive proof system, in which a prover sends long oracle messages which the verifier can query. Using Merkle commitments, we replace the oracles with cryptography, and we use Fiat-Shamir to remove interactivity. These succinct arguments have many desirable properties: minimal assumptions, post-quantum security, and fast provers. We tailor our interactive oracle proof to machine learning computation, and achieve succinctness via fold and hopping, an adaptation of the techniques in Zook.

Profilbild von Giacomo Fenzi
Giacomo Fenzivor 3 Tagen

To achieve great performance, we had to complement this with a large amount of engineering. Safe to say, Claude was very happy to help! We prove the entire model streaming on a single GPU (which cannot even fit the weights!). For a 400B mixture-of-experts model, we can prove at more than 100tok/s, just two orders of magnitudes slower than running the model natively!  We are aware of a number of further optimizations, so expect the number to improve!

Profilbild von Giacomo Fenzi
Giacomo Fenzivor 3 Tagen

We have (many) more details in the blog posts and the repositories. We also expect to post a (human generated) paper explaining the protocol in more details soon, so stay tuned for that one as well. FlashProve wouldn’t have been possible without the excellent work of everyone involved: @RoyRinberg , Alex, Ale, @miranda__christ, Rahul, @transmissions11 and @gwberg95 (and Claude). It was a lot of fun!

Profilbild von Jens Groth
Jens Grothvor 2 Tagen

Very cool, congrats! @GiacomoFenzi how do you handle noise in its various forms? Is my understanding correct that you make the model deterministic, i.e., no race conditions and no floating point issues? How about other input that may sneak in: time, tool calls, prompt grinding?

Profilbild von Giacomo Fenzi
Giacomo Fenzivor 2 Tagen

Yes! Currently for the prototype we quantize the model to make it deterministic. We have a few other tricks in store for the general case, that we hope to share soon.

Profilbild von Georgios Konstantopoulos
Georgios Konstantopoulosvor 3 Tagen

congrats man!! Awesome work.

Profilbild von Giacomo Fenzi
Giacomo Fenzivor 2 Tagen

Thank you!

Profilbild von drouyang
drouyangvor 3 Tagen

Congrats! Do you expects further performance improvements from the protocol or the GPU prover implementation side?

Profilbild von Giacomo Fenzi
Giacomo Fenzivor 2 Tagen

Thank you! Both! I think there is juice to squeeze in many places

Profilbild von drouyang
drouyangvor 2 Tagen

Great to know. Cann’t wait to build on top of it!

Profilbild von Princess Vegeta
Princess Vegetavor 3 Tagen

oooo

Profilbild von pietro
pietrovor 3 Tagen

@GiacomoFenzi goated

Profilbild von Giacomo Fenzi
Giacomo Fenzivor 2 Tagen

gotta cook some time 🧑‍🍳

Profilbild von Soubhik Deb
Soubhik Debvor 2 Tagen

wanted to confirm if i am understanding this part correctly: the models are being quantized to integer only to get determinism in matrix multiplication (due to arithmetization being over only integer fields?) and that there is another check to ensure that error introduced due to integer quantization is not being used as cover for breaking soundness?

Profilbild von Robert Corbin | Shadowfetch Studio | AIpeoplewiki
Robert Corbin | Shadowfetch Studio | AIpeoplewikivor 3 Tagen

Congrats on shipping FlashProve, Giacomo! Really cool to see this open-sourced. #AI #OpenSource

Profilbild von osdnk
osdnkvor 2 Tagen

@claucece Wow, that's so good!

Profilbild von Giacomo Fenzi
Giacomo Fenzivor 2 Tagen

@claucece Thank you! Very very happy ;)

Profilbild von Loris
Lorisvor 3 Tagen

Awesome stuff! Truly incredible to see zk proofs to secure llm!

Profilbild von Giacomo Fenzi
Giacomo Fenzivor 2 Tagen

Thank you!

Profilbild von Francesco Intoci
Francesco Intocivor 2 Tagen

Lo chef

Profilbild von Giacomo Fenzi
Giacomo Fenzivor 2 Tagen

🧑‍🍳🧑‍🍳🧑‍🍳

Profilbild von AndrewJoes
AndrewJoesvor 2 Tagen

Your report says FlashProve generates proofs after replies are served, by recomputing transcripts on separate hardware. A valid proof shows what the committed model would output. It doesn’t establish which model actually served those tokens. How can computational consistency prove the response’s origin?

Profilbild von Shez Malik
Shez Malikvor 2 Tagen

didn't think my laptop could do this

Profilbild von Zeko Labs
Zeko Labsvor 2 Tagen

nice work. we just open sourced our private, sovereign ZK AI protocol for ethereum

Profilbild von JB
JBvor 2 Tagen

One inference proved is a big step. Agent runs are dozens of calls with tool results feeding back in between. Curious how you see per-call proofs composing into evidence of the whole run, including the non-model steps a verifier still has to take on trust.

Profilbild von 0xJoshAlpha
0xJoshAlphavor 3 Tagen

provable inference only matters if the prover cannot swap the model mid-run

Profilbild von Shavaiz Tariq
Shavaiz Tariqvor 3 Tagen

the sampling part is where i'd poke. with temperature above zero, a provider could swap in a cheaper model and claim a lucky sample unless the seed is committed too. is the randomness bound into the proof, or is this greedy decoding only?

Ähnliche Videos

Dario Amodei just dismantled the biggest myth in the AI industry. Open source AI isn’t free. It never was. Amodei: “It’s not free. You have to run it on inference and someone has to make it fast on inference.” For decades, open source meant something real. It meant a teenager in a basement could download the same tools as a Fortune 500 company. Could read the code. Could modify it. Could build something that competed with the giants. That was genuine democratization. That actually happened. AI is different. Fundamentally. Physically. In ways the ideology hasn’t caught up to yet. Downloading the weights is the easy part. The part that actually costs something is turning the weights into a running system. Into responses. Into intelligence operating in real time at scale. That requires compute. Power. Infrastructure. The kind measured in billions of dollars and years of construction. Amodei: “These are big models. They’re hard to do inference on. Ultimately you have to host it on the cloud. The people who host it on the cloud do inference.” The open source debate was never about who owns the model. It was always about who owns the cloud. And Amodei goes further. When a competitor drops a new open model, he doesn’t ask whether it’s open or closed. He doesn’t care about the licensing. He doesn’t engage the ideology. Amodei: “I don’t think it mattered that DeepSeek is open source. I think I ask, is it a good model? Is it better than us at the things that matter? That’s the only thing that I care about.” That’s the ruthless clarity of someone actually trying to win. While the media debates licensing frameworks, Amodei is asking one question. Is it better. Everything else is a distraction. Amodei: “I don’t think open source works the same way in AI that it has worked in other areas. Here we can’t see inside the model.” This isn’t Linux. You can’t read it. You can’t fork it. You can’t understand it the way generations of developers understood the tools they inherited. You can download it. And then you need a data center to run it. The teenager in the basement who was supposed to be empowered by this revolution needs a billion dollars of infrastructure before the empowerment starts. The era of the basement coder rewriting civilization on a laptop is over. The future belongs to whoever commands the compute, owns the power grid, and can actually turn the intelligence on. Open weights without infrastructure isn’t democratization. It’s a promise the physics of the universe won’t let us keep.

Dustin

688,855 Aufrufe • vor 8 Monaten

America is about to lose the AI race, and it will not happen at the frontier. It will happen at the floor. Everyone is watching who ships the smartest model. The actual war is over the 80% of tokens nobody posts about: the routine inference that quietly runs the world. On current trajectory, that fight is already lost. Watch what people do, not what they say. Coinbase just defaulted its own engineers off frontier models onto open weights and cut AI spend nearly in half while usage kept climbing. Even NVIDIA runs a closed frontier model as an orchestrator and pushes the volume to its own open weights. The frontier is becoming a router. The volume goes open. That part is settled. Here is the part that should terrify Washington: the only credible open tier today is Chinese. GLM. Kimi. And the US answer is to tighten export controls and freeze its own labs in place, as if you can embargo a file that is already downloaded, or price-match free. So China hands the Global South Huawei hardware and free open models, and a generation in Africa and Southeast Asia learns to reason through a model that will not tell them what happened at Tiananmen Square. That is not a cost story. That is influence through inference. You do not have to win hearts and minds when you supply the mind. Open source is not a nice-to-have for America. It is the whole ballgame for the 80%, and right now the US is barely on the field. We need American open weights. Not eventually. Now.

Ben Pouladian

71,722 Aufrufe • vor 4 Monaten