Giacomo Fenzi

I am happy to share FlashProve: our performant open-source prototype for provable inference. We believe that this has significant implications for security, pacing AI development, integrity guarantees, and more. FlashProve allows a provider to commit to model weights, and then prove that replies originate from the committed model. The proof leaks no information about the weights, and the verifier can efficiently verify it on consumer hardware. Our library is performant, proving a 400B parameter MoE model at 100 tok/s. We have open-sourced the associated code and Lean formalization. We hope that it catalyzes further progress in verification of inference, and look forward to seeing it.