Loading video...

Video Failed to Load

Go Home

Another world first: AI that does facial recognition is now running *on* blockchain as a smart contract 🧠⚡️ :) See demo video, link to technical blog post in thread #NoLimits #ICP 🧵

178,416 views • 2 years ago •via X (Twitter)

10 Comments

dom.icp ∞'s profile picture
dom.icp ∞2 years ago

This blog post provides a thorough technical review of the Cyclotron milestone, link to the code repo for the demo, etc. Enjoy.

Blockchain Pill's profile picture
Blockchain Pill2 years ago

This is getting better and better 👏

GG's profile picture
GG2 years ago

Can the AI identify $WUMBO dom?

ICP Whale ∞ | ICP. The World Computer's profile picture
ICP Whale ∞ | ICP. The World Computer2 years ago

#ICP. Truly amazing 🚀!

Kibosh's profile picture
Kibosh2 years ago

Hey Dom, another great demo and fantastic progress with AI facial recognition fully on-chain $ICP 👏 🏆 Towards the end you mention that GPUs are non-deterministic so this will be technically challenging. Just to share the following which may help in this regard. Deterministic training is possible with multi-GPUs. To illustrate, check out the docs for Nvidia’s Clara platform, AI solutions to improve healthcare delivery and accelerate drug discovery, link below. Determinism can be achieved by setting the Python, Random, Numpy and TensorFlow seeds. Additionally, you can control for the two other sources of non-determinism, namely multiple workers in the TensorFlow pipeline ( and the Horovod Tensor Fusion environment variable. By setting multiple workers to 1 for deterministic training and the HFT environment variable to 0 for determinism for multi-GPU training. According to the Clara docs to eliminate all sources of randomness. It is recommended that the number of GPUs, the GPU architecture, driver versions, all framework versions, and the setup are all the same. Looking forward to the next AI update 🔥 @dfinity @JanCamenisch

X3_wtAgent/₿ Ξ ∞'s profile picture
X3_wtAgent/₿ Ξ ∞2 years ago

$ICP massive

CoinNation's profile picture
CoinNation2 years ago

Fading $ICP ∞ #ICP = Colossal mistake !

Fabio's profile picture
Fabio2 years ago

LLMs running fully on Chain + Proof of Humanity and Facial recognition. Sounds like good progress. Excited to see the developments in the next few months for #ICP

Dexter ∞ ₿'s profile picture
Dexter ∞ ₿2 years ago

Icp army, wizard seems to be a little exhausted after integrating the next alien tech, we need some memes to at least put a smile on his face, ICP the very thing stack with no limits ! #icp

DeRF's profile picture
DeRF2 years ago

It seems like every other day @dfinity has a world-first release. Ppl are starting to wake up to this sleeping giant and it's about time

Related Videos

A world first: a demonstration of AI running *on* blockchain as a smart contract 🧠⚡️ The Internet Computer is used – the world's first 3rd gen. blockchain #ICP. AI will become the beating heart of our web3, multi-chain world, and this is only my first demo. Code will follow shortly. This is running on DFINITY's Internet Computer testnet, but you'll be able to take the code and run it on the public network as the NNS is expected to up the per-transaction instruction limit in the coming days. Some important notes. The inference engine used has not been optimized, and we will show vastly greater efficiency in subsequent demos, where the AI runs even faster, and consumes less gas/cycles. We will also propose to the NNS that smart contracts have access to SIMD instructions – which we have determined are deterministic – unlocking vastly more speed and efficiency. Lastly, currently the actor smart contracts ICP hosts run inside a 32 bit environment, which limits their main memory to 4GB. Within the next couple of months, we expect the Internet Computer to move to a 64 bit environment, allowing smart contract memory limits to be raised much higher – allowing for models with far more parameters, and thus power, to be run. Those of you who have followed my posts know that hardware optimization support is planned. Firstly this will involve WASM smart contracts shipping out matrices for processing by the CPUs on existing node machines (another advantage of the Internet Computer running on sovereign node hardware). Secondly, we plan to propose a new public node machine specification, which node providers can build to, for use in subnets specialized for hosting AI smart contracts, in which each machine will incorporate several GPUs. Naturally, this will be packaged with other technological developments that ensure smart contract determinism. This is part of our mission to enable powerful LLMs to run as smart contracts on the Internet Computer – in a forms that are tamperproof, unstoppable, and optionally autonomous (including under the exclusive control of DAOs). Our vision: you will be able to have a chat with a smart contract. A smart contract will be able to coordinate your organization (see my earlier tweet about a "Delphi"). ICP smart contracts will be able to audit Ethereum smart contracts, kitemarking those without backdoors and reentrancy bugs. And smart contracts will be able to do KYC autonmously, matching faces to driving licenses, and more. We will deliver new SDK enhancements, and work with partners, to turbocharge crypto AI developers. Secure and unstoppable AI and third generation blockchain will be two sides of the same coin. Security and AI will be indivisible. AI models will be traded as NFTs. Thanks to Internet Computer's chain key (trustless multi-chain) capabilities, all blockchains will be able to leverage AI smart contracts. The future is beyond exciting. Thanks for watching. Can't wait to give you more demos!

dom | icp

1,362,003 views • 2 years ago

Say hello to a massive acceleration of AI smart contracts 🧠 on the Internet Computer #ICP blockchain. Brilliant work by the DFINITY Foundation team has accelerated deterministic floating point instructions by 10X. We continue on our mission to run sophisticated LLMs as smart contracts 👊⚡️🔥 In the demo, image classification is now running 3X+ faster (across 3-4 blocks through consensus compared to 10-12 before). Naturally, the gas/cycles costs of AI inference has come down commensurately. The acceleration was achieved through broad low-level work, which includes commits to the public Wasmtime virtual machine implementation of WebAssembly. Coming optimizations will take us much further. The next optimization will include the integration of SIMD instructions into the smart contract execution environment, which will allow multiple floating point calculations to be performed in parallel through the execution of a single instruction. Something crucial: also in near sight, is the migration of the ICP smart contract environment from 32-bit Wasm to 64-bit Wasm, which will scale the number of AI model weights that can be loaded into contract memory from 2B to whatever is needed for sophisticated LLMs. Somewhat further away, is the provision of new APIs allowing canister smart contract code to export AI computations for accelerated processing on GPUs. This will require substantial work to address the challenges of achieving deterministic computation directly on the silicon, and for the community to agree a new public spec for node machines that pack GPUs, and to add compliant blockchain nodes to the network. Together, these improvements will unlock further orders of magnitude acceleration of AI smart contract inference (and potentially training). We believe that in the future vast numbers of AI models will run as smart contracts, which will prevent them being hacked (and thus the sensitive data they ingest being stolen), make them unstoppable, make them transparent, and where needed, allow them to run autonomously – for example for purposes such as KYC or EVM smart contract verification/certification. In the future, you will be able to have a conversation with a blockchain, and ask it to do reasoning for you. In this bright future, on-chain AI will be at the heart of Web3 – and to be clear, the Internet Computer's chain key technology will allow direct trustless integration with smart contracts on traditional chains such as Ethereum, Solana and NEAR. Join the #ICP mission to run the most impactful AI models on blockchain as smart contracts, and help make the Internet Computer the "everything computer." Join next week's Global R&D for details about the low-level deterministic floating point optimizations. Thanks for following 💪
2:03

Sensitive content

Say hello to a massive acceleration of AI smart contracts 🧠 on the Internet Computer #ICP blockchain. Brilliant work by the DFINITY Foundation team has accelerated deterministic floating point instructions by 10X. We continue on our mission to run sophisticated LLMs as smart contracts 👊⚡️🔥 In the demo, image classification is now running 3X+ faster (across 3-4 blocks through consensus compared to 10-12 before). Naturally, the gas/cycles costs of AI inference has come down commensurately. The acceleration was achieved through broad low-level work, which includes commits to the public Wasmtime virtual machine implementation of WebAssembly. Coming optimizations will take us much further. The next optimization will include the integration of SIMD instructions into the smart contract execution environment, which will allow multiple floating point calculations to be performed in parallel through the execution of a single instruction. Something crucial: also in near sight, is the migration of the ICP smart contract environment from 32-bit Wasm to 64-bit Wasm, which will scale the number of AI model weights that can be loaded into contract memory from 2B to whatever is needed for sophisticated LLMs. Somewhat further away, is the provision of new APIs allowing canister smart contract code to export AI computations for accelerated processing on GPUs. This will require substantial work to address the challenges of achieving deterministic computation directly on the silicon, and for the community to agree a new public spec for node machines that pack GPUs, and to add compliant blockchain nodes to the network. Together, these improvements will unlock further orders of magnitude acceleration of AI smart contract inference (and potentially training). We believe that in the future vast numbers of AI models will run as smart contracts, which will prevent them being hacked (and thus the sensitive data they ingest being stolen), make them unstoppable, make them transparent, and where needed, allow them to run autonomously – for example for purposes such as KYC or EVM smart contract verification/certification. In the future, you will be able to have a conversation with a blockchain, and ask it to do reasoning for you. In this bright future, on-chain AI will be at the heart of Web3 – and to be clear, the Internet Computer's chain key technology will allow direct trustless integration with smart contracts on traditional chains such as Ethereum, Solana and NEAR. Join the #ICP mission to run the most impactful AI models on blockchain as smart contracts, and help make the Internet Computer the "everything computer." Join next week's Global R&D for details about the low-level deterministic floating point optimizations. Thanks for following 💪

dom | icp

278,277 views • 2 years ago