Introducing LlamaEdge — lightweight & portable LLM tools for your local, edge & server devices. Based on WasmEdge, LlamaEdge apps are <5 MB, self-contained (no complex dependencies), sandboxed (cloud ready), and can be orchestrated by container tools. LlamaEdge apps are portable across diverse CPUs, GPUs, and OSes. It is... super easy to build on them, test locally and then deploy to different devices on the edge or cloud. Try them today! 🚀show more

Looks awesome, especially with a tech stack of Rust + Wasm + llama.cpp

And more to come! We are supporting inference backends beyond llama.cpp. TensorRT-LLM and Intel Transformer Library. Stay tuned!

the video @_rajkhare @iamgingertrash

fyi @0x440x46 @AdonAlternative

This is awesome, I can’t wait to try it out!

I am new to wasmEdge, and I am already excited. I think it can/will make running AI models more accessible. Thus reducing barrier for entry. The plugin ecosystem will boost development in the space.

I really don't want to refute it. But this inconsistency is too obvious. Who should I trust? You say AI doesn't make people unemployed. But Lee Kai-fu said that AI will quickly and destructively make people unemployed, even larger than all of human tech revolutions added together

The screenshots I took before were all in Chinese. Now I found some English ones. You can also go to Google and search for it. Video and screenshot evidence of himself. The interviewer can also attest.

After all, he wore a suit and went to such a high-level interview. He said it so confidently. The facts are there. Or is he in a suit ,full of lies. I agree with you above. So what kind of lie is Kai-Fu Lee telling?