Xuan-Son Nguyen's banner
Xuan-Son Nguyen's profile picture

Xuan-Son Nguyen

@ngxson • 6,687 subscribers

Engineer @huggingface

Shorts

Qwen3.6-27B running 100% on WebGPU. Not the best speed but still 😁

Qwen3.6-27B running 100% on WebGPU. Not the best speed but still 😁

53,093 görüntüleme

I said let him cook 🗣️🗣️🗣️ Real-time on-mobile caption with PocketPal AI , running 100% offline 🚀 Tested on my poor iPhone SE 2 Huge kudos to Asghar Ghorbani for making this!!

I said let him cook 🗣️🗣️🗣️ Real-time on-mobile caption with PocketPal AI , running 100% offline 🚀 Tested on my poor iPhone SE 2 Huge kudos to Asghar Ghorbani for making this!!

22,301 görüntüleme

Videos

LIVE
1.2k

Anya Rossi

sweetdream.ai

SweetDream.aiSponsored•Livecam
Streaming Now

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

HD live stream
Exclusive private shows
1.2k viewers online

Free preview available • Premium content

Real-time webcam demo with Hugging Face SmolVLM and ggml llama.cpp server. All running locally on a Macbook M3
0:24
ngxson's profile picture

Real-time webcam demo with Hugging Face SmolVLM and ggml llama.cpp server. All running locally on a Macbook M3

Xuan-Son Nguyen

973,865 görüntüleme • 1 yıl önce

llama.cpp is likely the first LLM runtime in the world to allow "interrupt" reasoning without stopping the whole response. We also added a small "skip" button on the Web UI, the model gives the final response as soon as you click the button. The response is no longer bound to reasoning budget!
0:31
ngxson's profile picture

llama.cpp is likely the first LLM runtime in the world to allow "interrupt" reasoning without stopping the whole response. We also added a small "skip" button on the Web UI, the model gives the final response as soon as you click the button. The response is no longer bound to reasoning budget!

Xuan-Son Nguyen

31,511 görüntüleme • 1 ay önce

Introducing: the new llama-cli 🦙🦙 > Clean looking interface > Multimodal support > Conversation control via commands > Speculative decoding support > Jinja fully supported
0:26
ngxson's profile picture

Introducing: the new llama-cli 🦙🦙 > Clean looking interface > Multimodal support > Conversation control via commands > Speculative decoding support > Jinja fully supported

Xuan-Son Nguyen

21,343 görüntüleme • 7 ay önce

Daha fazla içerik yok.