Xuan-Son Nguyen's banner

Xuan-Son Nguyen

@ngxson • 6,687 subscribers

Engineer @huggingface

Shorts

Qwen3.6-27B running 100% on WebGPU. Not the best speed but still 😁

Qwen3.6-27B running 100% on WebGPU. Not the best speed but still 😁

53,093 Aufrufe

I said let him cook 🗣️🗣️🗣️ Real-time on-mobile caption with PocketPal AI , running 100% offline 🚀 Tested on my poor iPhone SE 2 Huge kudos to Asghar Ghorbani for making this!!

I said let him cook 🗣️🗣️🗣️ Real-time on-mobile caption with PocketPal AI , running 100% offline 🚀 Tested on my poor iPhone SE 2 Huge kudos to Asghar Ghorbani for making this!!

22,301 Aufrufe

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

Real-time webcam demo with Hugging Face SmolVLM and ggml llama.cpp server. All running locally on a Macbook M3

Real-time webcam demo with Hugging Face SmolVLM and ggml llama.cpp server. All running locally on a Macbook M3

Xuan-Son Nguyen

973,865 Aufrufe • vor 1 Jahr

llama.cpp is likely the first LLM runtime in the world to allow "interrupt" reasoning without stopping the whole response. We also added a small "skip" button on the Web UI, the model gives the final response as soon as you click the button. The response is no longer bound to reasoning budget!

llama.cpp is likely the first LLM runtime in the world to allow "interrupt" reasoning without stopping the whole response. We also added a small "skip" button on the Web UI, the model gives the final response as soon as you click the button. The response is no longer bound to reasoning budget!

Xuan-Son Nguyen

31,511 Aufrufe • vor 1 Monat

Introducing: the new llama-cli 🦙🦙 > Clean looking interface > Multimodal support > Conversation control via commands > Speculative decoding support > Jinja fully supported

Introducing: the new llama-cli 🦙🦙 > Clean looking interface > Multimodal support > Conversation control via commands > Speculative decoding support > Jinja fully supported

Xuan-Son Nguyen

21,343 Aufrufe • vor 7 Monaten

Keine weiteren Inhalte verfügbar