Xuan-Son Nguyen's banner

Xuan-Son Nguyen

@ngxson • 8,034 subscribers

Engineer @huggingface

Shorts

Fruit fly brain as LLM 🤷‍♂️🤷‍♂️

Fruit fly brain as LLM 🤷‍♂️🤷‍♂️

35,843 次观看

Qwen3.6-27B running 100% on WebGPU. Not the best speed but still 😁

Qwen3.6-27B running 100% on WebGPU. Not the best speed but still 😁

53,142 次观看

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

Real-time webcam demo with Hugging Face SmolVLM and ggml llama.cpp server. All running locally on a Macbook M3

Real-time webcam demo with Hugging Face SmolVLM and ggml llama.cpp server. All running locally on a Macbook M3

Xuan-Son Nguyen

974,800 次观看 • 1 年前

You heard about LLM inference on WebGPU, but what about... finetuning LLM on WebGPU? 🤯 I put together a super earlier PoC that proves it's possible, backed by llama.cpp / wllama 😁 Working on LoRA next...

You heard about LLM inference on WebGPU, but what about... finetuning LLM on WebGPU? 🤯 I put together a super earlier PoC that proves it's possible, backed by llama.cpp / wllama 😁 Working on LoRA next...

Xuan-Son Nguyen

19,982 次观看 • 1 个月前

llama.cpp is likely the first LLM runtime in the world to allow "interrupt" reasoning without stopping the whole response. We also added a small "skip" button on the Web UI, the model gives the final response as soon as you click the button. The response is no longer bound to reasoning budget!

llama.cpp is likely the first LLM runtime in the world to allow "interrupt" reasoning without stopping the whole response. We also added a small "skip" button on the Web UI, the model gives the final response as soon as you click the button. The response is no longer bound to reasoning budget!

Xuan-Son Nguyen

31,511 次观看 • 4 个月前

Introducing: the new llama-cli 🦙🦙 > Clean looking interface > Multimodal support > Conversation control via commands > Speculative decoding support > Jinja fully supported

Introducing: the new llama-cli 🦙🦙 > Clean looking interface > Multimodal support > Conversation control via commands > Speculative decoding support > Jinja fully supported

Xuan-Son Nguyen

21,343 次观看 • 10 个月前

没有更多内容可加载