
alexintosh
@Alexintosh • 8,942 subscribers
do you want to win?
Videos

I just ran Qwen3.5 35B on my iPhone at 5.6 tok/sec. Fully on-device. 4bit | 256 experts. Model: 19.5GB. iPhone: 12GB RAM. wild.
alexintosh390,182 просмотров • 7 месяцев назад

It's optimization time. Qwen3.5 35B at 13.1 tok/sec on iPhone 17 (no-pro). 2.3x from baseline of 2 days ago. Experimental features: --- Fused attention CMD1+CMD2 Merge Fused Expert Kernel Expert Prefetch I/O Fanout (credit Anemll) cc Dan Woods Daniel Isaac
alexintosh102,600 просмотров • 7 месяцев назад
Больше нет контента для загрузки