Loktar ๐Ÿ‡บ๐Ÿ‡ธ's banner
Loktar ๐Ÿ‡บ๐Ÿ‡ธ's profile picture

Loktar ๐Ÿ‡บ๐Ÿ‡ธ

@loktar00 โ€ข 7,121 subscribers

I test what models can build. Christian. Dad. Veteran.

Shorts

Qwen 3.6 27b Bf16 vs Q4 Not cherry picked first result from each, the prompt is from ๐—ญ๐—ฒ๐—ป ๐— ๐—ฎ๐—ด๐—ป๐—ฒ๐˜๐˜€ check out his pinned post it's a great test! I did throw Q4 a bone and gen twice more.. 2nd was also all white and the third was an error. Qwen 27b has a lot of life in it still!

Qwen 3.6 27b Bf16 vs Q4 Not cherry picked first result from each, the prompt is from ๐—ญ๐—ฒ๐—ป ๐— ๐—ฎ๐—ด๐—ป๐—ฒ๐˜๐˜€ check out his pinned post it's a great test! I did throw Q4 a bone and gen twice more.. 2nd was also all white and the third was an error. Qwen 27b has a lot of life in it still!

136,659 Aufrufe

Now at 256k context and 62 tk/s for IQ4 DSpark, no significant degradation I can see between IQ4 and Q8. It is really cool being able to run these locally. Q8 works but is at 25.3 tk/s too slow for daily use for me anyway.

Now at 256k context and 62 tk/s for IQ4 DSpark, no significant degradation I can see between IQ4 and Q8. It is really cool being able to run these locally. Q8 works but is at 25.3 tk/s too slow for daily use for me anyway.

13,020 Aufrufe

Videos