buun

@spiritbuun • 2,904 subscribers

this user is being compacted

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

Introducing a new KV format: VBR (Variable Bit Rate) VBR dynamically quantizes your KV cache layer-by-layer as your session grows, giving you the highest quality possible within your VRAM constraints. This is my dream format. Pushed to master. Available now. 1/15 🧵

Introducing a new KV format: VBR (Variable Bit Rate) VBR dynamically quantizes your KV cache layer-by-layer as your session grows, giving you the highest quality possible within your VRAM constraints. This is my dream format. Pushed to master. Available now. 1/15 🧵

48,983 views • 3 months ago

My first ever quant is going to drop in the next week. I've been working on this for over a month now. The recipe is locked in. The QAT is finished. This is not just quantization. This is the smartest B27 ever.

My first ever quant is going to drop in the next week. I've been working on this for over a month now. The recipe is locked in. The QAT is finished. This is not just quantization. This is the smartest B27 ever.

14,989 views • 4 months ago

No more content to load