Ashwin Gopinath's banner
Ashwin Gopinath's profile picture

Ashwin Gopinath

@ashwingop • 6,517 subscribers

CEO of Sentra; Used to be a Prof. at MIT; Random musings at https://t.co/C2NpmjRTl9

Videos

LIVE
1.2k

Anya Rossi

sweetdream.ai

SweetDream.aiSponsored•Livecam
Streaming Now

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

HD live stream
Exclusive private shows
1.2k viewers online

Free preview available • Premium content

We've raised $5M to build organizational memory. Every company runs on decisions, but as teams grow the, context behind them gets lost. We built Sentra to make sure that never happens again. Start using Sentra for free today!
1:23
ashwingop's profile picture

We've raised $5M to build organizational memory. Every company runs on decisions, but as teams grow the, context behind them gets lost. We built Sentra to make sure that never happens again. Start using Sentra for free today!

Ashwin Gopinath

190,877 views • 4 months ago

Sentra just killed Google Research's TurboQuant. SpectralQuant — 5.95× KV cache compression on Mistral 7B at +7.5% perplexity overhead. TurboQuant at the same compression: +22%. 3× less degradation. 15-second calibration. One per-model, then drop-in for any HuggingFace LLM, ViT, ESM, AlphaFold Evoformer, or VideoMAE. Check out the findings and how the mechanism works below. ↓
7:32
ashwingop's profile picture

Sentra just killed Google Research's TurboQuant. SpectralQuant — 5.95× KV cache compression on Mistral 7B at +7.5% perplexity overhead. TurboQuant at the same compression: +22%. 3× less degradation. 15-second calibration. One per-model, then drop-in for any HuggingFace LLM, ViT, ESM, AlphaFold Evoformer, or VideoMAE. Check out the findings and how the mechanism works below. ↓

Ashwin Gopinath

61,236 views • 3 months ago

No more content to load