Ashwin Gopinath's banner
Ashwin Gopinath's profile picture

Ashwin Gopinath

@ashwingop • 5,124 subscribers

CEO of https://t.co/i9EfIbqt9G ; Used to be a Prof. at MIT; 2x founder

Videos

LIVE
1.2k

Anya Rossi

sweetdream.ai

SweetDream.aiSponsored•Livecam
Streaming Now

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

HD live stream
Exclusive private shows
1.2k viewers online

Free preview available • Premium content

We've raised $5M to build organizational memory. Every company runs on decisions, but as teams grow the, context behind them gets lost. We built Sentra to make sure that never happens again. Start using Sentra for free today!
1:23
ashwingop's profile picture

We've raised $5M to build organizational memory. Every company runs on decisions, but as teams grow the, context behind them gets lost. We built Sentra to make sure that never happens again. Start using Sentra for free today!

Ashwin Gopinath

190,080 views • 2 months ago

Sentra just killed Google Research's TurboQuant. SpectralQuant — 5.95× KV cache compression on Mistral 7B at +7.5% perplexity overhead. TurboQuant at the same compression: +22%. 3× less degradation. 15-second calibration. One per-model, then drop-in for any HuggingFace LLM, ViT, ESM, AlphaFold Evoformer, or VideoMAE. Check out the findings and how the mechanism works below. ↓
7:32
ashwingop's profile picture

Sentra just killed Google Research's TurboQuant. SpectralQuant — 5.95× KV cache compression on Mistral 7B at +7.5% perplexity overhead. TurboQuant at the same compression: +22%. 3× less degradation. 15-second calibration. One per-model, then drop-in for any HuggingFace LLM, ViT, ESM, AlphaFold Evoformer, or VideoMAE. Check out the findings and how the mechanism works below. ↓

Ashwin Gopinath

59,538 views • 1 month ago

No more content to load