Joe Barrow's banner
Joe Barrow's profile picture

Joe Barrow

@barrowjoseph • 5,340 subscribers

NLP + Machine Learning NLP Researcher @AdobeResearch, PhD @ClipUmd.

Shorts

You want to serve large OCR models at low latency? I've been playing around with speculative decoding for Vik Paruchuri/Datalab's Chandra 2 and I'm releasing an initial EAGLE-3.1 model that gets a ~2x speedup at small batch sizes!

You want to serve large OCR models at low latency? I've been playing around with speculative decoding for Vik Paruchuri/Datalab's Chandra 2 and I'm releasing an initial EAGLE-3.1 model that gets a ~2x speedup at small batch sizes!

10,759 просмотров

Videos

Больше нет контента для загрузки