EAGLE-3 introduces two key innovations: Training-Time Testing (TTT) and... multi-level feature fusion. By removing the feature prediction constraint used in previous EAGLE versions and leveraging semantic features across multiple layers, EAGLE-3 achieves higher acceptance rates, faster generation, and lossless performance. The result? - 5.6× faster than vanilla decoding (13B) Compared to EAGLE-1, EAGLE-3 delivers a 1.8× speedup on the 13B model, with the future EAGLE-4 release expected to further improve decoding efficiency. *Inference on the video conducted on 2x RTX 3090 GPUs at fp16 precision using the Vicuna 13B model.show more

Can $300 RTX3060 be faster than $10,000 A100 for... LLM decoding?🧐Yes Introduce EAGLE-2: - 4.26x🚀vanilla (13B) - 1.4x🚀EAGLE (13B) - No extra training than EAGLE - Maintain distribution Paper: Code: Demo:show more

Dasting. Dan Scavino just post an eagle video on... IG with the song “Fly like and Eagle”. Bill Clinton’s Secret Service codename is “Eagle”.show more

The falcon thinks the eagle is his mother and... asks the eagle to feed himshow more

The falcon thinks the eagle is his mother and... asks the eagle to feed himshow more

WHAT IS GOING ON?! 🤯 The Danes are going... eagle-for-eagle across the back 9! 🔥 #DanishGolfshow more

You want to serve large OCR models at low... latency? I've been playing around with speculative decoding for Vik Paruchuri/Datalab's Chandra 2 and I'm releasing an initial EAGLE-3.1 model that gets a ~2x speedup at small batch sizes!show more

Introduce EAGLE, a new method for fast LLM decoding... based on compression: - 3x🚀than vanilla - 2x🚀 than Lookahead (on its benchmark) - 1.6x🚀 than Medusa (on its benchmark) - provably maintains text distribution - trainable (in 1~2 days) and testable on RTX 3090s Playground: Blog: Code: ⚒️First Principle: Compression! Yi Ma We find that the sequence of second-top-layer features is compressible, making the prediction of subsequent feature vectors from previous ones easy by a small model. 🙏Acknowledge: This project is greatly inspired by the Medusa team (Tianle Cai @yli3521 Zhengyang Geng Hongwu Peng Tri Dao), the Lookahead team (Hao Zhang LMSYS Org), and others. Joint work with Yuhui Li and Chao Zhangshow more

Martial eagle (Slide 1) is stronger than bald eagle... (Slide 2). It is also a better hunter. It can take down larger, more challenging prey like antelopes or monitor lizards, unlike the bald eagle which relies more on fish and scavenging. The martial eagle’s predatory style is also more aggressive and versatile. Why is the bald eagle now used more by people? That is the power of marketing. The bald eagle is the national bird of the United States. It has been packaged in movies and clips to look more regal and powerful. They even replace its sound with a louder and more majestic call of a red tailed hawk. Watch the second clip and you'll hear their natural sounds. Also, when you type "eagle," the emoji that comes out is 🦅 which is that of bald eagle. That's the power of PR.show more

The Great Eagle #eagle #hairstyle #haircut #subscribe

Chip-in eagle for Harry Hall 🦅 This is the... first eagle of the week on No. 17 Valero Texas Open.show more

The Flight of eagle #eagle #eagles #birdsofprey #birdsoftiktok #birds

Videographed bald eagle In Campbell River. The Haast’s eagle... is the largest and heaviest eagle to ever exist, weighing up to 37 pounds and measuring four feet long, with a nine to ten-foot wingspan. This enormous eagle had a bill larger than any living vulture and claws bigger than a tiger’s. Their main prey was moa, which could easily topple 12 feet high and weigh over 500 pounds! While the Haast’s eagle couldn’t necessarily fly off with a moa, they could use their sharp, powerful talons to rip through flesh and crush bone. There is evidence that the Haast’s eagle survived and evolved through multiple ice ages but went extinct around 500 to 600 years ago. In comparison, the biggest of the bald eagles can only reach up to 14 pounds and measure three feet long, with a seven-foot wingspan. #TwitterNatureCommunity #TwitterNaturePhotography #birds #BirdsOfTwitter #birdphotography #birdsofprey #wildlifephotography #NaturePhotographyshow more

The eagle catches rabbits #foryou #fyp #animal #rabbits #DiceRoll #eagle