EAGLE-3 introduces two key innovations: Training-Time Testing (TTT) and... multi-level feature fusion. By removing the feature prediction constraint used in previous EAGLE versions and leveraging semantic features across multiple layers, EAGLE-3 achieves higher acceptance rates, faster generation, and lossless performance. The result? - 5.6× faster than vanilla decoding (13B) Compared to EAGLE-1, EAGLE-3 delivers a 1.8× speedup on the 13B model, with the future EAGLE-4 release expected to further improve decoding efficiency. *Inference on the video conducted on 2x RTX 3090 GPUs at fp16 precision using the Vicuna 13B model.show more

Can $300 RTX3060 be faster than $10,000 A100 for... LLM decoding?🧐Yes Introduce EAGLE-2: - 4.26x🚀vanilla (13B) - 1.4x🚀EAGLE (13B) - No extra training than EAGLE - Maintain distribution Paper: Code: Demo:show more

The falcon thinks the eagle is his mother and... asks the eagle to feed himshow more

The falcon thinks the eagle is his mother and... asks the eagle to feed himshow more

The falcon thinks the eagle is his mother and... asks the eagle to feed himshow more

Introduce EAGLE, a new method for fast LLM decoding... based on compression: - 3x🚀than vanilla - 2x🚀 than Lookahead (on its benchmark) - 1.6x🚀 than Medusa (on its benchmark) - provably maintains text distribution - trainable (in 1~2 days) and testable on RTX 3090s Playground: Blog: Code: ⚒️First Principle: Compression! Yi Ma We find that the sequence of second-top-layer features is compressible, making the prediction of subsequent feature vectors from previous ones easy by a small model. 🙏Acknowledge: This project is greatly inspired by the Medusa team (Tianle Cai @yli3521 Zhengyang Geng Hongwu Peng Tri Dao), the Lookahead team (Hao Zhang LMSYS Org), and others. Joint work with Yuhui Li and Chao Zhangshow more

Martial eagle (Slide 1) is stronger than bald eagle... (Slide 2). It is also a better hunter. It can take down larger, more challenging prey like antelopes or monitor lizards, unlike the bald eagle which relies more on fish and scavenging. The martial eagle’s predatory style is also more aggressive and versatile. Why is the bald eagle now used more by people? That is the power of marketing. The bald eagle is the national bird of the United States. It has been packaged in movies and clips to look more regal and powerful. They even replace its sound with a louder and more majestic call of a red tailed hawk. Watch the second clip and you'll hear their natural sounds. Also, when you type "eagle," the emoji that comes out is 🦅 which is that of bald eagle. That's the power of PR.show more

last time i posted a clip K-Brad told me... to react to the obvious eagle spike..so i went and reacted to the fucking eagle spike👽show more

An eagle for Ian Woosnam! The 1991 Masters Champion... secures an eagle with his putt on the 16th hole🦅 #SeniorOpenshow more

1/6 Saving Eddie The Eagle - A Thread Eddie... the Eagle was in terrible pain & all alone with what looked like a broken leg The ambulance arrived to help him Read on 🧵⬇️show more

Chip-in eagle for Harry Hall 🦅 This is the... first eagle of the week on No. 17 Valero Texas Open.show more

The Harpy Eagle is the most powerful eagle in... the world. Its wingspan can reach to 7.5 feet of width.show more

Grace Kim makes the eagle putt on 18 to... get to -14 and force the playoff 💪show more

See the talons on this eagle! 😳

"Coach me on how you carry the football?" 1.... Eagle Claw 2. Bicep 3. Up to your Chin 4. Across the (Chest) Plate 5. Clasp the Wrist Ball Security is Job Security!show more

The chip-in. 💯💪 Cards an eagle on the 11th... to get to T3show more

EAGLE! 🦅 The first 3 at 16 this week.... Wyndham Clark leads the U.S. Open by SEVEN.show more

Watch out ⚠️ Jeeno drains the eagle on 17... to tie the lead at -21!show more

The bald eagle as a messenger between earth and... the creator, was carrying prayers on its wings to heaven 🙏show more