Загрузка видео...

Не удалось загрузить видео

На главную

EAGLE-3 introduces two key innovations: Training-Time Testing (TTT) and multi-level feature fusion. By removing the feature prediction constraint used in previous EAGLE versions and leveraging semantic features across multiple layers, EAGLE-3 achieves higher acceptance rates, faster generation, and lossless performance. The result? - 5.6× faster than vanilla decoding (13B)...

EagleCorp's profile picture

Eagle

1,930 subscribers

36,920 просмотров • 14 дней назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Can $300 RTX3060 be faster than $10,000 A100 for LLM decoding?🧐Yes Introduce EAGLE-2: - 4.26x🚀vanilla (13B) - 1.4x🚀EAGLE (13B) - No extra training than EAGLE - Maintain distribution Paper: Code: Demo:
0:13

Can $300 RTX3060 be faster than $10,000 A100 for LLM decoding?🧐Yes Introduce EAGLE-2: - 4.26x🚀vanilla (13B) - 1.4x🚀EAGLE (13B) - No extra training than EAGLE - Maintain distribution Paper: Code: Demo:

Hongyang Zhang

35,677 просмотров • 2 лет назад

The falcon thinks the eagle is his mother and asks the eagle to feed him
0:18

The falcon thinks the eagle is his mother and asks the eagle to feed him

Nature is Amazing ☘️

8,105,732 просмотров • 2 лет назад

The falcon thinks the eagle is his mother and asks the eagle to feed him
0:18

The falcon thinks the eagle is his mother and asks the eagle to feed him

Damn Nature You Scary

74,621 просмотров • 4 месяцев назад

The falcon thinks the eagle is his mother and asks the eagle to feed him
0:18

The falcon thinks the eagle is his mother and asks the eagle to feed him

Nature is Amazing ☘️

670,959 просмотров • 8 месяцев назад

Introduce EAGLE, a new method for fast LLM decoding based on compression: - 3x🚀than vanilla - 2x🚀 than Lookahead (on its benchmark) - 1.6x🚀 than Medusa (on its benchmark) - provably maintains text distribution - trainable (in 1~2 days) and testable on RTX 3090s Playground: Blog: Code: ⚒️First Principle: Compression! Yi Ma We find that the sequence of second-top-layer features is compressible, making the prediction of subsequent feature vectors from previous ones easy by a small model. 🙏Acknowledge: This project is greatly inspired by the Medusa team (Tianle Cai @yli3521 Zhengyang Geng Hongwu Peng Tri Dao), the Lookahead team (Hao Zhang LMSYS Org), and others. Joint work with Yuhui Li and Chao Zhang
0:15

Introduce EAGLE, a new method for fast LLM decoding based on compression: - 3x🚀than vanilla - 2x🚀 than Lookahead (on its benchmark) - 1.6x🚀 than Medusa (on its benchmark) - provably maintains text distribution - trainable (in 1~2 days) and testable on RTX 3090s Playground: Blog: Code: ⚒️First Principle: Compression! Yi Ma We find that the sequence of second-top-layer features is compressible, making the prediction of subsequent feature vectors from previous ones easy by a small model. 🙏Acknowledge: This project is greatly inspired by the Medusa team (Tianle Cai @yli3521 Zhengyang Geng Hongwu Peng Tri Dao), the Lookahead team (Hao Zhang LMSYS Org), and others. Joint work with Yuhui Li and Chao Zhang

Hongyang Zhang

118,810 просмотров • 2 лет назад

Martial eagle (Slide 1) is stronger than bald eagle (Slide 2). It is also a better hunter. It can take down larger, more challenging prey like antelopes or monitor lizards, unlike the bald eagle which relies more on fish and scavenging. The martial eagle’s predatory style is also more aggressive and versatile. Why is the bald eagle now used more by people? That is the power of marketing. The bald eagle is the national bird of the United States. It has been packaged in movies and clips to look more regal and powerful. They even replace its sound with a louder and more majestic call of a red tailed hawk. Watch the second clip and you'll hear their natural sounds. Also, when you type "eagle," the emoji that comes out is 🦅 which is that of bald eagle. That's the power of PR.
0:14

Martial eagle (Slide 1) is stronger than bald eagle (Slide 2). It is also a better hunter. It can take down larger, more challenging prey like antelopes or monitor lizards, unlike the bald eagle which relies more on fish and scavenging. The martial eagle’s predatory style is also more aggressive and versatile. Why is the bald eagle now used more by people? That is the power of marketing. The bald eagle is the national bird of the United States. It has been packaged in movies and clips to look more regal and powerful. They even replace its sound with a louder and more majestic call of a red tailed hawk. Watch the second clip and you'll hear their natural sounds. Also, when you type "eagle," the emoji that comes out is 🦅 which is that of bald eagle. That's the power of PR.

Arojinle

99,727 просмотров • 9 месяцев назад

last time i posted a clip K-Brad told me to react to the obvious eagle spike..so i went and reacted to the fucking eagle spike👽
0:17

last time i posted a clip K-Brad told me to react to the obvious eagle spike..so i went and reacted to the fucking eagle spike👽

Fiesty

56,105 просмотров • 1 год назад

An eagle for Ian Woosnam! The 1991 Masters Champion secures an eagle with his putt on the 16th hole🦅 #SeniorOpen
0:19

An eagle for Ian Woosnam! The 1991 Masters Champion secures an eagle with his putt on the 16th hole🦅 #SeniorOpen

DP World Tour

24,256 просмотров • 11 месяцев назад

1/6 Saving Eddie The Eagle - A Thread Eddie the Eagle was in terrible pain & all alone with what looked like a broken leg The ambulance arrived to help him Read on 🧵⬇️
0:10

1/6 Saving Eddie The Eagle - A Thread Eddie the Eagle was in terrible pain & all alone with what looked like a broken leg The ambulance arrived to help him Read on 🧵⬇️

Dog Desk Animal Action

36,003 просмотров • 1 год назад

The Harpy Eagle is the most powerful eagle in the world. Its wingspan can reach to 7.5 feet of width.
0:10

The Harpy Eagle is the most powerful eagle in the world. Its wingspan can reach to 7.5 feet of width.

Massimo

18,700 просмотров • 8 месяцев назад

Grace Kim makes the eagle putt on 18 to get to -14 and force the playoff 💪
0:13

Grace Kim makes the eagle putt on 18 to get to -14 and force the playoff 💪

LPGA

16,139 просмотров • 11 месяцев назад

See the talons on this eagle! 😳
0:10

See the talons on this eagle! 😳

Arojinle

58,235 просмотров • 7 месяцев назад

"Coach me on how you carry the football?" 1. Eagle Claw 2. Bicep 3. Up to your Chin 4. Across the (Chest) Plate 5. Clasp the Wrist Ball Security is Job Security!
0:17

"Coach me on how you carry the football?" 1. Eagle Claw 2. Bicep 3. Up to your Chin 4. Across the (Chest) Plate 5. Clasp the Wrist Ball Security is Job Security!

Coach Dan Casey

198,607 просмотров • 2 лет назад

EAGLE! 🦅 The first 3 at 16 this week. Wyndham Clark leads the U.S. Open by SEVEN.
0:17

EAGLE! 🦅 The first 3 at 16 this week. Wyndham Clark leads the U.S. Open by SEVEN.

U.S. Open

61,611 просмотров • 5 дней назад

The chip-in. 💯💪 Cards an eagle on the 11th to get to T3
0:17

The chip-in. 💯💪 Cards an eagle on the 11th to get to T3

Charley Hull

29,913 просмотров • 9 месяцев назад

Watch out ⚠️ Jeeno drains the eagle on 17 to tie the lead at -21!
0:13

Watch out ⚠️ Jeeno drains the eagle on 17 to tie the lead at -21!

LPGA

11,481 просмотров • 1 год назад

Off the green, on the money. Eagle for Scheffler. #PGAChamp
0:16

Off the green, on the money. Eagle for Scheffler. #PGAChamp

PGA Championship

16,177 просмотров • 1 год назад

The bald eagle as a messenger between earth and the creator, was carrying prayers on its wings to heaven 🙏
0:13

The bald eagle as a messenger between earth and the creator, was carrying prayers on its wings to heaven 🙏

Hatton, America is back

24,067 просмотров • 11 месяцев назад

🚨🚨🚨 EAGLE 🦅🦅🦅 TIGER WOODS HAS MADE EAGLE AT 18. HIS 2ND EAGLE OF THE BACK 9. YOU KIDDING ME 😵 NUCLR. ☢️
0:14

🚨🚨🚨 EAGLE 🦅🦅🦅 TIGER WOODS HAS MADE EAGLE AT 18. HIS 2ND EAGLE OF THE BACK 9. YOU KIDDING ME 😵 NUCLR. ☢️

TWLEGION

593,103 просмотров • 1 год назад