Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

EAGLE-3 introduces two key innovations: Training-Time Testing (TTT) and multi-level feature fusion. By removing the feature prediction constraint used in previous EAGLE versions and leveraging semantic features across multiple layers, EAGLE-3 achieves higher acceptance rates, faster generation, and lossless performance. The result? - 5.6× faster than vanilla decoding (13B)...

EagleCorp's profile picture

Eagle

1,930 subscribers

36,920 görüntüleme • 13 gün önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Can $300 RTX3060 be faster than $10,000 A100 for LLM decoding?🧐Yes Introduce EAGLE-2: - 4.26x🚀vanilla (13B) - 1.4x🚀EAGLE (13B) - No extra training than EAGLE - Maintain distribution Paper: Code: Demo:
0:13

Can $300 RTX3060 be faster than $10,000 A100 for LLM decoding?🧐Yes Introduce EAGLE-2: - 4.26x🚀vanilla (13B) - 1.4x🚀EAGLE (13B) - No extra training than EAGLE - Maintain distribution Paper: Code: Demo:

Hongyang Zhang

35,677 görüntüleme • 2 yıl önce

The falcon thinks the eagle is his mother and asks the eagle to feed him
0:18

The falcon thinks the eagle is his mother and asks the eagle to feed him

Damn Nature You Scary

74,621 görüntüleme • 4 ay önce

The falcon thinks the eagle is his mother and asks the eagle to feed him
0:18

The falcon thinks the eagle is his mother and asks the eagle to feed him

Nature is Amazing ☘️

8,105,726 görüntüleme • 2 yıl önce

The falcon thinks the eagle is his mother and asks the eagle to feed him
0:18

The falcon thinks the eagle is his mother and asks the eagle to feed him

Nature is Amazing ☘️

670,959 görüntüleme • 8 ay önce

Introduce EAGLE, a new method for fast LLM decoding based on compression: - 3x🚀than vanilla - 2x🚀 than Lookahead (on its benchmark) - 1.6x🚀 than Medusa (on its benchmark) - provably maintains text distribution - trainable (in 1~2 days) and testable on RTX 3090s Playground: Blog: Code: ⚒️First Principle: Compression! Yi Ma We find that the sequence of second-top-layer features is compressible, making the prediction of subsequent feature vectors from previous ones easy by a small model. 🙏Acknowledge: This project is greatly inspired by the Medusa team (Tianle Cai @yli3521 Zhengyang Geng Hongwu Peng Tri Dao), the Lookahead team (Hao Zhang LMSYS Org), and others. Joint work with Yuhui Li and Chao Zhang
0:15

Introduce EAGLE, a new method for fast LLM decoding based on compression: - 3x🚀than vanilla - 2x🚀 than Lookahead (on its benchmark) - 1.6x🚀 than Medusa (on its benchmark) - provably maintains text distribution - trainable (in 1~2 days) and testable on RTX 3090s Playground: Blog: Code: ⚒️First Principle: Compression! Yi Ma We find that the sequence of second-top-layer features is compressible, making the prediction of subsequent feature vectors from previous ones easy by a small model. 🙏Acknowledge: This project is greatly inspired by the Medusa team (Tianle Cai @yli3521 Zhengyang Geng Hongwu Peng Tri Dao), the Lookahead team (Hao Zhang LMSYS Org), and others. Joint work with Yuhui Li and Chao Zhang

Hongyang Zhang

118,810 görüntüleme • 2 yıl önce

Martial eagle (Slide 1) is stronger than bald eagle (Slide 2). It is also a better hunter. It can take down larger, more challenging prey like antelopes or monitor lizards, unlike the bald eagle which relies more on fish and scavenging. The martial eagle’s predatory style is also more aggressive and versatile. Why is the bald eagle now used more by people? That is the power of marketing. The bald eagle is the national bird of the United States. It has been packaged in movies and clips to look more regal and powerful. They even replace its sound with a louder and more majestic call of a red tailed hawk. Watch the second clip and you'll hear their natural sounds. Also, when you type "eagle," the emoji that comes out is 🦅 which is that of bald eagle. That's the power of PR.
0:14

Martial eagle (Slide 1) is stronger than bald eagle (Slide 2). It is also a better hunter. It can take down larger, more challenging prey like antelopes or monitor lizards, unlike the bald eagle which relies more on fish and scavenging. The martial eagle’s predatory style is also more aggressive and versatile. Why is the bald eagle now used more by people? That is the power of marketing. The bald eagle is the national bird of the United States. It has been packaged in movies and clips to look more regal and powerful. They even replace its sound with a louder and more majestic call of a red tailed hawk. Watch the second clip and you'll hear their natural sounds. Also, when you type "eagle," the emoji that comes out is 🦅 which is that of bald eagle. That's the power of PR.

Arojinle

99,727 görüntüleme • 9 ay önce

last time i posted a clip K-Brad told me to react to the obvious eagle spike..so i went and reacted to the fucking eagle spike👽
0:17

last time i posted a clip K-Brad told me to react to the obvious eagle spike..so i went and reacted to the fucking eagle spike👽

Fiesty

56,105 görüntüleme • 1 yıl önce

An eagle for Ian Woosnam! The 1991 Masters Champion secures an eagle with his putt on the 16th hole🦅 #SeniorOpen
0:19

An eagle for Ian Woosnam! The 1991 Masters Champion secures an eagle with his putt on the 16th hole🦅 #SeniorOpen

DP World Tour

24,256 görüntüleme • 11 ay önce

1/6 Saving Eddie The Eagle - A Thread Eddie the Eagle was in terrible pain & all alone with what looked like a broken leg The ambulance arrived to help him Read on 🧵⬇️
0:10

1/6 Saving Eddie The Eagle - A Thread Eddie the Eagle was in terrible pain & all alone with what looked like a broken leg The ambulance arrived to help him Read on 🧵⬇️

Dog Desk Animal Action

36,003 görüntüleme • 1 yıl önce

The Harpy Eagle is the most powerful eagle in the world. Its wingspan can reach to 7.5 feet of width.
0:10

The Harpy Eagle is the most powerful eagle in the world. Its wingspan can reach to 7.5 feet of width.

Massimo

18,700 görüntüleme • 8 ay önce

Grace Kim makes the eagle putt on 18 to get to -14 and force the playoff 💪
0:13

Grace Kim makes the eagle putt on 18 to get to -14 and force the playoff 💪

LPGA

16,139 görüntüleme • 11 ay önce

See the talons on this eagle! 😳
0:10

See the talons on this eagle! 😳

Arojinle

58,235 görüntüleme • 7 ay önce

"Coach me on how you carry the football?" 1. Eagle Claw 2. Bicep 3. Up to your Chin 4. Across the (Chest) Plate 5. Clasp the Wrist Ball Security is Job Security!
0:17

"Coach me on how you carry the football?" 1. Eagle Claw 2. Bicep 3. Up to your Chin 4. Across the (Chest) Plate 5. Clasp the Wrist Ball Security is Job Security!

Coach Dan Casey

198,607 görüntüleme • 2 yıl önce

EAGLE! 🦅 The first 3 at 16 this week. Wyndham Clark leads the U.S. Open by SEVEN.
0:17

EAGLE! 🦅 The first 3 at 16 this week. Wyndham Clark leads the U.S. Open by SEVEN.

U.S. Open

59,872 görüntüleme • 3 gün önce

The chip-in. 💯💪 Cards an eagle on the 11th to get to T3
0:17

The chip-in. 💯💪 Cards an eagle on the 11th to get to T3

Charley Hull

29,913 görüntüleme • 9 ay önce

Watch out ⚠️ Jeeno drains the eagle on 17 to tie the lead at -21!
0:13

Watch out ⚠️ Jeeno drains the eagle on 17 to tie the lead at -21!

LPGA

11,481 görüntüleme • 1 yıl önce

Off the green, on the money. Eagle for Scheffler. #PGAChamp
0:16

Off the green, on the money. Eagle for Scheffler. #PGAChamp

PGA Championship

16,177 görüntüleme • 1 yıl önce

The bald eagle as a messenger between earth and the creator, was carrying prayers on its wings to heaven 🙏
0:13

The bald eagle as a messenger between earth and the creator, was carrying prayers on its wings to heaven 🙏

Hatton, America is back

24,067 görüntüleme • 11 ay önce

🚨🚨🚨 EAGLE 🦅🦅🦅 TIGER WOODS HAS MADE EAGLE AT 18. HIS 2ND EAGLE OF THE BACK 9. YOU KIDDING ME 😵 NUCLR. ☢️
0:14

🚨🚨🚨 EAGLE 🦅🦅🦅 TIGER WOODS HAS MADE EAGLE AT 18. HIS 2ND EAGLE OF THE BACK 9. YOU KIDDING ME 😵 NUCLR. ☢️

TWLEGION

593,103 görüntüleme • 1 yıl önce