Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Up to 3x faster LLM generation with no extra resources/requirements - ngram speculation has landed in 🤗 transformers! 🏎️💨 All you need to do is to add `prompt_lookup_num_tokens=10` to your `generate` call and you'll get faster LLMs🔥 🧵How does it work?

joao_gante's profile picture

João Gante

3,356 subscribers

107,778 görüntüleme • 2 yıl önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

🏎️💨 Publishing in Rebolt used to take 120 seconds, now 15 (x8 faster) One random chat with Manuel Suarez made it happen It was number #1 complaint. Slow, opaque, and unreliable. We've rearchitected how the systems works. This is the result: ➡︎ From ~2 minutes to 15 seconds (8× faster). ➡︎ See which version is live with a live preview ➡︎ Errors were frequent and hard to debug. Now you can fix them with one click, no need to contact us! ↓ If you're interested in the story behind the new architecture, let us know and we'll write a blog post
0:15

🏎️💨 Publishing in Rebolt used to take 120 seconds, now 15 (x8 faster) One random chat with Manuel Suarez made it happen It was number #1 complaint. Slow, opaque, and unreliable. We've rearchitected how the systems works. This is the result: ➡︎ From ~2 minutes to 15 seconds (8× faster). ➡︎ See which version is live with a live preview ➡︎ Errors were frequent and hard to debug. Now you can fix them with one click, no need to contact us! ↓ If you're interested in the story behind the new architecture, let us know and we'll write a blog post

Javi

19,018 görüntüleme • 10 ay önce

The Superhive Spring Sale is LIVE! Get the Blender tools you need to get your work done faster... for 25% less. But hurry, this sale ends in 6 days!
0:11

The Superhive Spring Sale is LIVE! Get the Blender tools you need to get your work done faster... for 25% less. But hurry, this sale ends in 6 days!

Superhive (formerly Blender Market)

12,072 görüntüleme • 1 yıl önce

Introducing 𝗦𝘂𝗽𝗲𝗿 𝗝𝗦𝗢𝗡 𝗠𝗼𝗱𝗲, a framework for low latency structured output generation from LLMs. Generate JSON up to 𝟮𝟬𝘅 𝗳𝗮𝘀𝘁𝗲𝗿 from OpenAI and open source models. ❌ No need to threaten the model, tip the AI, etc ❌ Built with Alex Derhacobian 🔧 🧵👇
0:14

Introducing 𝗦𝘂𝗽𝗲𝗿 𝗝𝗦𝗢𝗡 𝗠𝗼𝗱𝗲, a framework for low latency structured output generation from LLMs. Generate JSON up to 𝟮𝟬𝘅 𝗳𝗮𝘀𝘁𝗲𝗿 from OpenAI and open source models. ❌ No need to threaten the model, tip the AI, etc ❌ Built with Alex Derhacobian 🔧 🧵👇

Varun Shenoy

166,182 görüntüleme • 2 yıl önce

Dark Zone grinders, your time is now! XP Boost Event live from June 17 to 24. ⚡ 3x XP on all activities 🛡️ No XP loss on death 🔥 Level up your rank faster than ever
0:17

Dark Zone grinders, your time is now! XP Boost Event live from June 17 to 24. ⚡ 3x XP on all activities 🛡️ No XP loss on death 🔥 Level up your rank faster than ever

Tom Clancy's The Division

59,637 görüntüleme • 1 yıl önce

Stop Scrolling. Get back to Work. Someone has to take action to make your dreams come true, And no one else is going to do it. So you have to.
0:12

Stop Scrolling. Get back to Work. Someone has to take action to make your dreams come true, And no one else is going to do it. So you have to.

Andrew Tate

1,368,406 görüntüleme • 3 yıl önce

Ye was the reason Jay became a billionaire FASTER never said he couldn’t have on his own but the fact someone has the power to accelerate your growth and get you to where you need to FASTER IN ONE LIFETIME THAT SHIT IS PRICELESS and all Ye ever wanted was a community of brothers Everyone owes Ye HE will always be the first hip hop billionaire
0:11

Ye was the reason Jay became a billionaire FASTER never said he couldn’t have on his own but the fact someone has the power to accelerate your growth and get you to where you need to FASTER IN ONE LIFETIME THAT SHIT IS PRICELESS and all Ye ever wanted was a community of brothers Everyone owes Ye HE will always be the first hip hop billionaire

WEST DAY EVER

251,333 görüntüleme • 9 ay önce

❓If you woke up in the morning and had missed calls from mamamoo members, who would you call first? 🐶 yongsun unnie because she’s the leader. you probably have to call to sort it out anyway, and it will get sorted faster if i call her.
0:17

❓If you woke up in the morning and had missed calls from mamamoo members, who would you call first? 🐶 yongsun unnie because she’s the leader. you probably have to call to sort it out anyway, and it will get sorted faster if i call her.

수박 🍉

34,483 görüntüleme • 4 ay önce

The longevity exercise no one over 40 is doing: Plyometrics. You lose your power to jump faster than you lose strength or muscle. And almost no one knows how to rebuild it. Here are 7 beginner plyometric exercises to get you jumping again (without injuries):
0:10

The longevity exercise no one over 40 is doing: Plyometrics. You lose your power to jump faster than you lose strength or muscle. And almost no one knows how to rebuild it. Here are 7 beginner plyometric exercises to get you jumping again (without injuries):

Ted Ryce

64,839 görüntüleme • 1 ay önce

Hate your over the top move? Where the hands stay up as you rotate into your downswing creating pulls and slices? Here is a great drill for you to get your arms down faster to bring your hand and club path more from the inside that you can do a lot at home. Great way to work
0:10

Hate your over the top move? Where the hands stay up as you rotate into your downswing creating pulls and slices? Here is a great drill for you to get your arms down faster to bring your hand and club path more from the inside that you can do a lot at home. Great way to work

Jayson Nickol

55,618 görüntüleme • 6 ay önce

omg.. just found a way to install&use Clawdbot in 2 mins no need mac mini, API keys, just one click to set up everything automatically and get personal AI assistant to work for you 24/7 here's how and what you can do with it:
0:17

omg.. just found a way to install&use Clawdbot in 2 mins no need mac mini, API keys, just one click to set up everything automatically and get personal AI assistant to work for you 24/7 here's how and what you can do with it:

el.cine

3,323,666 görüntüleme • 7 ay önce

6-step MiniMax H3 Turbo Generation with Maestro! Blaine Brown has implemented MiniMax H3 Turbo LoRA into Maestro, and now you can generate videos faster! You will need to use the full model (not pruned), select the turbo mode, and finally, if you have low VRAM (not 24GB+), recommend switching to 480p instead of the default 768p
0:17

6-step MiniMax H3 Turbo Generation with Maestro! Blaine Brown has implemented MiniMax H3 Turbo LoRA into Maestro, and now you can generate videos faster! You will need to use the full model (not pruned), select the turbo mode, and finally, if you have low VRAM (not 24GB+), recommend switching to 480p instead of the default 768p

cocktail peanut

18,541 görüntüleme • 1 ay önce

You put EXTRA cheese on my pizza? You know what cheese does to me! Ugh, it stinks already... Oh no no, where do you think you're going? Because of your mistake, you're going to SOAK up my farts alllll night🍕🍑💨
0:18

Sensitive content

You put EXTRA cheese on my pizza? You know what cheese does to me! Ugh, it stinks already... Oh no no, where do you think you're going? Because of your mistake, you're going to SOAK up my farts alllll night🍕🍑💨

Brat

25,652 görüntüleme • 3 yıl önce

Excited to introduce Orbit - a new API specifically built for coding agents to discover, evaluate, and integrate public APIs. Orbit has two simple tools: search and integrate. All your agent needs to do is describe the task, and Orbit will generate a task brief to integrate the API. Best of all: it is completely free! No auth, no set up. Just add it to Claude, Cursor, OpenCode Devin Desktop or any other coding agent. Check it out here:
0:17

Excited to introduce Orbit - a new API specifically built for coding agents to discover, evaluate, and integrate public APIs. Orbit has two simple tools: search and integrate. All your agent needs to do is describe the task, and Orbit will generate a task brief to integrate the API. Best of all: it is completely free! No auth, no set up. Just add it to Claude, Cursor, OpenCode Devin Desktop or any other coding agent. Check it out here:

Abhinav Asthana

481,674 görüntüleme • 1 ay önce

Dear Catcher, This is Mr. Coach. How dare you do a deflection with your mitt on the 100mph FB spiked at 56’ feet. You need to first get off your knee, slide your body over with two knees down, tuck your chin, and get your barehand behind the ball! - Reality: Nice athletic game-saving stop. Do what you gotta do! Catch first, Stop it second. Hands move faster than the body! I’ve never met a pitcher that tried to intentionally throw a fastball in the dirt.
0:12

Dear Catcher, This is Mr. Coach. How dare you do a deflection with your mitt on the 100mph FB spiked at 56’ feet. You need to first get off your knee, slide your body over with two knees down, tuck your chin, and get your barehand behind the ball! - Reality: Nice athletic game-saving stop. Do what you gotta do! Catch first, Stop it second. Hands move faster than the body! I’ve never met a pitcher that tried to intentionally throw a fastball in the dirt.

Tyler Goodro

990,888 görüntüleme • 1 yıl önce

You know that saying "a picture speaks a thousand words"? Now it... can! In addition to being able to upload images to use in your Flow videos, you can also add speech to the images you upload. Get your pet ready for its close-up and a monologue 🎬 Audio generation on Flow is still experimental, but we're excited for you try it out. Add your videos below ⬇️
0:11

You know that saying "a picture speaks a thousand words"? Now it... can! In addition to being able to upload images to use in your Flow videos, you can also add speech to the images you upload. Get your pet ready for its close-up and a monologue 🎬 Audio generation on Flow is still experimental, but we're excited for you try it out. Add your videos below ⬇️

Google Labs

47,734 görüntüleme • 1 yıl önce

Google introduces #NotebookLM, an #AI-powered notebook for faster learning and insights! 🔥 With it, you can: - Summarize facts + explain ideas. - Generate connections based on chosen sources. - Personalize it with your GDocs. - It's privacy-focused! Link to waitlist below ↓
0:12

Google introduces #NotebookLM, an #AI-powered notebook for faster learning and insights! 🔥 With it, you can: - Summarize facts + explain ideas. - Generate connections based on chosen sources. - Personalize it with your GDocs. - It's privacy-focused! Link to waitlist below ↓

Charly Wargnier

112,980 görüntüleme • 3 yıl önce

After 72 hours in Crimson Desert, I managed to unlock Character Customizations and it's..... meh😅 Anyway, here's how you unlock it. 🔸You need to be minimum chapter 4 on main quest 🔸You need to do Greymane quests and expand your base camp to level 4 🔸On level 4 camp, you'll find new quests to locate your comrades and you'll find your barber!
0:16

After 72 hours in Crimson Desert, I managed to unlock Character Customizations and it's..... meh😅 Anyway, here's how you unlock it. 🔸You need to be minimum chapter 4 on main quest 🔸You need to do Greymane quests and expand your base camp to level 4 🔸On level 4 camp, you'll find new quests to locate your comrades and you'll find your barber!

SpawnYaard 🎮

126,129 görüntüleme • 5 ay önce