Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Updated the llama.vim plugin to support speculative FIM It now generates the next suggestion while you review the current one. If you accept it, the next suggestion is available immediately.

Georgi Gerganov

71,048 subscribers

28,337 views • 1 year ago •via X (Twitter)

Education Science & Technology

Anya Rossi• Live Now

Private livecam show

11 Comments

Siddhartha Golu1 year ago

Looks amazing! I've been running it for the past few days and loving it. Any way to figure out the optimal settings for a machine? Is llama-bench a good tool for that? I'm using Qwen-2.5-coder-7B_q8 on a 64 GB M1 and wondering if I can optimize it some more.

Georgi Gerganov1 year ago

Definitely try the updated version from today. 7B on M1 might be a bit too much. I would probably go with 3B on that machine.

OPEN1 year ago

From the wilderness to futuristic cities, your OP3N adventure starts here. Join our Discord channel and become part of the community!

Carlos DP1 year ago

What plugin gives the cursor motion blur like that?

Georgi Gerganov1 year ago

It's a feature of the terminal emulator - kitty

iplayfast1 year ago

Is this on the github repo?

Georgi Gerganov1 year ago

The plugin is here:

Devin J. Dawson1 year ago

wow

Rudi Servo1 year ago

Sorry to ask, I am a bit dum on this, how do you get this working with lazyvim?

kfant1 year ago

VIM 🤭

Ylber1 year ago

this looks great

Related Videos

Q: The suggestion you made was that if Zelenskyy doesn't accept it, the US will pull back its support for Ukraine Trump: You remember right in the Oval Office I said, 'You don't have the cards'

Q: The suggestion you made was that if Zelenskyy doesn't accept it, the US will pull back its support for Ukraine Trump: You remember right in the Oval Office I said, 'You don't have the cards'

Republicans against Trump

331,567 views • 10 months ago

"As I speak to you, states are rolling out preparations to deploy state police. I have just one demand and one suggestion: Is it possible, or can the administration simply say, 'We will not deploy state police before the next election'? Because if you're rolling out state police between now and the next election, it is unrealistic." — Chidi Odinkalu 🎥: MIC ON PODCAST

"As I speak to you, states are rolling out preparations to deploy state police. I have just one demand and one suggestion: Is it possible, or can the administration simply say, 'We will not deploy state police before the next election'? Because if you're rolling out state police between now and the next election, it is unrealistic." — Chidi Odinkalu 🎥: MIC ON PODCAST

TheCable

66,386 views • 2 months ago

You don't have to make a deal with the devil to try The Killing Stone early because... 🩸 The demo is available NOW as part of Steam Next Fest! Check it out and leave us a review if you like it!

You don't have to make a deal with the devil to try The Killing Stone early because... 🩸 The demo is available NOW as part of Steam Next Fest! Check it out and leave us a review if you like it!

Question

35,216 views • 11 months ago

Reporter: The suggestion you made was that if Zelensky doesn't accept the deal, the US will pull back its support for Ukraine. Trump: At some point he's going to have to accept something (…) In the Oval Office, I said, "You don't have the cards."

Reporter: The suggestion you made was that if Zelensky doesn't accept the deal, the US will pull back its support for Ukraine. Trump: At some point he's going to have to accept something (…) In the Oval Office, I said, "You don't have the cards."

Visegrád 24

117,294 views • 10 months ago

Do you remember when they used to spoil the next week's episode immediately after the current one ended?

Do you remember when they used to spoil the next week's episode immediately after the current one ended?

Blaze Binges

35,889 views • 6 months ago

Current Eye Option Design for the Customizable Model ! if you have a suggestion please don't hesitate to comment ! 🥰 #Live2D #MoeCustomizableModel

Current Eye Option Design for the Customizable Model ! if you have a suggestion please don't hesitate to comment ! 🥰 #Live2D #MoeCustomizableModel

｡𖦹°‧Chiffon - MOE Customizable Model OUT NOW 🐾

13,208 views • 3 months ago

This 1983 commercial is flagged by YOUR AI for subliminal suggestions. Now at first I did not understand. But the AI found the suggestion pitched to the female cohort. Once you get it, it is quite interesting. I train AI to look out for you. This is just one way. WARNING:

This 1983 commercial is flagged by YOUR AI for subliminal suggestions. Now at first I did not understand. But the AI found the suggestion pitched to the female cohort. Once you get it, it is quite interesting. I train AI to look out for you. This is just one way. WARNING:

Brian Roemmele

148,028 views • 8 months ago

What would YOU name this colorway? Leave a suggestion in the comments. The most Liked will be featured in a poll next week. And you can vote for the next Field Cloak and Poncho name!

What would YOU name this colorway? Leave a suggestion in the comments. The most Liked will be featured in a poll next week. And you can vote for the next Field Cloak and Poncho name!

Five Star Alterations

11,232 views • 10 months ago

the advice wonwoo’s mom gave to him 🤍 "whatever it is, cherish it while it is next to you"

the advice wonwoo’s mom gave to him 🤍 "whatever it is, cherish it while it is next to you"

tracy 🐱

282,157 views • 3 years ago

“Next one is the big one. If you get it back to Edmonton, you feel pretty good.” Elliotte Friedman on the Oilers keeping their season alive.

“Next one is the big one. If you get it back to Edmonton, you feel pretty good.” Elliotte Friedman on the Oilers keeping their season alive.

Sportsnet

21,214 views • 5 months ago

There's a gap between finishing one feature and starting the next. There's pressure to fill it immediately. That gap is where you work on your futures—the things that make the next feature easier.

There's a gap between finishing one feature and starting the next. There's pressure to fill it immediately. That gap is where you work on your futures—the things that make the next feature easier.

Kent Beck 🌻

19,339 views • 8 months ago

THANK YOU for making Amanda the Adventurer 2 one of the MOST PLAYED DEMOS in the Steam Next Fest! The demo is still available, so if you haven't checked it out, now's the time! THANK YOU AGAIN!

THANK YOU for making Amanda the Adventurer 2 one of the MOST PLAYED DEMOS in the Steam Next Fest! The demo is still available, so if you haven't checked it out, now's the time! THANK YOU AGAIN!

Amanda the Adventurer 3

67,784 views • 2 years ago

Some footage of the mighty Tyne Bridge I shot yesterday. #Newcastle is littered with landmarks when you look at it. (Soundtrack updated as per Craig Wright's suggestion. Thanks, Lindisfarne the band !) #Tyneside #NUFC

Some footage of the mighty Tyne Bridge I shot yesterday. #Newcastle is littered with landmarks when you look at it. (Soundtrack updated as per Craig Wright's suggestion. Thanks, Lindisfarne the band !) #Tyneside #NUFC

Michael Bailey Photography

17,570 views • 8 months ago

🐹: you (🐻) can flip the next one. 🐹: you can try the next one if this falls apart, okay? 🐹: namjoon, can you photograph this? "What if he flings it? Then, he flings it."

🐹: you (🐻) can flip the next one. 🐹: you can try the next one if this falls apart, okay? 🐹: namjoon, can you photograph this? "What if he flings it? Then, he flings it."

JA

18,535 views • 8 months ago

This is one of my favorite movie endings... It has a powerful lesson: "At some point, everything is going to go south on you...and you're gonna say 'this is it, this is how I end.' Now you can either accept that, or you can get to work. That's all it is, you just begin. You do the math. You solve one problem. Then you solve the next one. And the next. And if you solve enough problems, you get to come home." This is the beautiful thing about life: No matter where you are today—no matter how deep in the darkness—you are always just one good decision away from being in a better place tomorrow. You can always focus on that one decision—that one problem—in front of you. Don't worry about the hundreds or thousands of decisions that you still have to make to get to where you want to be—just focus on the next decision. Just begin. Solve one problem. Then solve the next one. And the next. "Life is really simple, but we insist on making it complicated." - Confucius

This is one of my favorite movie endings... It has a powerful lesson: "At some point, everything is going to go south on you...and you're gonna say 'this is it, this is how I end.' Now you can either accept that, or you can get to work. That's all it is, you just begin. You do the math. You solve one problem. Then you solve the next one. And the next. And if you solve enough problems, you get to come home." This is the beautiful thing about life: No matter where you are today—no matter how deep in the darkness—you are always just one good decision away from being in a better place tomorrow. You can always focus on that one decision—that one problem—in front of you. Don't worry about the hundreds or thousands of decisions that you still have to make to get to where you want to be—just focus on the next decision. Just begin. Solve one problem. Then solve the next one. And the next. "Life is really simple, but we insist on making it complicated." - Confucius

Sahil Bloom

213,822 views • 2 years ago

This video is for northerners. Note: If you think it doesn’t concern you, you might end up being the next victim. The choice is yours; either you act NOW or wait until you become the next victim!

This video is for northerners. Note: If you think it doesn’t concern you, you might end up being the next victim. The choice is yours; either you act NOW or wait until you become the next victim!

Altaaf

16,050 views • 2 years ago

Once more suggestion: if you find the collar itchy, tie a bandana around your neck and stuff the points underneath your sweater. It will provide comfort but also stay hidden. Second video shows how to tie one while reducing the bulk of the knot. IG sarah.corbettwinder

Once more suggestion: if you find the collar itchy, tie a bandana around your neck and stuff the points underneath your sweater. It will provide comfort but also stay hidden. Second video shows how to tie one while reducing the bulk of the knot. IG sarah.corbettwinder

derek guy

256,354 views • 1 year ago

🇺🇸 THIS TESLA PATTERN SAYS THE NEXT TARGET IS $680. The same support level has always pushed $TSLA to the same resistance level. If this patterns repeats, $680 is the next target and it looks identical to last time it hit this level. Most people are afraid to buy right now. Are you?

🇺🇸 THIS TESLA PATTERN SAYS THE NEXT TARGET IS $680. The same support level has always pushed $TSLA to the same resistance level. If this patterns repeats, $680 is the next target and it looks identical to last time it hit this level. Most people are afraid to buy right now. Are you?

CoinForge

24,290 views • 4 months ago

"If it was me running the #USMNT, I'd go "Hey, here's a blank check."" Troy Deeney has an interesting suggestion for Pep Guardiola's next role 👀🇺🇸

"If it was me running the #USMNT, I'd go "Hey, here's a blank check."" Troy Deeney has an interesting suggestion for Pep Guardiola's next role 👀🇺🇸

CBS Sports Golazo ⚽️

32,734 views • 4 months ago