llama.vscode (powered by Qwen Coder)
@ggerganov63K followers
77,668 views
9 Comments
Comments from the original post on X (Twitter)

@ggerganov
This is a lightweight and very efficient VS Code extension using llama.cpp directly to provide local LLM-assisted code and text completions:
60 likes

@ggerganov
The llama.cpp server provides unique context reuse techniques that allow you to efficiently use large contexts to enhance the completions based on the contents of your codebase. The setup is simple, no RAG is necessary and the performance is good even on low-end hardware. Enjoy!
32 likes

@yondifon
nvim?? 🥹🥹
3 likes

@ggerganov
i got you pal
4 likes

@daniel_nguyenx
Great work. Thanks
1 like

@neilsuperduper
Lets go! Nice work.

@Hormold
Great start!

@raw_works
wow - thank you so much for giving the different suggestions for different hardware (RAM). two follow up questions: - can i do this on PC? (my PC happens to have way more GPU/RAM) - from a purely personal perspective - what is the minimum "useful" RAM for this?

@ggerganov
Yes, this runs on Mac, Linux and Windows - see the setup instructions in the readme. The 7B models are pretty good, so if you can run this (i.e. ~8GB of VRAM) then go for this. Otherwise - use the 3B model (~4GB)
3 likes