Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Here is how to deploy and serve any LLM on HF with a single command in less than 3 minutes with llama.cpp $ bash -c "$(curl -s

ggerganov's profile picture

Georgi Gerganov

62,478 subscribers

143,140 Aufrufe • vor 2 Jahren •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

8 Kommentare

Profilbild von Georgi Gerganov
Georgi Gerganovvor 2 Jahren

More info

Profilbild von Fernando Vidal
Fernando Vidalvor 2 Jahren

Would be cool to have some kind of auth system, where you can have it check against a list of auth tokens before serving the request.

Profilbild von Donneker
Donnekervor 2 Jahren

thanks for the demo, nice done

Profilbild von bornjre
bornjrevor 2 Jahren

Does server binary supports LLaVA/BakLLaVA models ?

Profilbild von wwwwg
wwwwgvor 2 Jahren

@memdotai mem it

Profilbild von Mem
Memvor 2 Jahren

@ggerganov Saved! Here's the compiled thread: 🪄 AI-generated summary: "This thread provides instructions on how to deploy and serve any LLM on HF with a single command in less than 3 minutes using llama.cpp. More information can be found at the...

Profilbild von Tim Wu
Tim Wuvor 2 Jahren

Time to fill up my runpod credits. 😁 It would be lovely if supports llava.

Profilbild von Filippo Broggini
Filippo Brogginivor 2 Jahren

They should have made you CEO of OpenAI 😅😇💪

Ähnliche Videos

Deploy Custom Oracle Feeds In 97 Seconds On SEDA. Watch CTO jasper: - Configure a feed. - Deploy a feed. - Execute request with results In less than 2 minutes....
1:39

Deploy Custom Oracle Feeds In 97 Seconds On SEDA. Watch CTO jasper: - Configure a feed. - Deploy a feed. - Execute request with results In less than 2 minutes....

SEDA

54,189 Aufrufe • vor 1 Jahr

How to instantly get more FPS in ANY GAME with the TunedPC App in less than 4 minutes:
4:22

How to instantly get more FPS in ANY GAME with the TunedPC App in less than 4 minutes:

KIRNEILL

73,324 Aufrufe • vor 4 Monaten

🦞 Ready to deploy OpenClaw🦞? Our just released NVIDIA NemoClaw simplifies running OpenClaw always-on assistants more safely with a single command. ✅ Deploy claws more safely ✅ Run any coding agent ✅ Deploy anywhere Try with a free NVIDIA Brev Launchable: 🔗
2:33

🦞 Ready to deploy OpenClaw🦞? Our just released NVIDIA NemoClaw simplifies running OpenClaw always-on assistants more safely with a single command. ✅ Deploy claws more safely ✅ Run any coding agent ✅ Deploy anywhere Try with a free NVIDIA Brev Launchable: 🔗

NVIDIA AI Developer

189,692 Aufrufe • vor 4 Monaten

Analyzing your LinkedIn data with ChatGPT's Code Interpreter is a secret weapon. 🤫 Use it to identify your next customer or job opportunity in less than 10 minutes. Here is a quick tutorial on how.
8:03

Analyzing your LinkedIn data with ChatGPT's Code Interpreter is a secret weapon. 🤫 Use it to identify your next customer or job opportunity in less than 10 minutes. Here is a quick tutorial on how.

Sebo ⚛︎

73,754 Aufrufe • vor 2 Jahren

BIG MAN TD ALERT!! Saint Francis Football S&C Sophomore Jared Almeida with the focus to tie it up with less than 2 minutes in regulation. #SCTop10 ESPNAssignmentDesk NAIAFBALL
0:31

BIG MAN TD ALERT!! Saint Francis Football S&C Sophomore Jared Almeida with the focus to tie it up with less than 2 minutes in regulation. #SCTop10 ESPNAssignmentDesk NAIAFBALL

ISC Sports Network

24,175 Aufrufe • vor 1 Jahr

Creating & deploying a dapp on Fuel is easy, and fast. Watch me start from scratch, add a feature, and deploy that dapp to testnet in less than 2 minutes ⚡️👇
1:52

Creating & deploying a dapp on Fuel is easy, and fast. Watch me start from scratch, add a feature, and deploy that dapp to testnet in less than 2 minutes ⚡️👇

Dhai

21,085 Aufrufe • vor 1 Jahr

The truck is able to repair potholes in less than five minutes each and is capable of fixing up to 50 potholes in a single day.
1:21

The truck is able to repair potholes in less than five minutes each and is capable of fixing up to 50 potholes in a single day.

Tech Burrito

573,601 Aufrufe • vor 3 Jahren

Someone built a free and better alternative to Claude that runs 100% locally. → works with any LLM (Claude, GPT, Gemini, vLLM) → beats it on deep research → has Cowork-like capabilities → 50+ connectors out of the box → deploy in literally one command 100% open source. MIT license. 28k stars.
1:00

Someone built a free and better alternative to Claude that runs 100% locally. → works with any LLM (Claude, GPT, Gemini, vLLM) → beats it on deep research → has Cowork-like capabilities → 50+ connectors out of the box → deploy in literally one command 100% open source. MIT license. 28k stars.

How To Prompt

39,202 Aufrufe • vor 2 Monaten

Agents & MCP are great... but how can you DEPLOY an agent with MCP tools? Here's the fastest way I've found to build and deploy with the OpenAI Agents SDK in <3 minutes.
3:46

Agents & MCP are great... but how can you DEPLOY an agent with MCP tools? Here's the fastest way I've found to build and deploy with the OpenAI Agents SDK in <3 minutes.

matt palmer

64,690 Aufrufe • vor 1 Jahr

anyways here's USC vs Notre Dame on 4th and 9 with USC down 3 with less than 2 minutes left in the 4th quarter ✌🏻
0:34

anyways here's USC vs Notre Dame on 4th and 9 with USC down 3 with less than 2 minutes left in the 4th quarter ✌🏻

Arrogant Nation✌🏻

13,574 Aufrufe • vor 2 Monaten

I'm super excited to launch ⌘ 🥳 ⌘ Langbase – Composable AI developer platform to ship AI features in minutes, not months. Deploy AI Pipes: Hook any LLM to any data, hyper-personalized API AI Memory: Managed search engine API with RAG tools
12:59

I'm super excited to launch ⌘ 🥳 ⌘ Langbase – Composable AI developer platform to ship AI features in minutes, not months. Deploy AI Pipes: Hook any LLM to any data, hyper-personalized API AI Memory: Managed search engine API with RAG tools

Ahmad Awais

57,484 Aufrufe • vor 2 Jahren

GPT-4o's native image gen enables amazing workflows You can generate the perfect landing page with 4o and then build and deploy it with Replit. Literally from imagination to production in less than 5 minutes. Prompts below
0:34

GPT-4o's native image gen enables amazing workflows You can generate the perfect landing page with 4o and then build and deploy it with Replit. Literally from imagination to production in less than 5 minutes. Prompts below

Paul Couvert

290,720 Aufrufe • vor 1 Jahr

Most "AI coding tools" need 5 files, a build config, and a prayer. Gradio 6's gr.HTML: one Python file. Frontend, backend, state—done 😎 Generate with Claude or any frontier LLM in one shot. Deploy in seconds. This is what vibe coding is supposed to be! Full breakdown👇️
0:28

Most "AI coding tools" need 5 files, a build config, and a prayer. Gradio 6's gr.HTML: one Python file. Frontend, backend, state—done 😎 Generate with Claude or any frontier LLM in one shot. Deploy in seconds. This is what vibe coding is supposed to be! Full breakdown👇️

Gradio

22,392 Aufrufe • vor 5 Monaten

he literally taught me how to bersyukur dan ikhlas in less than 3 minutes
2:21

he literally taught me how to bersyukur dan ikhlas in less than 3 minutes

tubina

343,091 Aufrufe • vor 2 Jahren

MARVEL SNAP Beach Bash is here, and ⁨Ken is here to show you how to get tubular with Sub-Mariner!
5:19

MARVEL SNAP Beach Bash is here, and ⁨Ken is here to show you how to get tubular with Sub-Mariner!

MARVEL SNAP

15,252 Aufrufe • vor 1 Monat

Homemade marshmallow! Made with just a few ingredients and in less than ten minutes.
1:49

Homemade marshmallow! Made with just a few ingredients and in less than ten minutes.

Mindful DIY

57,951 Aufrufe • vor 2 Monaten

Build a multiplayer game from your terminal! Billy Jacobson shows how to vibe code a holiday village and deploy it with real-time syncing using the /𝚏𝚒𝚛𝚎𝚋𝚊𝚜𝚎 𝚒𝚗𝚒𝚝 command in Gemini CLI. From local script to live URL in minutes → #DEVcember
1:28

Build a multiplayer game from your terminal! Billy Jacobson shows how to vibe code a holiday village and deploy it with real-time syncing using the /𝚏𝚒𝚛𝚎𝚋𝚊𝚜𝚎 𝚒𝚗𝚒𝚝 command in Gemini CLI. From local script to live URL in minutes → #DEVcember

Google Cloud Tech

11,810 Aufrufe • vor 7 Monaten

You can now deploy apps directly to TestFlight with EAS Build in a single command! 🚀 eas build -s → download your app on TestFlight Huge time savings since you don't need to open the ASC website and click through a bunch of forms to download your app.
2:58

You can now deploy apps directly to TestFlight with EAS Build in a single command! 🚀 eas build -s → download your app on TestFlight Huge time savings since you don't need to open the ASC website and click through a bunch of forms to download your app.

Evan Bacon 🥓

108,927 Aufrufe • vor 1 Jahr