Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Create OpenAI like API for Llama-3 deployed locally on your computer (100% free and without internet):

Saboo_Shubham_'s profile picture

Shubham Saboo

116,851 subscribers

308,867 görüntüleme • 2 yıl önce •via X (Twitter)

EğitimHaberler & PolitikaBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

10 Yorum

Shubham Saboo profil fotoğrafı
Shubham Saboo2 yıl önce

Running on Macbook M1 pro (16GB RAM) using the @LMStudioAI. If you find this useful, RT to share it with your friends. Don't forget to follow me @Saboo_Shubham_ for more such LLMs tips and resources.

Kairos Data Labs profil fotoğrafı
Kairos Data Labs2 yıl önce

Waoo, you can do all this stuff locally. Insane!!

Shubham Saboo profil fotoğrafı
Shubham Saboo2 yıl önce

Yes, it's just like unlocking a new set of super powers!

Gargi profil fotoğrafı
Gargi2 yıl önce

Another sleek llama-3 tutorial, thanks!

Shubham Saboo profil fotoğrafı
Shubham Saboo2 yıl önce

You're welcome!

Pallav Agarwal profil fotoğrafı
Pallav Agarwal2 yıl önce

You can use an app like Pal Chat to even interact with a model running on your computer, from your phone!

Prateek Sharma profil fotoğrafı
Prateek Sharma2 yıl önce

Absolutely right !! But, you can't beat magic of @GroqInc

Shubham Saboo profil fotoğrafı
Shubham Saboo2 yıl önce

@GroqInc That’s a cloud service using insane amount of hardware for powering a single API.

Coding But Still Alive profil fotoğrafı
Coding But Still Alive2 yıl önce

What is the difference to @ollama ?

ollama profil fotoğrafı
ollama2 yıl önce

@Saboo_Shubham_ Love the community!! Ollama is open-source. You can use Ollama however you want. The particular tool requires a license technically. Ollama is happy to support them though! Open-source is all about choice.

Benzer Videolar

Create OpenAI like AI assistant with Llama 3.2 deployed locally on your computer (100% free and without internet):
0:51

Create OpenAI like AI assistant with Llama 3.2 deployed locally on your computer (100% free and without internet):

Shubham Saboo

73,631 görüntüleme • 1 yıl önce

Create OpenAI like API for newly launched Llama-3.1 and deploy it locally on your computer in just 2 minutes (100% free and without internet):
0:32

Create OpenAI like API for newly launched Llama-3.1 and deploy it locally on your computer in just 2 minutes (100% free and without internet):

Shubham Saboo

529,188 görüntüleme • 1 yıl önce

CodeGPT AI extension in Visual Studio can quickly fix and refactor your Python Code using Llama-3 running locally on your computer (100% free and without internet):
1:36

CodeGPT AI extension in Visual Studio can quickly fix and refactor your Python Code using Llama-3 running locally on your computer (100% free and without internet):

Shubham Saboo

119,904 görüntüleme • 1 yıl önce

Run Deepseek R1 locally on your computer with thinking UI (100% free and without internet):
0:26

Run Deepseek R1 locally on your computer with thinking UI (100% free and without internet):

Shubham Saboo

302,960 görüntüleme • 1 yıl önce

Claude 3.5 Sonnet creates fully working ChatGPT clone from just a screenshot in 2 minutes. It uses Llama-3 running locally on your computer (100% free and without internet).
0:52

Claude 3.5 Sonnet creates fully working ChatGPT clone from just a screenshot in 2 minutes. It uses Llama-3 running locally on your computer (100% free and without internet).

Shubham Saboo

344,992 görüntüleme • 2 yıl önce

Run any LLM like Llama 3.2 directly from Hugging Face using Ollama on your local computer (100% free and without internet).
0:46

Run any LLM like Llama 3.2 directly from Hugging Face using Ollama on your local computer (100% free and without internet).

Shubham Saboo

33,551 görüntüleme • 1 yıl önce

Build a local LLM app with RAG to chat with Google Drive data using Mistral or Llama-3 running locally on your computer without wiring a single line of Python Code (100% free and without internet):
0:35

Build a local LLM app with RAG to chat with Google Drive data using Mistral or Llama-3 running locally on your computer without wiring a single line of Python Code (100% free and without internet):

Shubham Saboo

189,746 görüntüleme • 1 yıl önce

Software Engineering AI Agent on your machine connects with your apps and tools to automate engineering tasks. It can work with OpenAI, Claude Sonnet 3.5, Gemini and local Llama 3. 100% Opensource and free.
0:22

Software Engineering AI Agent on your machine connects with your apps and tools to automate engineering tasks. It can work with OpenAI, Claude Sonnet 3.5, Gemini and local Llama 3. 100% Opensource and free.

Shubham Saboo

169,161 görüntüleme • 1 yıl önce

Hot tip for anyone doing AI dev: Use Ollama to easily run models like Deepseek-r1 or Gemma locally on your machine. It downloads them and spins up a server with an OpenAI SDK compatible API The smaller models are fast and good enough to work on new features or debug streaming without having to pay for API requests
2:08

Hot tip for anyone doing AI dev: Use Ollama to easily run models like Deepseek-r1 or Gemma locally on your machine. It downloads them and spins up a server with an OpenAI SDK compatible API The smaller models are fast and good enough to work on new features or debug streaming without having to pay for API requests

Wes Bos

153,435 görüntüleme • 11 ay önce

AgenticSeek is an opensource alternative to $200/month Manus AI agent. It runs entirely on your computer, letting local reasoning LLMs like DeepSeek R1 browse the web, write code, and execute tasks while keeping all your data private. 100% free and without internet.
2:31

AgenticSeek is an opensource alternative to $200/month Manus AI agent. It runs entirely on your computer, letting local reasoning LLMs like DeepSeek R1 browse the web, write code, and execute tasks while keeping all your data private. 100% free and without internet.

Unwind AI

57,425 görüntüleme • 1 yıl önce

Qwen QwQ-32B can reason as good as OpenAI o1 mini (in most of the cases). Best part? You can run this locally with an UI in less than 10 lines of Python Code (100% free and without internet).
0:31

Qwen QwQ-32B can reason as good as OpenAI o1 mini (in most of the cases). Best part? You can run this locally with an UI in less than 10 lines of Python Code (100% free and without internet).

Shubham Saboo

60,135 görüntüleme • 1 yıl önce

OK it's a game changer You can create and run an AI agent 100% locally on your laptop. No need to connect or pay a provider like OpenAI or Anthropic. Combine the open source Google Gemma 3 model, Smolagents and LM Studio and you're ready. (Links and resources below) #gifted
17:24

OK it's a game changer You can create and run an AI agent 100% locally on your laptop. No need to connect or pay a provider like OpenAI or Anthropic. Combine the open source Google Gemma 3 model, Smolagents and LM Studio and you're ready. (Links and resources below) #gifted

Paul Couvert

78,710 görüntüleme • 1 yıl önce

Drag & Drop to build local chat app with memory using Llama 3.1 without writing a single line of code (100% free and without internet).
1:07

Drag & Drop to build local chat app with memory using Llama 3.1 without writing a single line of code (100% free and without internet).

Shubham Saboo

12,443 görüntüleme • 1 yıl önce

OpenAI just released access to Computer Use Agent via an API. It combines GPT-4o vision with advanced reasoning for an AI Agent to simulate controlling computer interfaces and performing tasks just like humans. You can try it for free using this Agent Playground.
1:18

OpenAI just released access to Computer Use Agent via an API. It combines GPT-4o vision with advanced reasoning for an AI Agent to simulate controlling computer interfaces and performing tasks just like humans. You can try it for free using this Agent Playground.

Shubham Saboo

64,206 görüntüleme • 1 yıl önce

Literally Free, Unlimited Access to Top AI APIs for Your Apps Puter isn’t just a computer in your browser — it’s a full-blown AI playground. With the “User Pays” model, users cover API costs — not you Connect to OpenAI, Claude, Grok, Llama & Gemini. Build freely link 🔗 👇🧵
0:26

Literally Free, Unlimited Access to Top AI APIs for Your Apps Puter isn’t just a computer in your browser — it’s a full-blown AI playground. With the “User Pays” model, users cover API costs — not you Connect to OpenAI, Claude, Grok, Llama & Gemini. Build freely link 🔗 👇🧵

Python Space

21,251 görüntüleme • 1 yıl önce

Introducing Memex: The Everything Builder for your Computer. Vibe code anything using any programming language + tech stack on your computer. Deploy anywhere. Create apps, pipelines, and more without writing code.
3:08

Introducing Memex: The Everything Builder for your Computer. Vibe code anything using any programming language + tech stack on your computer. Deploy anywhere. Create apps, pipelines, and more without writing code.

Memex

1,942,500 görüntüleme • 1 yıl önce

Open Interpreter is like ChatGPT Code Interpreter, but you can run it locally on your computer, and it is 100% open-source. Write and execute code, analyze data, control your computer, and more. Great work killian Here's how to install and use it: 👇
1:30

Open Interpreter is like ChatGPT Code Interpreter, but you can run it locally on your computer, and it is 100% open-source. Write and execute code, analyze data, control your computer, and more. Great work killian Here's how to install and use it: 👇

Matthew Berman

142,901 görüntüleme • 2 yıl önce

You can now generate and iterate on images with gpt-image-1.5 in Codex to create frontend designs, mockups, game assets, and more without leaving your workflow. Usage is included with your ChatGPT account, no API key needed.
0:20

You can now generate and iterate on images with gpt-image-1.5 in Codex to create frontend designs, mockups, game assets, and more without leaving your workflow. Usage is included with your ChatGPT account, no API key needed.

OpenAI

127,660 görüntüleme • 2 ay önce

Stop paying for Claude Code! Use it for FREE with ollama I just set up Claude Code running locally on my computer. Zero API costs, complete privacy, and it actually works for real coding tasks. Full step-by-step guide in my latest video:
4:42

Stop paying for Claude Code! Use it for FREE with ollama I just set up Claude Code running locally on my computer. Zero API costs, complete privacy, and it actually works for real coding tasks. Full step-by-step guide in my latest video:

Mervin Praison

57,732 görüntüleme • 4 ay önce