Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Create OpenAI like API for Llama-3 deployed locally on your computer (100% free and without internet):

Shubham Saboo

116,851 subscribers

308,867 views • 2 years ago •via X (Twitter)

Education News & Politics Science & Technology

Anya Rossi• Live Now

Private livecam show

10 Comments

Shubham Saboo2 years ago

Running on Macbook M1 pro (16GB RAM) using the @LMStudioAI. If you find this useful, RT to share it with your friends. Don't forget to follow me @Saboo_Shubham_ for more such LLMs tips and resources.

Kairos Data Labs2 years ago

Waoo, you can do all this stuff locally. Insane!!

Shubham Saboo2 years ago

Yes, it's just like unlocking a new set of super powers!

Gargi2 years ago

Another sleek llama-3 tutorial, thanks!

Shubham Saboo2 years ago

You're welcome!

Pallav Agarwal2 years ago

You can use an app like Pal Chat to even interact with a model running on your computer, from your phone!

Prateek Sharma2 years ago

Absolutely right !! But, you can't beat magic of @GroqInc

Shubham Saboo2 years ago

@GroqInc That’s a cloud service using insane amount of hardware for powering a single API.

Coding But Still Alive2 years ago

What is the difference to @ollama ?

ollama2 years ago

@Saboo_Shubham_ Love the community!! Ollama is open-source. You can use Ollama however you want. The particular tool requires a license technically. Ollama is happy to support them though! Open-source is all about choice.

Related Videos

Create OpenAI like AI assistant with Llama 3.2 deployed locally on your computer (100% free and without internet):

Create OpenAI like AI assistant with Llama 3.2 deployed locally on your computer (100% free and without internet):

Shubham Saboo

73,631 views • 1 year ago

Create OpenAI like API for newly launched Llama-3.1 and deploy it locally on your computer in just 2 minutes (100% free and without internet):

Create OpenAI like API for newly launched Llama-3.1 and deploy it locally on your computer in just 2 minutes (100% free and without internet):

Shubham Saboo

529,188 views • 1 year ago

CodeGPT AI extension in Visual Studio can quickly fix and refactor your Python Code using Llama-3 running locally on your computer (100% free and without internet):

CodeGPT AI extension in Visual Studio can quickly fix and refactor your Python Code using Llama-3 running locally on your computer (100% free and without internet):

Shubham Saboo

119,904 views • 1 year ago

Run Deepseek R1 locally on your computer with thinking UI (100% free and without internet):

Run Deepseek R1 locally on your computer with thinking UI (100% free and without internet):

Shubham Saboo

302,960 views • 1 year ago

Claude 3.5 Sonnet creates fully working ChatGPT clone from just a screenshot in 2 minutes. It uses Llama-3 running locally on your computer (100% free and without internet).

Claude 3.5 Sonnet creates fully working ChatGPT clone from just a screenshot in 2 minutes. It uses Llama-3 running locally on your computer (100% free and without internet).

Shubham Saboo

344,992 views • 2 years ago

Run any LLM like Llama 3.2 directly from Hugging Face using Ollama on your local computer (100% free and without internet).

Run any LLM like Llama 3.2 directly from Hugging Face using Ollama on your local computer (100% free and without internet).

Shubham Saboo

33,551 views • 1 year ago

Build a local LLM app with RAG to chat with Google Drive data using Mistral or Llama-3 running locally on your computer without wiring a single line of Python Code (100% free and without internet):

Build a local LLM app with RAG to chat with Google Drive data using Mistral or Llama-3 running locally on your computer without wiring a single line of Python Code (100% free and without internet):

Shubham Saboo

189,746 views • 1 year ago

Software Engineering AI Agent on your machine connects with your apps and tools to automate engineering tasks. It can work with OpenAI, Claude Sonnet 3.5, Gemini and local Llama 3. 100% Opensource and free.

Software Engineering AI Agent on your machine connects with your apps and tools to automate engineering tasks. It can work with OpenAI, Claude Sonnet 3.5, Gemini and local Llama 3. 100% Opensource and free.

Shubham Saboo

169,161 views • 1 year ago

Hot tip for anyone doing AI dev: Use Ollama to easily run models like Deepseek-r1 or Gemma locally on your machine. It downloads them and spins up a server with an OpenAI SDK compatible API The smaller models are fast and good enough to work on new features or debug streaming without having to pay for API requests

Hot tip for anyone doing AI dev: Use Ollama to easily run models like Deepseek-r1 or Gemma locally on your machine. It downloads them and spins up a server with an OpenAI SDK compatible API The smaller models are fast and good enough to work on new features or debug streaming without having to pay for API requests

Wes Bos

153,435 views • 1 year ago

AgenticSeek is an opensource alternative to $200/month Manus AI agent. It runs entirely on your computer, letting local reasoning LLMs like DeepSeek R1 browse the web, write code, and execute tasks while keeping all your data private. 100% free and without internet.

AgenticSeek is an opensource alternative to $200/month Manus AI agent. It runs entirely on your computer, letting local reasoning LLMs like DeepSeek R1 browse the web, write code, and execute tasks while keeping all your data private. 100% free and without internet.

Unwind AI

57,425 views • 1 year ago

Qwen QwQ-32B can reason as good as OpenAI o1 mini (in most of the cases). Best part? You can run this locally with an UI in less than 10 lines of Python Code (100% free and without internet).

Qwen QwQ-32B can reason as good as OpenAI o1 mini (in most of the cases). Best part? You can run this locally with an UI in less than 10 lines of Python Code (100% free and without internet).

Shubham Saboo

60,212 views • 1 year ago

OpenAI just released access to Computer Use Agent via an API. It combines GPT-4o vision with advanced reasoning for an AI Agent to simulate controlling computer interfaces and performing tasks just like humans. You can try it for free using this Agent Playground.

OpenAI just released access to Computer Use Agent via an API. It combines GPT-4o vision with advanced reasoning for an AI Agent to simulate controlling computer interfaces and performing tasks just like humans. You can try it for free using this Agent Playground.

Shubham Saboo

64,206 views • 1 year ago

Drag & Drop to build local chat app with memory using Llama 3.1 without writing a single line of code (100% free and without internet).

Drag & Drop to build local chat app with memory using Llama 3.1 without writing a single line of code (100% free and without internet).

Shubham Saboo

12,443 views • 1 year ago

OK it's a game changer You can create and run an AI agent 100% locally on your laptop. No need to connect or pay a provider like OpenAI or Anthropic. Combine the open source Google Gemma 3 model, Smolagents and LM Studio and you're ready. (Links and resources below) #gifted

OK it's a game changer You can create and run an AI agent 100% locally on your laptop. No need to connect or pay a provider like OpenAI or Anthropic. Combine the open source Google Gemma 3 model, Smolagents and LM Studio and you're ready. (Links and resources below) #gifted

Paul Couvert

78,710 views • 1 year ago

Literally Free, Unlimited Access to Top AI APIs for Your Apps Puter isn’t just a computer in your browser — it’s a full-blown AI playground. With the “User Pays” model, users cover API costs — not you Connect to OpenAI, Claude, Grok, Llama & Gemini. Build freely link 🔗 👇🧵

Literally Free, Unlimited Access to Top AI APIs for Your Apps Puter isn’t just a computer in your browser — it’s a full-blown AI playground. With the “User Pays” model, users cover API costs — not you Connect to OpenAI, Claude, Grok, Llama & Gemini. Build freely link 🔗 👇🧵

Python Space

21,251 views • 1 year ago

Introducing Memex: The Everything Builder for your Computer. Vibe code anything using any programming language + tech stack on your computer. Deploy anywhere. Create apps, pipelines, and more without writing code.

Introducing Memex: The Everything Builder for your Computer. Vibe code anything using any programming language + tech stack on your computer. Deploy anywhere. Create apps, pipelines, and more without writing code.

Memex

1,942,500 views • 1 year ago

Open Interpreter is like ChatGPT Code Interpreter, but you can run it locally on your computer, and it is 100% open-source. Write and execute code, analyze data, control your computer, and more. Great work killian Here's how to install and use it: 👇

Open Interpreter is like ChatGPT Code Interpreter, but you can run it locally on your computer, and it is 100% open-source. Write and execute code, analyze data, control your computer, and more. Great work killian Here's how to install and use it: 👇

Matthew Berman

142,901 views • 2 years ago

You can now generate and iterate on images with gpt-image-1.5 in Codex to create frontend designs, mockups, game assets, and more without leaving your workflow. Usage is included with your ChatGPT account, no API key needed.

You can now generate and iterate on images with gpt-image-1.5 in Codex to create frontend designs, mockups, game assets, and more without leaving your workflow. Usage is included with your ChatGPT account, no API key needed.

OpenAI

127,660 views • 2 months ago

Stop paying for Claude Code! Use it for FREE with ollama I just set up Claude Code running locally on my computer. Zero API costs, complete privacy, and it actually works for real coding tasks. Full step-by-step guide in my latest video:

Stop paying for Claude Code! Use it for FREE with ollama I just set up Claude Code running locally on my computer. Zero API costs, complete privacy, and it actually works for real coding tasks. Full step-by-step guide in my latest video:

Mervin Praison

57,732 views • 4 months ago