Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Create OpenAI like API for newly launched Llama-3.1 and deploy it locally on your computer in just 2 minutes (100% free and without internet):

Shubham Saboo

113,727 subscribers

529,157 views • 1 year ago •via X (Twitter)

Education Science & Technology News & Politics

Anya Rossi• Live Now

Private livecam show

10 Comments

Shubham Saboo1 year ago

Running on Macbook M1 pro (16GB RAM) using the @LMStudioAI. If you find this useful, RT to share it with your friends. Don't forget to follow me @Saboo_Shubham_ for more such LLMs tips and tutorials.

Kairos Data Labs1 year ago

@ollama and @LMStudioAI has made building local LLM apps a piece of cake 💥

Shubham Saboo1 year ago

@ollama @LMStudioAI Very true!

Gargi1 year ago

This is amazing and very timely!!

Shubham Saboo1 year ago

Thank you!

bitlas1 year ago

or you can just download @bonzai_depin $bonzai app and install it in one click🤷‍♀️ llama-3.1 will be available this week on bonzai website.

Brad1 year ago

Love seeing this. Please stick with local/open/decentralized for your content. Centralized AI is where all the danger lies.

Shubham Saboo1 year ago

Thank you. I try to share as many opensource stuff as possible. Local LLMs are a game changer!

Tim Hulse1 year ago

Thanks!

Shubham Saboo1 year ago

You're welcome Tim!

Related Videos

Create OpenAI like API for Llama-3 deployed locally on your computer (100% free and without internet):

Create OpenAI like API for Llama-3 deployed locally on your computer (100% free and without internet):

Shubham Saboo

308,867 views • 2 years ago

Create OpenAI like AI assistant with Llama 3.2 deployed locally on your computer (100% free and without internet):

Create OpenAI like AI assistant with Llama 3.2 deployed locally on your computer (100% free and without internet):

Shubham Saboo

73,631 views • 1 year ago

Claude 3.5 Sonnet creates fully working ChatGPT clone from just a screenshot in 2 minutes. It uses Llama-3 running locally on your computer (100% free and without internet).

Claude 3.5 Sonnet creates fully working ChatGPT clone from just a screenshot in 2 minutes. It uses Llama-3 running locally on your computer (100% free and without internet).

Shubham Saboo

343,880 views • 2 years ago

CodeGPT AI extension in Visual Studio can quickly fix and refactor your Python Code using Llama-3 running locally on your computer (100% free and without internet):

CodeGPT AI extension in Visual Studio can quickly fix and refactor your Python Code using Llama-3 running locally on your computer (100% free and without internet):

Shubham Saboo

119,904 views • 1 year ago

Run Deepseek R1 locally on your computer with thinking UI (100% free and without internet):

Run Deepseek R1 locally on your computer with thinking UI (100% free and without internet):

Shubham Saboo

302,960 views • 1 year ago

Run any LLM like Llama 3.2 directly from Hugging Face using Ollama on your local computer (100% free and without internet).

Run any LLM like Llama 3.2 directly from Hugging Face using Ollama on your local computer (100% free and without internet).

Shubham Saboo

33,551 views • 1 year ago

Build a local LLM app with RAG to chat with Google Drive data using Mistral or Llama-3 running locally on your computer without wiring a single line of Python Code (100% free and without internet):

Build a local LLM app with RAG to chat with Google Drive data using Mistral or Llama-3 running locally on your computer without wiring a single line of Python Code (100% free and without internet):

Shubham Saboo

189,592 views • 1 year ago

Drag & Drop to build local chat app with memory using Llama 3.1 without writing a single line of code (100% free and without internet).

Drag & Drop to build local chat app with memory using Llama 3.1 without writing a single line of code (100% free and without internet).

Shubham Saboo

12,443 views • 1 year ago

Introducing Memex: The Everything Builder for your Computer. Vibe code anything using any programming language + tech stack on your computer. Deploy anywhere. Create apps, pipelines, and more without writing code.

Introducing Memex: The Everything Builder for your Computer. Vibe code anything using any programming language + tech stack on your computer. Deploy anywhere. Create apps, pipelines, and more without writing code.

Memex

1,942,500 views • 1 year ago

OpenAI just released access to Computer Use Agent via an API. It combines GPT-4o vision with advanced reasoning for an AI Agent to simulate controlling computer interfaces and performing tasks just like humans. You can try it for free using this Agent Playground.

OpenAI just released access to Computer Use Agent via an API. It combines GPT-4o vision with advanced reasoning for an AI Agent to simulate controlling computer interfaces and performing tasks just like humans. You can try it for free using this Agent Playground.

Shubham Saboo

64,206 views • 1 year ago

Tencent just launched its answer to Claude Computer Use 🤯 QClaw is a personal AI agent that runs locally on your device, sets up in 3 minutes, and takes commands from WhatsApp or Telegram. Built on open-source OpenClaw. Free beta.

Tencent just launched its answer to Claude Computer Use 🤯 QClaw is a personal AI agent that runs locally on your device, sets up in 3 minutes, and takes commands from WhatsApp or Telegram. Built on open-source OpenClaw. Free beta.

Alvaro Cintas

20,202 views • 1 month ago

Stop paying for Claude Code! Use it for FREE with ollama I just set up Claude Code running locally on my computer. Zero API costs, complete privacy, and it actually works for real coding tasks. Full step-by-step guide in my latest video:

Stop paying for Claude Code! Use it for FREE with ollama I just set up Claude Code running locally on my computer. Zero API costs, complete privacy, and it actually works for real coding tasks. Full step-by-step guide in my latest video:

Mervin Praison

57,732 views • 4 months ago

Open Interpreter is like ChatGPT Code Interpreter, but you can run it locally on your computer, and it is 100% open-source. Write and execute code, analyze data, control your computer, and more. Great work killian Here's how to install and use it: 👇

Open Interpreter is like ChatGPT Code Interpreter, but you can run it locally on your computer, and it is 100% open-source. Write and execute code, analyze data, control your computer, and more. Great work killian Here's how to install and use it: 👇

Matthew Berman

142,901 views • 2 years ago

AgenticSeek is an opensource alternative to $200/month Manus AI agent. It runs entirely on your computer, letting local reasoning LLMs like DeepSeek R1 browse the web, write code, and execute tasks while keeping all your data private. 100% free and without internet.

AgenticSeek is an opensource alternative to $200/month Manus AI agent. It runs entirely on your computer, letting local reasoning LLMs like DeepSeek R1 browse the web, write code, and execute tasks while keeping all your data private. 100% free and without internet.

Unwind AI

57,425 views • 1 year ago

Hot tip for anyone doing AI dev: Use Ollama to easily run models like Deepseek-r1 or Gemma locally on your machine. It downloads them and spins up a server with an OpenAI SDK compatible API The smaller models are fast and good enough to work on new features or debug streaming without having to pay for API requests

Hot tip for anyone doing AI dev: Use Ollama to easily run models like Deepseek-r1 or Gemma locally on your machine. It downloads them and spins up a server with an OpenAI SDK compatible API The smaller models are fast and good enough to work on new features or debug streaming without having to pay for API requests

Wes Bos

153,435 views • 11 months ago

people think running AI locally requires: → $3,000 MacBook Pro → RTX 4090 → $20/month cloud subscription nvidia just dropped a $249 computer. 67 TOPS. runs llama 3.1-8B locally. no internet. no API. no monthly fee. ever. smaller than your router. costs the same as AirPods. runs the same models you pay $240/year to access via ChatGPT. the local AI era just got a price tag. $249.

people think running AI locally requires: → $3,000 MacBook Pro → RTX 4090 → $20/month cloud subscription nvidia just dropped a $249 computer. 67 TOPS. runs llama 3.1-8B locally. no internet. no API. no monthly fee. ever. smaller than your router. costs the same as AirPods. runs the same models you pay $240/year to access via ChatGPT. the local AI era just got a price tag. $249.

self.dll

320,926 views • 1 month ago

Qwen QwQ-32B can reason as good as OpenAI o1 mini (in most of the cases). Best part? You can run this locally with an UI in less than 10 lines of Python Code (100% free and without internet).

Qwen QwQ-32B can reason as good as OpenAI o1 mini (in most of the cases). Best part? You can run this locally with an UI in less than 10 lines of Python Code (100% free and without internet).

Shubham Saboo

60,135 views • 1 year ago

Software Engineering AI Agent on your machine connects with your apps and tools to automate engineering tasks. It can work with OpenAI, Claude Sonnet 3.5, Gemini and local Llama 3. 100% Opensource and free.

Software Engineering AI Agent on your machine connects with your apps and tools to automate engineering tasks. It can work with OpenAI, Claude Sonnet 3.5, Gemini and local Llama 3. 100% Opensource and free.

Shubham Saboo

169,161 views • 1 year ago

This is all the code you need to create a Streamlit app to chat with Llama 3.1 8B locally via ollama. Fast and private.

This is all the code you need to create a Streamlit app to chat with Llama 3.1 8B locally via ollama. Fast and private.

Pietro Schirano

310,018 views • 1 year ago

Cloud lock-in is the tech industry’s dirty secret. Cloud engines on DFINITY Foundation are about to fix that: → Create an engine on Amazon → Deploy your apps → Move the whole thing to Google — instantly → Or distribute across both for resilience Just like the internet runs across everything, the Internet Computer will too.

Cloud lock-in is the tech industry’s dirty secret. Cloud engines on DFINITY Foundation are about to fix that: → Create an engine on Amazon → Deploy your apps → Move the whole thing to Google — instantly → Or distribute across both for resilience Just like the internet runs across everything, the Internet Computer will too.

DFINITY Foundation

11,061 views • 3 months ago