Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Open Interpreter's new release looks great for locally running LLMs The tool lets LLMs run code (Python, Javascript, Shell, and more) locally. You can chat with Open Interpreter through a ChatGPT-like interface in your terminal by running $ interpreter after installing. Just do `pip install open-interpreter` and then just... show more

Rohan Paul

150,800 subscribers

154,611 views • 2 years ago •via X (Twitter)

Comedy Science & Technology Education

Anya Rossi• Live Now

Private livecam show

7 Comments

Mike Bird (Hiring)2 years ago

We strive to be the most powerful, capable local option for benefiting from LLMs!

Sanim Hassan 🇮🇳2 years ago

What are the hardware requirements for using this?

Aritra Roy Gosthipaty2 years ago

The keras team is going to like this! CC: @martin_gorner @fchollet

Matthew Zeits2 years ago

NVM interpreter --api_base " --api_key "fake_key"

Andrii 🌄 Syrokomskyi1 year ago

So many posts about "deploying LLM locally"... I like "locally", really. But just not LLM. It's interesting, but not practical… for my laptop)

Sinh Nguyen2 years ago

No hesitation?

Matthew Zeits2 years ago

What if my instance of ollama is running on another machine?

Related Videos

Today I’m launching Open Interpreter, an open-source Code Interpreter that runs locally. Summarize PDFs, visualize datasets, and control your browser — all from a ChatGPT-like interface in your terminal. ● $ pip install open-interpreter $ interpreter

Today I’m launching Open Interpreter, an open-source Code Interpreter that runs locally. Summarize PDFs, visualize datasets, and control your browser — all from a ChatGPT-like interface in your terminal. ● $ pip install open-interpreter $ interpreter

killian

2,055,740 views • 2 years ago

Open Interpreter is like ChatGPT Code Interpreter, but you can run it locally on your computer, and it is 100% open-source. Write and execute code, analyze data, control your computer, and more. Great work killian Here's how to install and use it: 👇

Open Interpreter is like ChatGPT Code Interpreter, but you can run it locally on your computer, and it is 100% open-source. Write and execute code, analyze data, control your computer, and more. Great work killian Here's how to install and use it: 👇

Matthew Berman

142,913 views • 2 years ago

Built an open-source Jupyter Notebook that brings the power of OpenAI's code interpreter into your local Python development environment. Watch how easy it is to use Thread to edit code I wrote, chat with my notebook, or generate charts just using prompts. We built Thread using Next.js, Chakra and Project Jupyter and you can install it by running: pip install thread-dev

Built an open-source Jupyter Notebook that brings the power of OpenAI's code interpreter into your local Python development environment. Watch how easy it is to use Thread to edit code I wrote, chat with my notebook, or generate charts just using prompts. We built Thread using Next.js, Chakra and Project Jupyter and you can install it by running: pip install thread-dev

Ali Shobeiri

112,649 views • 2 years ago

Introducing Docker 🐳 AI Models for local + private LLMs in VSCode 🤩 You can now use Docker as a local model provider in VSCode, JetBrains, Cursor, and soon Visual Studio Enterprise. With Docker Model Runner (v4.40+), run AI models locally on your machine... no data sharing, no cloud dependency 👏 Just update Docker, open CodeGPT, select the model, click "Download", and enjoy 👉 Here’s how to update Docker:

Introducing Docker 🐳 AI Models for local + private LLMs in VSCode 🤩 You can now use Docker as a local model provider in VSCode, JetBrains, Cursor, and soon Visual Studio Enterprise. With Docker Model Runner (v4.40+), run AI models locally on your machine... no data sharing, no cloud dependency 👏 Just update Docker, open CodeGPT, select the model, click "Download", and enjoy 👉 Here’s how to update Docker:

Daniel San

65,228 views • 1 year ago

Still running the "deaf and blind" #OpenClaw on a Mac mini? #PicoClaw turns #MaixCAM2 into your pocket personal assistant with multimodal #vision and #voice support! In fact, MaixCAM2 can even run LLMs/VLMs locally—no more privacy anxiety!

Still running the "deaf and blind" #OpenClaw on a Mac mini? #PicoClaw turns #MaixCAM2 into your pocket personal assistant with multimodal #vision and #voice support! In fact, MaixCAM2 can even run LLMs/VLMs locally—no more privacy anxiety!

Sipeed

37,001 views • 5 months ago

finetuning LLMs will never be the same! Unsloth just launched an open-source web UI to run and fine-tune 500+ LLMs without writing any code. key features - run models locally on Mac, Windows, Linux - train 500+ models 2x faster with 70% less VRAM - supports GGUF, vision, audio, embedding models - auto-create datasets from PDF, CSV, DOCX - self-healing tool calling and code execution - compare models side by side + export to GGUF to get started, I've shared links in the next tweet.

finetuning LLMs will never be the same! Unsloth just launched an open-source web UI to run and fine-tune 500+ LLMs without writing any code. key features - run models locally on Mac, Windows, Linux - train 500+ models 2x faster with 70% less VRAM - supports GGUF, vision, audio, embedding models - auto-create datasets from PDF, CSV, DOCX - self-healing tool calling and code execution - compare models side by side + export to GGUF to get started, I've shared links in the next tweet.

Akshay 🚀

45,225 views • 4 months ago

Truly unbelievable GLM 5.2 just released and it's an open weights model you can run locally The insane part is, it's just as good as Opus 4.8 Unlimited, free super intelligence running on your desk In this video I cover how it works, and how to set up your first local model:

Truly unbelievable GLM 5.2 just released and it's an open weights model you can run locally The insane part is, it's just as good as Opus 4.8 Unlimited, free super intelligence running on your desk In this video I cover how it works, and how to set up your first local model:

Alex Finn

123,220 views • 1 month ago

Local Autonomous Agent for All of Us Browser-Use Web UI is a gradio app that uses LLMs to automatically surf the web to achieve tasks. All you need to do is just tell it what to do. It works like magic. And now anyone can run it locally with 1 click.

Local Autonomous Agent for All of Us Browser-Use Web UI is a gradio app that uses LLMs to automatically surf the web to achieve tasks. All you need to do is just tell it what to do. It works like magic. And now anyone can run it locally with 1 click.

cocktail peanut

40,782 views • 1 year ago

You can now run Claude Code locally for FREE. → Using open-source models → Locally and fully private → Full agent + tool workflows Here's the FULL step-by-step tutorial to get it all set up in less than 10 minutes:

You can now run Claude Code locally for FREE. → Using open-source models → Locally and fully private → Full agent + tool workflows Here's the FULL step-by-step tutorial to get it all set up in less than 10 minutes:

Alvaro Cintas

1,317,847 views • 6 months ago

IBM just released Granite-4.0 Nano, their smallest LLMs ever (300M & 1B)! 😍 The models demonstrate remarkable instruction following and tool calling capabilities, and can even run locally in-browser! This means they can interact with websites and call browser APIs for you! 🤯

IBM just released Granite-4.0 Nano, their smallest LLMs ever (300M & 1B)! 😍 The models demonstrate remarkable instruction following and tool calling capabilities, and can even run locally in-browser! This means they can interact with websites and call browser APIs for you! 🤯

Xenova

32,462 views • 9 months ago

Excited to present the LLM-Council skill. Initial idea by Karpathy. I just packaged it as a skill. You can easily spin up a council of LLMs or agents via Fireworks AI. Watch how the new GLM-5 model "deliberates" on other LLMs' thoughts on the big question, "Can LLMs reason?" Things worth paying attention to: New open models like GLM-5 have surprisingly improved on complex reasoning and long-running agentic tasks. The AskUserQuestion tool in Claude Code came in handy to select the council and chairperson. As Andrej Karpathy puts it, it's a really interesting way to get different perspectives from LLMs, which can lead to better decision-making on whatever task you are working on. You can use it for other agentic coding use cases, like evaluation, tool building, designing, and research.

Excited to present the LLM-Council skill. Initial idea by Karpathy. I just packaged it as a skill. You can easily spin up a council of LLMs or agents via Fireworks AI. Watch how the new GLM-5 model "deliberates" on other LLMs' thoughts on the big question, "Can LLMs reason?" Things worth paying attention to: New open models like GLM-5 have surprisingly improved on complex reasoning and long-running agentic tasks. The AskUserQuestion tool in Claude Code came in handy to select the council and chairperson. As Andrej Karpathy puts it, it's a really interesting way to get different perspectives from LLMs, which can lead to better decision-making on whatever task you are working on. You can use it for other agentic coding use cases, like evaluation, tool building, designing, and research.

elvis

39,452 views • 5 months ago

A 100% open-source alternative to n8n! Sim is a drag-and-drop UI for creating powerful AI agent workflows: - Runs locally on your machine - Works with local LLMs I built a stock market research agent & connected it to Telegram in minutes. Here's a step-by-step guide:

A 100% open-source alternative to n8n! Sim is a drag-and-drop UI for creating powerful AI agent workflows: - Runs locally on your machine - Works with local LLMs I built a stock market research agent & connected it to Telegram in minutes. Here's a step-by-step guide:

Akshay 🚀

176,428 views • 7 months ago

A 100% open-source alternative to n8n! Sim is a drag-and-drop UI for creating powerful AI agent workflows: - Runs locally on your machine - Works with local LLMs I built a job finder for top YC startups & connected it to Telegram in minutes. Here's a step-by-step guide:

A 100% open-source alternative to n8n! Sim is a drag-and-drop UI for creating powerful AI agent workflows: - Runs locally on your machine - Works with local LLMs I built a job finder for top YC startups & connected it to Telegram in minutes. Here's a step-by-step guide:

Akshay 🚀

125,575 views • 11 months ago

Introducing Private Mind! 🚀 Our new open-source app, built with React Native ExecuTorch, lets you run LLMs 100% locally on your device. 🔹 Explore and swap pre-exported models 🔹 Benchmark performance, speed & memory 🔹 Customize system prompts 🔹 100% offline, private & free Now available on App Store and Google Play! Links in 🧵

Introducing Private Mind! 🚀 Our new open-source app, built with React Native ExecuTorch, lets you run LLMs 100% locally on your device. 🔹 Explore and swap pre-exported models 🔹 Benchmark performance, speed & memory 🔹 Customize system prompts 🔹 100% offline, private & free Now available on App Store and Google Play! Links in 🧵

Software Mansion

21,764 views • 1 year ago

Run Artist AI on Your Local Computer. Just published a 1 click local launcher for the Artist Gradio app on Huggingface by Sylvain Filoni -- lets you take any existing image and stylize it with high quality results. Run locally on all platforms with one click: Mac, Linux, Windows.

Run Artist AI on Your Local Computer. Just published a 1 click local launcher for the Artist Gradio app on Huggingface by Sylvain Filoni -- lets you take any existing image and stylize it with high quality results. Run locally on all platforms with one click: Mac, Linux, Windows.

cocktail peanut

14,482 views • 2 years ago

Introducing Unsloth Studio ✨ A new open-source web UI to train and run LLMs. • Run models locally on Mac, Windows, Linux • Train 500+ models 2x faster with 70% less VRAM • Supports GGUF, vision, audio, embedding models • Auto-create datasets from PDF, CSV, DOCX • Self-healing tool calling and code execution • Compare models side by side + export to GGUF GitHub: Blog and Guide: Available now on Hugging Face, NVIDIA, Docker and Colab.

Introducing Unsloth Studio ✨ A new open-source web UI to train and run LLMs. • Run models locally on Mac, Windows, Linux • Train 500+ models 2x faster with 70% less VRAM • Supports GGUF, vision, audio, embedding models • Auto-create datasets from PDF, CSV, DOCX • Self-healing tool calling and code execution • Compare models side by side + export to GGUF GitHub: Blog and Guide: Available now on Hugging Face, NVIDIA, Docker and Colab.

Unsloth AI

1,711,264 views • 4 months ago

Hermes is powerful. But Open WebUI makes it way easier to actually use. Here’s the setup: → Run Hermes locally → Add the API server → Set up the environment file → Install Open WebUI with Docker → Connect Hermes as the chat agent → Log in and start chatting through a clean UI Now you can use Hermes without living inside the terminal. You get a ChatGPT-style interface, file uploads, model switching, web search, image tools, previews, and cleaner conversation management. Save this video, you’ll make Hermes 10x easier to use. Want the SOP? DM me. 💬

Hermes is powerful. But Open WebUI makes it way easier to actually use. Here’s the setup: → Run Hermes locally → Add the API server → Set up the environment file → Install Open WebUI with Docker → Connect Hermes as the chat agent → Log in and start chatting through a clean UI Now you can use Hermes without living inside the terminal. You get a ChatGPT-style interface, file uploads, model switching, web search, image tools, previews, and cleaner conversation management. Save this video, you’ll make Hermes 10x easier to use. Want the SOP? DM me. 💬

Julian Goldie SEO

61,195 views • 3 months ago

Best way to debug Claude Code sessions and inspect agent context. Just Run: npx claude-code-templates@latest --chats Browser interface with advanced search across all your sessions (name, ID, directory, dates, message content). Shows every tool call with exact JSON executed. Resume button lets you continue any session - efficient context loading. Runs completely local and open source 👏

Best way to debug Claude Code sessions and inspect agent context. Just Run: npx claude-code-templates@latest --chats Browser interface with advanced search across all your sessions (name, ID, directory, dates, message content). Shows every tool call with exact JSON executed. Resume button lets you continue any session - efficient context loading. Runs completely local and open source 👏

Daniel San

32,873 views • 9 months ago

Introducing Claude Code Templates 🚀 I originally built this to streamline how I set up new projects with Claude Code…just a small tool to make my own workflow smoother. No install, just run: npx claude-code-templates Right now, it configures Commands, Hooks, MCPs, and settings.json for JavaScript/TypeScript and Python projects. It made things so much easier for me that I decided to share it with the community. Open-source and open to ideas — feel free to contribute! Big thanks to the team at Anthropic and everyone behind Claude Code Community 🙌

Introducing Claude Code Templates 🚀 I originally built this to streamline how I set up new projects with Claude Code…just a small tool to make my own workflow smoother. No install, just run: npx claude-code-templates Right now, it configures Commands, Hooks, MCPs, and settings.json for JavaScript/TypeScript and Python projects. It made things so much easier for me that I decided to share it with the community. Open-source and open to ideas — feel free to contribute! Big thanks to the team at Anthropic and everyone behind Claude Code Community 🙌

Daniel San

28,410 views • 1 year ago

Build your own local ChatGPT-like interface! Powered by Llama 3.2 Vision, it runs 100% locally and supports: ↳Text chat ↳Chat with images Tech stack: ↳ Chainlit for the UI ↳ Ollama for serving Llama 3.2 vision Everything is just 50 lines of code! I have shared link to the code in next tweet! _____ Find me → Akshay 🚀 ✔️ For more insights and tutorials on ML and AI Engineering!

Build your own local ChatGPT-like interface! Powered by Llama 3.2 Vision, it runs 100% locally and supports: ↳Text chat ↳Chat with images Tech stack: ↳ Chainlit for the UI ↳ Ollama for serving Llama 3.2 vision Everything is just 50 lines of code! I have shared link to the code in next tweet! _____ Find me → Akshay 🚀 ✔️ For more insights and tutorials on ML and AI Engineering!

Akshay 🚀

49,952 views • 1 year ago