Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

BOOM! Starting today you can use open source frontier LLMs in Visual Studio Code with HF Inference Providers! 🔥 Use your inference credits on SoTA llms like GLM 4.5, Qwen3 Coder, DeepSeek 3.1 and more All of it packaged in one simple extension - try it out today 🤗

Vaibhav (VB) Srivastav

41,633 subscribers

41,185 views • 9 months ago •via X (Twitter)

Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Cerebras Inference powers the world's top models - like Qwen3 Coder at 2000 tokens/s 🤯 And you can now access these models directly in Visual Studio Code with the extension and an API key (that you can get for free from

Cerebras Inference powers the world's top models - like Qwen3 Coder at 2000 tokens/s 🤯 And you can now access these models directly in Visual Studio Code with the extension and an API key (that you can get for free from

Visual Studio Code

57,360 views • 9 months ago

Open source/weight models are often used in regulated industries like Health Care or Financial Services, where they handle personally identifiable data, and can't send it to proprietary LLM providers. We recently chatted to Vaibhav (VB) Srivastav about the partnership VS Visual Studio Code and Hugging Face inference providers have to let you use open weight models directly in your IDE! Something that surprised me was just how fast inference providers like Cerebras make it to generate code! In this episode we made a journaling CLI tool using Qwen! I personally love open source and hope more of these models will become small enough to run locally!

Open source/weight models are often used in regulated industries like Health Care or Financial Services, where they handle personally identifiable data, and can't send it to proprietary LLM providers. We recently chatted to Vaibhav (VB) Srivastav about the partnership VS Visual Studio Code and Hugging Face inference providers have to let you use open weight models directly in your IDE! Something that surprised me was just how fast inference providers like Cerebras make it to generate code! In this episode we made a journaling CLI tool using Qwen! I personally love open source and hope more of these models will become small enough to run locally!

Marlene Mhangami

18,215 views • 7 months ago

How can we use small LLMs to shift more AI workloads onto our laptops and phones? In our paper and open-source code, we pair on-device LLMs (ollama) with frontier LLMs in the cloud (OpenAI, Together), to solve token-intensive workloads on your 💻 at 17.5% of the cloud cost while maintaining 97.9% of the accuracy. See Gru and the Minions in action below, 🔉on please (h/t )!

How can we use small LLMs to shift more AI workloads onto our laptops and phones? In our paper and open-source code, we pair on-device LLMs (ollama) with frontier LLMs in the cloud (OpenAI, Together), to solve token-intensive workloads on your 💻 at 17.5% of the cloud cost while maintaining 97.9% of the accuracy. See Gru and the Minions in action below, 🔉on please (h/t )!

Dan Biderman

193,212 views • 1 year ago

This is HUGE, Hugging Face just shipped Inference Providers on the Hub Partnering with Together AI, @FAL, Replicate and SambaNova! Starting today you can access thousands of Models like DeepSeek R1, Llama, Flux, Whisper, and more Directly from Hugging Face!

This is HUGE, Hugging Face just shipped Inference Providers on the Hub Partnering with Together AI, @FAL, Replicate and SambaNova! Starting today you can access thousands of Models like DeepSeek R1, Llama, Flux, Whisper, and more Directly from Hugging Face!

AK

177,126 views • 1 year ago

Excited to present the LLM-Council skill. Initial idea by Karpathy. I just packaged it as a skill. You can easily spin up a council of LLMs or agents via Fireworks AI. Watch how the new GLM-5 model "deliberates" on other LLMs' thoughts on the big question, "Can LLMs reason?" Things worth paying attention to: New open models like GLM-5 have surprisingly improved on complex reasoning and long-running agentic tasks. The AskUserQuestion tool in Claude Code came in handy to select the council and chairperson. As Andrej Karpathy puts it, it's a really interesting way to get different perspectives from LLMs, which can lead to better decision-making on whatever task you are working on. You can use it for other agentic coding use cases, like evaluation, tool building, designing, and research.

Excited to present the LLM-Council skill. Initial idea by Karpathy. I just packaged it as a skill. You can easily spin up a council of LLMs or agents via Fireworks AI. Watch how the new GLM-5 model "deliberates" on other LLMs' thoughts on the big question, "Can LLMs reason?" Things worth paying attention to: New open models like GLM-5 have surprisingly improved on complex reasoning and long-running agentic tasks. The AskUserQuestion tool in Claude Code came in handy to select the council and chairperson. As Andrej Karpathy puts it, it's a really interesting way to get different perspectives from LLMs, which can lead to better decision-making on whatever task you are working on. You can use it for other agentic coding use cases, like evaluation, tool building, designing, and research.

elvis

39,452 views • 4 months ago

Releasing kyutai pocket TTS inference in webgpu today — it’s open-source, here’s a demo from my phone It took a while and a bunch of code to implement streaming inference from scratch!

Releasing kyutai pocket TTS inference in webgpu today — it’s open-source, here’s a demo from my phone It took a while and a bunch of code to implement streaming inference from scratch!

Eric Zhang

22,085 views • 5 months ago

AkashML is live! A fully managed AI inference service on Akash Network. Deploying open models like DeepSeek shouldn’t cost $50K/month or require complex setup. AkashML makes inference simple, affordable, and automatic, so developers can run AI workloads on decentralized GPUs with ease. Try it out here 👇 Read More about it Here 👇

AkashML is live! A fully managed AI inference service on Akash Network. Deploying open models like DeepSeek shouldn’t cost $50K/month or require complex setup. AkashML makes inference simple, affordable, and automatic, so developers can run AI workloads on decentralized GPUs with ease. Try it out here 👇 Read More about it Here 👇

Akash Network

37,017 views • 7 months ago

English Is The New SQL LLMs have made it easy for everyone to create on-the-fly dashboards and plots. You can connect to your database and then use a SOTA LLM like 4o, Opus, or Gemini to generate SQL and Python code to create on-the-fly dashboards and plots. ChatLLM makes it possible across all state-of-the-art LLMs -

English Is The New SQL LLMs have made it easy for everyone to create on-the-fly dashboards and plots. You can connect to your database and then use a SOTA LLM like 4o, Opus, or Gemini to generate SQL and Python code to create on-the-fly dashboards and plots. ChatLLM makes it possible across all state-of-the-art LLMs -

Bindu Reddy

50,564 views • 2 years ago

Looking for a seamless way to use local models in your development? With the AI Toolkit extension, you can now access the power of Foundry Local models, directly in Visual Studio Code. Read more in the latest blog:

Looking for a seamless way to use local models in your development? With the AI Toolkit extension, you can now access the power of Foundry Local models, directly in Visual Studio Code. Read more in the latest blog:

Visual Studio Code

26,628 views • 9 months ago

⚙️ The new Profiles editor in Visual Studio Code makes it simple to manage your profiles in one place, so you can easily switch between different setups. Watch how you can quickly view all of your existing profiles and create a new profile + configure its source of contents.

Visual Studio Code

42,453 views • 1 year ago

🚀 1/7 We are thrilled to launch LLM360 — pushing the frontier of open-source & transparent LLMs! Starting with Amber (7B) & CrystalCoder (7B), we are releasing brand new pre-trained LLMs with all training code, data, and up to 360 model checkpoints. 🔗

LLM360

329,446 views • 2 years ago

start agents with giants like Llama 4, with only one line of code 🔥 Hugging Face Inference Providers 🤝 smolagents

start agents with giants like Llama 4, with only one line of code 🔥 Hugging Face Inference Providers 🤝 smolagents

merve

19,267 views • 1 year ago

🤯 Wow! In one prompt Qwen3-Coder-Next generated a fully working flappy birds game in HTML. (0:05) Claude Code with Qwen3-Coder-Next (0:26) Shows the game running Run it fully locally: ollama pull qwen3-coder-next Ollama's cloud if you can't run it locally: ollama pull qwen3-coder-next:cloud Try launching it with Claude Code using ollama launch (link to play 🧵) So cool! Qwen Tongyi Lab Junyang Lin

🤯 Wow! In one prompt Qwen3-Coder-Next generated a fully working flappy birds game in HTML. (0:05) Claude Code with Qwen3-Coder-Next (0:26) Shows the game running Run it fully locally: ollama pull qwen3-coder-next Ollama's cloud if you can't run it locally: ollama pull qwen3-coder-next:cloud Try launching it with Claude Code using ollama launch (link to play 🧵) So cool! Qwen Tongyi Lab Junyang Lin

ollama

117,339 views • 4 months ago

Open source like DeepSeek doesn’t shrink markets. It grows them. Faster, cheaper training means rising inference demand and a new era of AI hardware.

Open source like DeepSeek doesn’t shrink markets. It grows them. Faster, cheaper training means rising inference demand and a new era of AI hardware.

The Linux Foundation

32,930 views • 1 year ago

Qwen3-Coder inference on AI Gateway now runs on , joining existing support from @deepinfra and Parasail.

Qwen3-Coder inference on AI Gateway now runs on , joining existing support from @deepinfra and Parasail.

Vercel Developers

29,351 views • 10 months ago

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

Madison Kanna

119,268 views • 3 months ago

i had opus credits to burn so i recreated github with instant navigation and the ui that i would want you can use it today most of your workflow should work on it, private repos are supported, and it's open source

i had opus credits to burn so i recreated github with instant navigation and the ui that i would want you can use it today most of your workflow should work on it, private repos are supported, and it's open source

Rhys

161,535 views • 4 months ago

Open Interpreter is like ChatGPT Code Interpreter, but you can run it locally on your computer, and it is 100% open-source. Write and execute code, analyze data, control your computer, and more. Great work killian Here's how to install and use it: 👇

Open Interpreter is like ChatGPT Code Interpreter, but you can run it locally on your computer, and it is 100% open-source. Write and execute code, analyze data, control your computer, and more. Great work killian Here's how to install and use it: 👇

Matthew Berman

142,901 views • 2 years ago

Today we're excited to introduce Multi-Model Sessions! — Load & prompt multiple local LLMs simultaneously — Use the API to build networks, pipelines of LLMs that can talk with each other — Use the new JSON Mode to constrain each model's output format LM Studio 0.2.17 is available for Mac, Windows, and Linux. Get it here:

Today we're excited to introduce Multi-Model Sessions! — Load & prompt multiple local LLMs simultaneously — Use the API to build networks, pipelines of LLMs that can talk with each other — Use the new JSON Mode to constrain each model's output format LM Studio 0.2.17 is available for Mac, Windows, and Linux. Get it here:

LM Studio

89,817 views • 2 years ago