Загрузка видео...

Не удалось загрузить видео

На главную

BOOM! Starting today you can use open source frontier LLMs in Visual Studio Code with HF Inference Providers! 🔥 Use your inference credits on SoTA llms like GLM 4.5, Qwen3 Coder, DeepSeek 3.1 and more All of it packaged in one simple extension - try it out today 🤗

reach_vb's profile picture

Vaibhav (VB) Srivastav

54,654 subscribers

41,201 просмотров • 1 год назад •via X (Twitter)

Наука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

You can now run Nebius AI Studio models directly in Visual Studio Code, just select Hugging Face as your Copilot provider and enter your HF key. ✅ Use models like Qwen, DeepSeek, Kimi, GLM ⚡ Powered by Nebius inference infrastructure Open models, instant APIs, zero setup.
0:27

You can now run Nebius AI Studio models directly in Visual Studio Code, just select Hugging Face as your Copilot provider and enter your HF key. ✅ Use models like Qwen, DeepSeek, Kimi, GLM ⚡ Powered by Nebius inference infrastructure Open models, instant APIs, zero setup.

Nebius Token Factory

12,247 просмотров • 1 год назад

Cerebras Inference powers the world's top models - like Qwen3 Coder at 2000 tokens/s 🤯 And you can now access these models directly in Visual Studio Code with the extension and an API key (that you can get for free from
0:22

Cerebras Inference powers the world's top models - like Qwen3 Coder at 2000 tokens/s 🤯 And you can now access these models directly in Visual Studio Code with the extension and an API key (that you can get for free from

Visual Studio Code

57,423 просмотров • 1 год назад

Open source/weight models are often used in regulated industries like Health Care or Financial Services, where they handle personally identifiable data, and can't send it to proprietary LLM providers. We recently chatted to Vaibhav (VB) Srivastav about the partnership VS Visual Studio Code and Hugging Face inference providers have to let you use open weight models directly in your IDE! Something that surprised me was just how fast inference providers like Cerebras make it to generate code! In this episode we made a journaling CLI tool using Qwen! I personally love open source and hope more of these models will become small enough to run locally!
1:36

Open source/weight models are often used in regulated industries like Health Care or Financial Services, where they handle personally identifiable data, and can't send it to proprietary LLM providers. We recently chatted to Vaibhav (VB) Srivastav about the partnership VS Visual Studio Code and Hugging Face inference providers have to let you use open weight models directly in your IDE! Something that surprised me was just how fast inference providers like Cerebras make it to generate code! In this episode we made a journaling CLI tool using Qwen! I personally love open source and hope more of these models will become small enough to run locally!

Marlene Mhangami

18,215 просмотров • 11 месяцев назад

How can we use small LLMs to shift more AI workloads onto our laptops and phones? In our paper and open-source code, we pair on-device LLMs (ollama) with frontier LLMs in the cloud (OpenAI, Together), to solve token-intensive workloads on your 💻 at 17.5% of the cloud cost while maintaining 97.9% of the accuracy. See Gru and the Minions in action below, 🔉on please (h/t )!
1:39

How can we use small LLMs to shift more AI workloads onto our laptops and phones? In our paper and open-source code, we pair on-device LLMs (ollama) with frontier LLMs in the cloud (OpenAI, Together), to solve token-intensive workloads on your 💻 at 17.5% of the cloud cost while maintaining 97.9% of the accuracy. See Gru and the Minions in action below, 🔉on please (h/t )!

Dan Biderman

193,829 просмотров • 1 год назад

This is HUGE, Hugging Face just shipped Inference Providers on the Hub Partnering with Together AI, @FAL, Replicate and SambaNova! Starting today you can access thousands of Models like DeepSeek R1, Llama, Flux, Whisper, and more Directly from Hugging Face!
0:21

This is HUGE, Hugging Face just shipped Inference Providers on the Hub Partnering with Together AI, @FAL, Replicate and SambaNova! Starting today you can access thousands of Models like DeepSeek R1, Llama, Flux, Whisper, and more Directly from Hugging Face!

AK

177,217 просмотров • 1 год назад

🚨 Frontier Model Router - Mix And Match All the Frontier LLMs Our most popular custom router is our frontier-model router that combines the best LLMs for all your tasks GPT 5.6 sol - data analysis Fable / Opus 4.8 - coding Flash 3.5 - summarization Grok 4.5 - real-time Pick your favorite LLMs for all your tasks. As of today the custom routers can be used in ANY harness - Abacus AI, Claude, Codex, Open-Code....
1:21

🚨 Frontier Model Router - Mix And Match All the Frontier LLMs Our most popular custom router is our frontier-model router that combines the best LLMs for all your tasks GPT 5.6 sol - data analysis Fable / Opus 4.8 - coding Flash 3.5 - summarization Grok 4.5 - real-time Pick your favorite LLMs for all your tasks. As of today the custom routers can be used in ANY harness - Abacus AI, Claude, Codex, Open-Code....

Bindu Reddy

4,592,609 просмотров • 3 месяцев назад

Excited to present the LLM-Council skill. Initial idea by Karpathy. I just packaged it as a skill. You can easily spin up a council of LLMs or agents via Fireworks. Watch how the new GLM-5 model "deliberates" on other LLMs' thoughts on the big question, "Can LLMs reason?" Things worth paying attention to: New open models like GLM-5 have surprisingly improved on complex reasoning and long-running agentic tasks. The AskUserQuestion tool in Claude Code came in handy to select the council and chairperson. As Andrej Karpathy puts it, it's a really interesting way to get different perspectives from LLMs, which can lead to better decision-making on whatever task you are working on. You can use it for other agentic coding use cases, like evaluation, tool building, designing, and research.
0:35

Excited to present the LLM-Council skill. Initial idea by Karpathy. I just packaged it as a skill. You can easily spin up a council of LLMs or agents via Fireworks. Watch how the new GLM-5 model "deliberates" on other LLMs' thoughts on the big question, "Can LLMs reason?" Things worth paying attention to: New open models like GLM-5 have surprisingly improved on complex reasoning and long-running agentic tasks. The AskUserQuestion tool in Claude Code came in handy to select the council and chairperson. As Andrej Karpathy puts it, it's a really interesting way to get different perspectives from LLMs, which can lead to better decision-making on whatever task you are working on. You can use it for other agentic coding use cases, like evaluation, tool building, designing, and research.

elvis

39,654 просмотров • 8 месяцев назад

Meet June: your private AI agent now with local models on your Mac. Turn the wifi off: Agent, dictation, meeting notes, and your files all in one workspace. 100% free to use with local inference. Open Source. MIT. Local first. Try it:
0:49

Meet June: your private AI agent now with local models on your Mac. Turn the wifi off: Agent, dictation, meeting notes, and your files all in one workspace. 100% free to use with local inference. Open Source. MIT. Local first. Try it:

OpenSoftware

17,471 просмотров • 4 месяцев назад

Releasing kyutai pocket TTS inference in webgpu today — it’s open-source, here’s a demo from my phone It took a while and a bunch of code to implement streaming inference from scratch!
0:29

Releasing kyutai pocket TTS inference in webgpu today — it’s open-source, here’s a demo from my phone It took a while and a bunch of code to implement streaming inference from scratch!

Eric Zhang

22,085 просмотров • 9 месяцев назад

AkashML is live! A fully managed AI inference service on Akash Network. Deploying open models like DeepSeek shouldn’t cost $50K/month or require complex setup. AkashML makes inference simple, affordable, and automatic, so developers can run AI workloads on decentralized GPUs with ease. Try it out here 👇 Read More about it Here 👇
0:39

AkashML is live! A fully managed AI inference service on Akash Network. Deploying open models like DeepSeek shouldn’t cost $50K/month or require complex setup. AkashML makes inference simple, affordable, and automatic, so developers can run AI workloads on decentralized GPUs with ease. Try it out here 👇 Read More about it Here 👇

Akash Network

37,113 просмотров • 11 месяцев назад

English Is The New SQL LLMs have made it easy for everyone to create on-the-fly dashboards and plots. You can connect to your database and then use a SOTA LLM like 4o, Opus, or Gemini to generate SQL and Python code to create on-the-fly dashboards and plots. ChatLLM makes it possible across all state-of-the-art LLMs -
0:27

English Is The New SQL LLMs have made it easy for everyone to create on-the-fly dashboards and plots. You can connect to your database and then use a SOTA LLM like 4o, Opus, or Gemini to generate SQL and Python code to create on-the-fly dashboards and plots. ChatLLM makes it possible across all state-of-the-art LLMs -

Bindu Reddy

50,569 просмотров • 2 лет назад

I installed a new Visual Studio Code extension to help me write code. But this extension doesn't get in your way. It doesn't try to write code for you. It only gives you hints and recommendations about your code. I like that. Like a second pair of eyes, looking over my shoulder and telling me how I can do things better. The extension is Traycer. You can install it directly from inside Visual Studio Code. It's free forever for anyone working on open-source projects (and if you aren't, you can use it for free until the end of June.) I recorded a super-duper-quick video to show you how this extension works. I know code generation is a huge thing, but I really appreciate tools that help me do what I do better. Thanks to the Traycer team for helping me with the extension and collaborating with me on this post!
2:56

I installed a new Visual Studio Code extension to help me write code. But this extension doesn't get in your way. It doesn't try to write code for you. It only gives you hints and recommendations about your code. I like that. Like a second pair of eyes, looking over my shoulder and telling me how I can do things better. The extension is Traycer. You can install it directly from inside Visual Studio Code. It's free forever for anyone working on open-source projects (and if you aren't, you can use it for free until the end of June.) I recorded a super-duper-quick video to show you how this extension works. I know code generation is a huge thing, but I really appreciate tools that help me do what I do better. Thanks to the Traycer team for helping me with the extension and collaborating with me on this post!

Santiago

101,068 просмотров • 2 лет назад

Introducing Liquid Inference by Architect, a new LLM model router where inference providers compete dynamically to offer lowest-cost tokens. Providers onboard in minutes, not weeks. Buyers have full price visibility and receive 20% of referred fees in free inference. More info: Liquid Inference can be used in place of any OpenAI or Anthropic API-compatible backend. Behind it, our team has leveraged our experience trading and building financial exchanges to create real-time two-sided price discovery for inference. Benefits for buyers and providers: INFERENCE BUYERS • Fully compatible with agentic coding tools: Claude Code, Codex, OpenCode, Cursor, Pi, Cline, and many more. Full multi-modal support. • Hundreds of open- and closed-weight models. Create routing rule presets or use our Auto routing algorithms. • Providers compete dynamically on price for every prompt, offering the lowest marginal cost. • Sign up for free with email, first 500 users get $20 of free inference. • Receive 20% of referred fees as free inference, 10% for second-level referrals. INFERENCE PROVIDERS • Onboard through the Liquid Inference app. We verify new providers in minutes, not weeks. • All prompts are OpenAI API standard. Simple REST/Websocket API to register models and quotes. • Update quotes dynamically based on your own costs. Monetize GPU capacity only when you want. • Standardize payouts via Stripe, full itemized records of all jobs performed.
0:44

Introducing Liquid Inference by Architect, a new LLM model router where inference providers compete dynamically to offer lowest-cost tokens. Providers onboard in minutes, not weeks. Buyers have full price visibility and receive 20% of referred fees in free inference. More info: Liquid Inference can be used in place of any OpenAI or Anthropic API-compatible backend. Behind it, our team has leveraged our experience trading and building financial exchanges to create real-time two-sided price discovery for inference. Benefits for buyers and providers: INFERENCE BUYERS • Fully compatible with agentic coding tools: Claude Code, Codex, OpenCode, Cursor, Pi, Cline, and many more. Full multi-modal support. • Hundreds of open- and closed-weight models. Create routing rule presets or use our Auto routing algorithms. • Providers compete dynamically on price for every prompt, offering the lowest marginal cost. • Sign up for free with email, first 500 users get $20 of free inference. • Receive 20% of referred fees as free inference, 10% for second-level referrals. INFERENCE PROVIDERS • Onboard through the Liquid Inference app. We verify new providers in minutes, not weeks. • All prompts are OpenAI API standard. Simple REST/Websocket API to register models and quotes. • Update quotes dynamically based on your own costs. Monetize GPU capacity only when you want. • Standardize payouts via Stripe, full itemized records of all jobs performed.

Brett Harrison

39,450 просмотров • 1 месяц назад

Looking for a seamless way to use local models in your development? With the AI Toolkit extension, you can now access the power of Foundry Local models, directly in Visual Studio Code. Read more in the latest blog:
0:40

Looking for a seamless way to use local models in your development? With the AI Toolkit extension, you can now access the power of Foundry Local models, directly in Visual Studio Code. Read more in the latest blog:

Visual Studio Code

26,634 просмотров • 1 год назад

⚙️ The new Profiles editor in Visual Studio Code makes it simple to manage your profiles in one place, so you can easily switch between different setups. Watch how you can quickly view all of your existing profiles and create a new profile + configure its source of contents.
1:00

⚙️ The new Profiles editor in Visual Studio Code makes it simple to manage your profiles in one place, so you can easily switch between different setups. Watch how you can quickly view all of your existing profiles and create a new profile + configure its source of contents.

Visual Studio Code

42,459 просмотров • 2 лет назад

🚀 1/7 We are thrilled to launch LLM360 — pushing the frontier of open-source & transparent LLMs! Starting with Amber (7B) & CrystalCoder (7B), we are releasing brand new pre-trained LLMs with all training code, data, and up to 360 model checkpoints. 🔗
0:25

🚀 1/7 We are thrilled to launch LLM360 — pushing the frontier of open-source & transparent LLMs! Starting with Amber (7B) & CrystalCoder (7B), we are releasing brand new pre-trained LLMs with all training code, data, and up to 360 model checkpoints. 🔗

LLM360

329,563 просмотров • 2 лет назад

🤯 Wow! In one prompt Qwen3-Coder-Next generated a fully working flappy birds game in HTML. (0:05) Claude Code with Qwen3-Coder-Next (0:26) Shows the game running Run it fully locally: ollama pull qwen3-coder-next Ollama's cloud if you can't run it locally: ollama pull qwen3-coder-next:cloud Try launching it with Claude Code using ollama launch (link to play 🧵) So cool! Qwen Tongyi Lab Junyang Lin
0:43

🤯 Wow! In one prompt Qwen3-Coder-Next generated a fully working flappy birds game in HTML. (0:05) Claude Code with Qwen3-Coder-Next (0:26) Shows the game running Run it fully locally: ollama pull qwen3-coder-next Ollama's cloud if you can't run it locally: ollama pull qwen3-coder-next:cloud Try launching it with Claude Code using ollama launch (link to play 🧵) So cool! Qwen Tongyi Lab Junyang Lin

ollama

117,716 просмотров • 9 месяцев назад

Ad | Lately I've been testing several OpenAI-compatible inference providers. One that stood out: Jalapeno Cloud. One API for DeepSeek, GLM, Kimi, MiniMax and more. It's not a pure reseller either: they run their own GPU clusters in Japan and Singapore.
0:23

Ad | Lately I've been testing several OpenAI-compatible inference providers. One that stood out: Jalapeno Cloud. One API for DeepSeek, GLM, Kimi, MiniMax and more. It's not a pure reseller either: they run their own GPU clusters in Japan and Singapore.

Rakib Hossen

14,392 просмотров • 9 дней назад

Don't waste 2 years learning to use LLMs like Claude & ChatGPT. Andrej Karpathy, the godfather of AI, dropped a 2 hour course on how he personally uses LLMs daily. • 00:00 - LLMs simplified • 22:49 - which LLM to actually use • 42:00 - one prompt for full research • 1:13:57 - how to code with LLMs • 1:37:04 - NotebookLM podcast generation This course will teach you more about using LLMs than most AI engineers learn in their entire career. Bookmark this & give 2 hours today, no matter what. Then read the article below.
2:11:07

Don't waste 2 years learning to use LLMs like Claude & ChatGPT. Andrej Karpathy, the godfather of AI, dropped a 2 hour course on how he personally uses LLMs daily. • 00:00 - LLMs simplified • 22:49 - which LLM to actually use • 42:00 - one prompt for full research • 1:13:57 - how to code with LLMs • 1:37:04 - NotebookLM podcast generation This course will teach you more about using LLMs than most AI engineers learn in their entire career. Bookmark this & give 2 hours today, no matter what. Then read the article below.

Roan

57,188 просмотров • 3 месяцев назад