正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Dexter can now use local LLMs. We finally added ollama support today. Includes models like: • qwen 3 • gemma 3 • deepseek r1 Because Dexter is built on LangChain, switching between local and cloud models is easy. Huge thanks to Harsh Gupta for shipping this.

virat

44,990 subscribers

36,456 次观看 • 7 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

I’ve been building Dexter for 2 months now. It’s like Claude Code, but for finance. What Dexter can do: • find undervalued stocks • analyze them in detail • build investment thesis All of the code is open source. Bonus: Dexter can also run on local LLMs.

I’ve been building Dexter for 2 months now. It’s like Claude Code, but for finance. What Dexter can do: • find undervalued stocks • analyze them in detail • build investment thesis All of the code is open source. Bonus: Dexter can also run on local LLMs.

Virat Singh

553,544 次观看 • 7 个月前

Ollama can now think! 🤔🤔🤔 For thinking models, and especially useful for very thoughtful models like DeepSeek-R1-0528, Ollama can separate the thoughts and the response. Thinking can also be disabled! This is useful for getting a direct response. This works across Ollama's CLI, API, and Python/JavaScript libraries. 🧵 blog post 👇👇👇

Ollama can now think! 🤔🤔🤔 For thinking models, and especially useful for very thoughtful models like DeepSeek-R1-0528, Ollama can separate the thoughts and the response. Thinking can also be disabled! This is useful for getting a direct response. This works across Ollama's CLI, API, and Python/JavaScript libraries. 🧵 blog post 👇👇👇

ollama

106,287 次观看 • 1 年前

Check this!! A 100% open-source toolkit to work with LLMs. Transformer Lab is an app to experiment with LLMs: - Train, fine-tune, or chat. - One-click LLM download (DeepSeek, Gemma, etc.) - Drag-n-drop UI for RAG. - Built-in logging, and more. 100% local!

Check this!! A 100% open-source toolkit to work with LLMs. Transformer Lab is an app to experiment with LLMs: - Train, fine-tune, or chat. - One-click LLM download (DeepSeek, Gemma, etc.) - Drag-n-drop UI for RAG. - Built-in logging, and more. 100% local!

Avi Chawla

74,961 次观看 • 1 年前

DeepSeek R1 is *the* best model available right now. It's at the level of o1, but you can use it for free, and it's much faster. A huge leap forward that nobody saw coming. No wonder so many people are throwing tantrums online trying to discredit the Chinese students who built this. You can use DeepSeek in Visual Studio Code right now: 1. Install the Qodo Gen AI extension 2. Select DeepSeek R1 from their list of models The Qodo team is hosting DeepSeek on their servers, so none of your data will go to China. I've been building a Tetris game using DeepSeek, and this is the most impressive model I've seen so far.

DeepSeek R1 is the best model available right now. It's at the level of o1, but you can use it for free, and it's much faster. A huge leap forward that nobody saw coming. No wonder so many people are throwing tantrums online trying to discredit the Chinese students who built this. You can use DeepSeek in Visual Studio Code right now: 1. Install the Qodo Gen AI extension 2. Select DeepSeek R1 from their list of models The Qodo team is hosting DeepSeek on their servers, so none of your data will go to China. I've been building a Tetris game using DeepSeek, and this is the most impressive model I've seen so far.

Santiago

1,224,318 次观看 • 1 年前

Jan Desktop v0.7.7 is live 💛 This update brings native MLX support on macOS, a broader UX and UI refresh across the app, and better support for developer workflows. You can now upload files in Projects, use the local API server with both local and remote models, and work more smoothly with tools like Claude Code and other CLIs. Update your Jan or download the latest version at

Jan Desktop v0.7.7 is live 💛 This update brings native MLX support on macOS, a broader UX and UI refresh across the app, and better support for developer workflows. You can now upload files in Projects, use the local API server with both local and remote models, and work more smoothly with tools like Claude Code and other CLIs. Update your Jan or download the latest version at

👋 Jan

28,378 次观看 • 6 个月前

The leading model runnable on a single cloud H100 GPU now fits on a single home GPU! 🔥 We've optimized Gemma 3 27B with QAT so you can run our best-in-class open model on your desktop RTX 3090 or similar. See how easy it is to try via ollama! 👇

The leading model runnable on a single cloud H100 GPU now fits on a single home GPU! 🔥 We've optimized Gemma 3 27B with QAT so you can run our best-in-class open model on your desktop RTX 3090 or similar. See how easy it is to try via ollama! 👇

Glenn Cameron Jr

81,427 次观看 • 1 年前

Found a big collection of jailbreaks Prompt collections for working with GPT, Claude, Gemini, DeepSeek, Grok, and more: github{.}com/... 1. elder-plinius/L1B3RT4S > GitHub stars: 21K > supports models: ChatGPT, Claude, Gemini, DeepSeek, Grok, Llama, Copilot, Cursor, Perplexity 2. ShadowHackrs/Jailbreaks-GPT-Gemini-deepseek- > GitHub stars: 1.1K > supports models: GPT, Sora, Claude, Gemini, DeepSeek 3. Calrton/jailbreak-prompts > GitHub stars: 86 > supports models: Codex, GPT-5.x, Claude, Gemini, DeepSeek, Grok 4. Quincunx33/Ai-jailbreak > GitHub stars: 10 > supports models: Qwen 3.5, Gemma 4, Llama 4, Kimi K3, GPT-5.x, Gemini 3.x, Grok 4.x Found this while digging deeper after the GPT 5.6 prompt. The repo ecosystem is way bigger than the jailbreak itself.

Found a big collection of jailbreaks Prompt collections for working with GPT, Claude, Gemini, DeepSeek, Grok, and more: github{.}com/... 1. elder-plinius/L1B3RT4S > GitHub stars: 21K > supports models: ChatGPT, Claude, Gemini, DeepSeek, Grok, Llama, Copilot, Cursor, Perplexity 2. ShadowHackrs/Jailbreaks-GPT-Gemini-deepseek- > GitHub stars: 1.1K > supports models: GPT, Sora, Claude, Gemini, DeepSeek 3. Calrton/jailbreak-prompts > GitHub stars: 86 > supports models: Codex, GPT-5.x, Claude, Gemini, DeepSeek, Grok 4. Quincunx33/Ai-jailbreak > GitHub stars: 10 > supports models: Qwen 3.5, Gemma 4, Llama 4, Kimi K3, GPT-5.x, Gemini 3.x, Grok 4.x Found this while digging deeper after the GPT 5.6 prompt. The repo ecosystem is way bigger than the jailbreak itself.

kaize

68,127 次观看 • 10 天前

Gemma 4 is here! Our most intelligent open models to date, are built on the same world-class research and tech as Gemini 3, and are sized to run and fine-tune efficiently on local hardware. Check out what Google Gemma 4 brings to devs: 💎 Advanced Reasoning: Deep logic tasks, complex multi-step planning, and beyond 💎 Longer context: Seamlessly analyze entire codebases with context windows of 128K tokens for our edge models and 256K tokens for our largest models 💎 Vision and audio: Rich, multimodal interactions out of the box 💎 140+ languages: Trained on 140+ languages 💎 Apache 2.0 license: industry-standard open-source license

Gemma 4 is here! Our most intelligent open models to date, are built on the same world-class research and tech as Gemini 3, and are sized to run and fine-tune efficiently on local hardware. Check out what Google Gemma 4 brings to devs: 💎 Advanced Reasoning: Deep logic tasks, complex multi-step planning, and beyond 💎 Longer context: Seamlessly analyze entire codebases with context windows of 128K tokens for our edge models and 256K tokens for our largest models 💎 Vision and audio: Rich, multimodal interactions out of the box 💎 140+ languages: Trained on 140+ languages 💎 Apache 2.0 license: industry-standard open-source license

Google for Developers

269,912 次观看 • 5 个月前

Right now, you may not have access to models like GPT‑5.6 Sol, GPT‑4.6 Terra, GPT‑5.6 Luna, Claude Mythos 5, or Claude Fable 5. But you can run something surprisingly powerful today, locally, and completely free. in the next 10 mins on your 8 GB VRAM gaming laptop. Gemma 4 26B A4B QAT (MoE) delivers strong performance on a standard 8 GB VRAM GPU using Ollama, with no API, no usage limits, and no external dependencies. Out of the box, it reaches around 20 tokens per second without any optimizations. Only one command in your terminal: Ollama run gemma4:26b This means: Full offline capability (privacy by default) Zero recurring cost Competitive performance for many real world tasks Fast enough for interactive use on cheap consumer hardware If you're waiting for cutting edge cloud models, you're missing what is already practical today: a capable, local LLM that runs entirely on your own machine.

Right now, you may not have access to models like GPT‑5.6 Sol, GPT‑4.6 Terra, GPT‑5.6 Luna, Claude Mythos 5, or Claude Fable 5. But you can run something surprisingly powerful today, locally, and completely free. in the next 10 mins on your 8 GB VRAM gaming laptop. Gemma 4 26B A4B QAT (MoE) delivers strong performance on a standard 8 GB VRAM GPU using Ollama, with no API, no usage limits, and no external dependencies. Out of the box, it reaches around 20 tokens per second without any optimizations. Only one command in your terminal: Ollama run gemma4:26b This means: Full offline capability (privacy by default) Zero recurring cost Competitive performance for many real world tasks Fast enough for interactive use on cheap consumer hardware If you're waiting for cutting edge cloud models, you're missing what is already practical today: a capable, local LLM that runs entirely on your own machine.

Alok

65,387 次观看 • 2 个月前

Claude fable 5 is cooked Claude fable 5 Vs Gemma 4 26b a4b qat MTP Gemma 4 26b running locally on my 8GB vram single RTX 4060 built this using three.js in a single session and 3 prompts. no cloud, no subscription 100% private unlimited use. how long until it can catch up completely?

Claude fable 5 is cooked Claude fable 5 Vs Gemma 4 26b a4b qat MTP Gemma 4 26b running locally on my 8GB vram single RTX 4060 built this using three.js in a single session and 3 prompts. no cloud, no subscription 100% private unlimited use. how long until it can catch up completely?

Alok

30,802 次观看 • 2 个月前

most of you don't know how hard hermes agent is optimized for local AI at the system level. watch the full setup flow on screen. you paste an openai-compatible v1 endpoint, hermes auto-detects every model running behind it. doesn't matter if it's llama.cpp or vllm or any compatible server, all your models surface and become selectable in seconds. no config gymnastics, no manual model list. then it goes deeper. hermes ships with per model parsers, prompt template auto-handling, tool call format detection per model architecture, thinking mode awareness, all the small friction points other harnesses leak on. these were not built for cloud apis with one canonical model. they were built for builders running 10 different local models across 10 different stacks. cloud first harnesses bolt local support on top. hermes agent is local first from the architecture out. that's the system level gap. if you're getting started on local AI, this is the harness you start with. try for yourself and find out. anyone serious about local AI lands here eventually.

most of you don't know how hard hermes agent is optimized for local AI at the system level. watch the full setup flow on screen. you paste an openai-compatible v1 endpoint, hermes auto-detects every model running behind it. doesn't matter if it's llama.cpp or vllm or any compatible server, all your models surface and become selectable in seconds. no config gymnastics, no manual model list. then it goes deeper. hermes ships with per model parsers, prompt template auto-handling, tool call format detection per model architecture, thinking mode awareness, all the small friction points other harnesses leak on. these were not built for cloud apis with one canonical model. they were built for builders running 10 different local models across 10 different stacks. cloud first harnesses bolt local support on top. hermes agent is local first from the architecture out. that's the system level gap. if you're getting started on local AI, this is the harness you start with. try for yourself and find out. anyone serious about local AI lands here eventually.

Sudo su

14,407 次观看 • 3 个月前

wow, this new AI is incredible Promptly can generate prompts for specific AI models like ChatGPT, Midjourney, many video generators and.. guide you how to make it better, this is super useful free to use now 7 examples:

wow, this new AI is incredible Promptly can generate prompts for specific AI models like ChatGPT, Midjourney, many video generators and.. guide you how to make it better, this is super useful free to use now 7 examples:

el.cine

130,286 次观看 • 1 年前

🚨 do you understand what is happening?! OpenAI and Anthropic are putting the best models behind approval lists. Meanwhile GLM 5.2 is running locally on a Mac Studio, coding in a loop 24/7. If someone can turn off your AI, you are renting your intelligence layer. Local models are getting so good now that you can create gameplays like this.👇

🚨 do you understand what is happening?! OpenAI and Anthropic are putting the best models behind approval lists. Meanwhile GLM 5.2 is running locally on a Mac Studio, coding in a loop 24/7. If someone can turn off your AI, you are renting your intelligence layer. Local models are getting so good now that you can create gameplays like this.👇

Vadim

14,609 次观看 • 2 个月前

MRC is already deployed across all of OpenAI’s largest supercomputers that we use to train frontier models, including our site with Oracle Cloud Infrastructure (OCI) in Abilene, Texas, and in Microsoft’s Fairwater supercomputers. MRC is now available through the Open Compute Project for the entire industry to use and build on.

MRC is already deployed across all of OpenAI’s largest supercomputers that we use to train frontier models, including our site with Oracle Cloud Infrastructure (OCI) in Abilene, Texas, and in Microsoft’s Fairwater supercomputers. MRC is now available through the Open Compute Project for the entire industry to use and build on.

OpenAI

146,115 次观看 • 3 个月前

Our open-source RAG app, Verba, can now run Ollama models locally to embed documents into Weaviate and generate answers without your data leaving your device! I tested it with Llama3, and it works great + super quickly on my M2; In this recording, I'm doing a little Verba-ception, asking Verba what Verba is 🤤 You can also use open-source models like Mistral, Claude, or your own custom LLMs. This will make doing RAG with sensitive data possible since you won't depend on APIs anymore. Looking forward to everyone trying it out 🤗 Update's coming next week!

Our open-source RAG app, Verba, can now run Ollama models locally to embed documents into Weaviate and generate answers without your data leaving your device! I tested it with Llama3, and it works great + super quickly on my M2; In this recording, I'm doing a little Verba-ception, asking Verba what Verba is 🤤 You can also use open-source models like Mistral, Claude, or your own custom LLMs. This will make doing RAG with sensitive data possible since you won't depend on APIs anymore. Looking forward to everyone trying it out 🤗 Update's coming next week!

Edward

125,582 次观看 • 2 年前

Introducing Jan v3, with updates to Jan Desktop v0.7.6 💛 Jan v3 is our first v3 model, a 4B base built for fine-tuning and fast local use, with stronger math and coding. This release also includes a small Jan Desktop update, starting with a UI refresh as we move toward a more unified Jan experience. Try it: - Jan v3 is available in Jan Desktop and at - Get the latest desktop app at Model: - Jan-v3-4B: - Jan-v3-4B-GGUF: Thanks Qwen for the base model and Georgi Gerganov for llama.cpp 💛

Introducing Jan v3, with updates to Jan Desktop v0.7.6 💛 Jan v3 is our first v3 model, a 4B base built for fine-tuning and fast local use, with stronger math and coding. This release also includes a small Jan Desktop update, starting with a UI refresh as we move toward a more unified Jan experience. Try it: - Jan v3 is available in Jan Desktop and at - Get the latest desktop app at Model: - Jan-v3-4B: - Jan-v3-4B-GGUF: Thanks Qwen for the base model and Georgi Gerganov for llama.cpp 💛

👋 Jan

53,900 次观看 • 7 个月前

Frontier world models now run on edge GPUs. ⚡ Now openly available, NVIDIA Cosmos 3 Edge brings advanced world-model capabilities to local devices. The 4-billion-parameter omnimodel can understand and generate text, image, video, ambient sound and action for physical AI across robotics, autonomous vehicles and smart infrastructure. 🔗 #SIGGRAPH2026

Frontier world models now run on edge GPUs. ⚡ Now openly available, NVIDIA Cosmos 3 Edge brings advanced world-model capabilities to local devices. The 4-billion-parameter omnimodel can understand and generate text, image, video, ambient sound and action for physical AI across robotics, autonomous vehicles and smart infrastructure. 🔗 #SIGGRAPH2026

NVIDIA

33,144 次观看 • 1 个月前

Throughout my journey in developing multimodal models, I’ve always wanted a framework that lets me plug & play modality encoders/decoders on top of an auto-regressive LLM. I want to prototype fast, try new architectures, and have my demo files scale effortlessly — with full support for parallelism and optimization. Not just to hack⚙️, but also to scale🚀. So finally we built it for ourselves. LMMs-Engine: a lean, efficient framework built to train unified multimodal model at scale. From Qwen LLM, VLM, LLaVA-OV, and WanVideo, to unified models like Qwen-Omni and BAGEL — plus Linear-Attn GDN and research prototypes like RAE and SiT - all under one modular system that seamlessly integrates diverse datasets and optimization strategies. Powered by FSDP2 multi-dim parallelism, Ulysses sequence parallel, Flash-Attention, Liger Kernels, and Native Sparse Attention (also with bonus support for the Muon optimizer for all models).

Throughout my journey in developing multimodal models, I’ve always wanted a framework that lets me plug & play modality encoders/decoders on top of an auto-regressive LLM. I want to prototype fast, try new architectures, and have my demo files scale effortlessly — with full support for parallelism and optimization. Not just to hack⚙️, but also to scale🚀. So finally we built it for ourselves. LMMs-Engine: a lean, efficient framework built to train unified multimodal model at scale. From Qwen LLM, VLM, LLaVA-OV, and WanVideo, to unified models like Qwen-Omni and BAGEL — plus Linear-Attn GDN and research prototypes like RAE and SiT - all under one modular system that seamlessly integrates diverse datasets and optimization strategies. Powered by FSDP2 multi-dim parallelism, Ulysses sequence parallel, Flash-Attention, Liger Kernels, and Native Sparse Attention (also with bonus support for the Muon optimizer for all models).

Brian Li

54,840 次观看 • 10 个月前