LM Studio's banner

LM Studio

@lmstudio • 60,953 subscribers

LM Studio Bionic is out now https://t.co/YS5uiRQFJg

Shorts

Batching for vision models is now available in Beta with our latest MLX engine update 👾 The updated engine also brings major improvements to caching for faster inference overall. Turn on Developer Mode, choose the beta runtime channel, and select LM Studio MLX v1.8.1.

Batching for vision models is now available in Beta with our latest MLX engine update 👾 The updated engine also brings major improvements to caching for faster inference overall. Turn on Developer Mode, choose the beta runtime channel, and select LM Studio MLX v1.8.1.

47,703 просмотров

LM Studio 0.3.4 ships with Apple MLX 🚢🍎 Run on-device LLMs super fast, 100% locally and offline on your Apple Silicon Mac! Includes: > run Llama 3.2 1B at ~250 tok/sec (!) on M3 > enforce structured JSON responses > use via chat UI, or from your own code > run multiple models simultaneously > download any model from Hugging Face Video at 1x speed.

LM Studio 0.3.4 ships with Apple MLX 🚢🍎 Run on-device LLMs super fast, 100% locally and offline on your Apple Silicon Mac! Includes: > run Llama 3.2 1B at ~250 tok/sec (!) on M3 > enforce structured JSON responses > use via chat UI, or from your own code > run multiple models simultaneously > download any model from Hugging Face Video at 1x speed.

171,777 просмотров

After months of work, and with the help of our awesome community, we're excited to finally share LM Studio 0.3.0! 🎉 🔥 What's new: - Built-in Chat with Documents, 100% offline - OpenAI-like 'Structured Outputs' API with any local model - Total UI revamp (with dark/light/sepia themes) - Load & serve multiple LLMs *on the local network* - Available in 7 languages! 🌎🌍🌏 - Download any supported model from Hugging Face - Update LLM runtimes (llama.cpp) separately from the app ... and tons more goodies! Let us know how you like it! 👾🤝

After months of work, and with the help of our awesome community, we're excited to finally share LM Studio 0.3.0! 🎉 🔥 What's new: - Built-in Chat with Documents, 100% offline - OpenAI-like 'Structured Outputs' API with any local model - Total UI revamp (with dark/light/sepia themes) - Load & serve multiple LLMs on the local network - Available in 7 languages! 🌎🌍🌏 - Download any supported model from Hugging Face - Update LLM runtimes (llama.cpp) separately from the app ... and tons more goodies! Let us know how you like it! 👾🤝

142,600 просмотров

Introducing Parallel Requests for MLX! Multiple requests to the same model can now be processed simultaneously ✨🚄⚡️ Works both in the API and in Split View chats. See it in action 👇🕺

Introducing Parallel Requests for MLX! Multiple requests to the same model can now be processed simultaneously ✨🚄⚡️ Works both in the API and in Split View chats. See it in action 👇🕺

40,805 просмотров

Thinking...

Thinking...

96,204 просмотров

LM Studio 0.3.10 is here with 🔮 Speculative Decoding! This provides inferencing speedups, in some cases 2x or more, with no degradation in quality. - Works for both GGUF/llama.cpp and MLX models! - Easily experiment with different draft models - Visualize accepted draft token % rate - Works in Chat UI and API

LM Studio 0.3.10 is here with 🔮 Speculative Decoding! This provides inferencing speedups, in some cases 2x or more, with no degradation in quality. - Works for both GGUF/llama.cpp and MLX models! - Easily experiment with different draft models - Visualize accepted draft token % rate - Works in Chat UI and API

73,791 просмотров

Counting penguins can be challenging 🧐🐧 New in LM Studio 0.2.9: 🎉 Local & Offline Vision Models! In this demo: the small and impressive Obsidian Vision 3B by Nous Research.

Counting penguins can be challenging 🧐🐧 New in LM Studio 0.2.9: 🎉 Local & Offline Vision Models! In this demo: the small and impressive Obsidian Vision 3B by Nous Research.

70,941 просмотров

New in LM Studio 0.3.27 💬🔍 Find in current chat, and search all of your chats! ⌘/Ctrl + F ⌘/Ctrl + Shift + F

New in LM Studio 0.3.27 💬🔍 Find in current chat, and search all of your chats! ⌘/Ctrl + F ⌘/Ctrl + Shift + F

28,749 просмотров

Happy 2025! Introducing LM Studio 0.3.6 🚀 - New vision models: Qwen2VL and QVQ (both GGUF + MLX) 🤩 - Function Calling API (in beta) 🧰 - New installer on Windows: choose drive (finally 😮‍💨) - In-app updates are much smaller & have a progress bar! 🟩🟩⬜️⬜️ - Update your llama.cpp and MLX engines w/o a full app update 🚂 The demo below uses a 2B model! 🤯

Happy 2025! Introducing LM Studio 0.3.6 🚀 - New vision models: Qwen2VL and QVQ (both GGUF + MLX) 🤩 - Function Calling API (in beta) 🧰 - New installer on Windows: choose drive (finally 😮‍💨) - In-app updates are much smaller & have a progress bar! 🟩🟩⬜️⬜️ - Update your llama.cpp and MLX engines w/o a full app update 🚂 The demo below uses a 2B model! 🤯

30,165 просмотров

.AI at Meta's Llama 4 Scout ripping 42.27 tok / sec on M2 Ultra Mac Studio

.AI at Meta's Llama 4 Scout ripping 42.27 tok / sec on M2 Ultra Mac Studio

19,587 просмотров

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

Meet LM Studio's mobile app. Your local models, now in your pocket.

Meet LM Studio's mobile app. Your local models, now in your pocket.

753,128 просмотров • 1 месяц назад

MTP is available in LM Studio 0.4.14. Sound on.

MTP is available in LM Studio 0.4.14. Sound on.

76,345 просмотров • 1 месяц назад

LM Studio 0.3.31 has shipped! What's new: 🏞️ OCR, VLM performance improvements 🛠️ MiniMax-M2 tool calling support ⚡️ Flash Attention on by default for CUDA 🚂 New CLI command: `lms runtime` See it in action 👇

LM Studio 0.3.31 has shipped! What's new: 🏞️ OCR, VLM performance improvements 🛠️ MiniMax-M2 tool calling support ⚡️ Flash Attention on by default for CUDA 🚂 New CLI command: `lms runtime` See it in action 👇

36,198 просмотров • 8 месяцев назад

Today we're excited to introduce Multi-Model Sessions! — Load & prompt multiple local LLMs simultaneously — Use the API to build networks, pipelines of LLMs that can talk with each other — Use the new JSON Mode to constrain each model's output format LM Studio 0.2.17 is available for Mac, Windows, and Linux. Get it here:

Today we're excited to introduce Multi-Model Sessions! — Load & prompt multiple local LLMs simultaneously — Use the API to build networks, pipelines of LLMs that can talk with each other — Use the new JSON Mode to constrain each model's output format LM Studio 0.2.17 is available for Mac, Windows, and Linux. Get it here:

89,817 просмотров • 2 лет назад

Больше нет контента для загрузки