Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Introducing Parallel Requests for MLX! Multiple requests to the same model can now be processed simultaneously ✨🚄⚡️ Works both in the API and in Split View chats. See it in action 👇🕺

lmstudio's profile picture

LM Studio

60,936 subscribers

40,805 görüntüleme • 5 ay önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Vibe Design is all about rapid iteration. Now your tools finally move as fast as your ideas. 🌍✨ Introducing Parallel Editing. ⚡️ Iterate across multiple screens at the same time. You can now fire off edits on multiple screens simultaneously—or spin up 5 different edits of the same screen at once. While "vibe coding" makes you wait line-by-line, Stitch lets you iterate on your entire flow in parallel. Don’t block your creativity.
0:15

Vibe Design is all about rapid iteration. Now your tools finally move as fast as your ideas. 🌍✨ Introducing Parallel Editing. ⚡️ Iterate across multiple screens at the same time. You can now fire off edits on multiple screens simultaneously—or spin up 5 different edits of the same screen at once. While "vibe coding" makes you wait line-by-line, Stitch lets you iterate on your entire flow in parallel. Don’t block your creativity.

Stitch by Google

73,103 görüntüleme • 7 ay önce

We took a 30B model and split it in two to write tokens in parallel instead of one at a time. Introducing Nemotron-Labs-TwoTower: a diffusion language model from NVIDIA Research adapted from Nemotron-3-Nano-30B-A3B. Here’s how it works: one half holds the context, the other writes the tokens, with both reusing the pretrained model instead of training a new one from scratch. We found it kept 98.7% of the original model’s quality at 2.42× faster generation.
0:13

We took a 30B model and split it in two to write tokens in parallel instead of one at a time. Introducing Nemotron-Labs-TwoTower: a diffusion language model from NVIDIA Research adapted from Nemotron-3-Nano-30B-A3B. Here’s how it works: one half holds the context, the other writes the tokens, with both reusing the pretrained model instead of training a new one from scratch. We found it kept 98.7% of the original model’s quality at 2.42× faster generation.

NVIDIA AI

759,295 görüntüleme • 28 gün önce

The op kept it for 6 yrs and just uploaded it this March. There were two kisses: the one in the new video should be the ‘first’ one (you can see the same male staff in both video)
0:12

The op kept it for 6 yrs and just uploaded it this March. There were two kisses: the one in the new video should be the ‘first’ one (you can see the same male staff in both video)

Kaede711

176,461 görüntüleme • 2 ay önce

Here's another tip for painting in . You can split the viewport and use different cameras if you want to paint around a model without rotating your view 🎨
0:13

Here's another tip for painting in . You can split the viewport and use different cameras if you want to paint around a model without rotating your view 🎨

Jordan Cain

16,068 görüntüleme • 8 ay önce

Happy 2025! Introducing LM Studio 0.3.6 🚀 - New vision models: Qwen2VL and QVQ (both GGUF + MLX) 🤩 - Function Calling API (in beta) 🧰 - New installer on Windows: choose drive (finally 😮‍💨) - In-app updates are much smaller & have a progress bar! 🟩🟩⬜️⬜️ - Update your llama.cpp and MLX engines w/o a full app update 🚂 The demo below uses a 2B model! 🤯
0:18

Happy 2025! Introducing LM Studio 0.3.6 🚀 - New vision models: Qwen2VL and QVQ (both GGUF + MLX) 🤩 - Function Calling API (in beta) 🧰 - New installer on Windows: choose drive (finally 😮‍💨) - In-app updates are much smaller & have a progress bar! 🟩🟩⬜️⬜️ - Update your llama.cpp and MLX engines w/o a full app update 🚂 The demo below uses a 2B model! 🤯

LM Studio

30,165 görüntüleme • 1 yıl önce

Introducing bunnyOS: the small-model agent and inference platform. Small language models can now reason, plan, use tools, and take action. We are building the infrastructure to unlock them. Litepaper in bio.
0:13

Introducing bunnyOS: the small-model agent and inference platform. Small language models can now reason, plan, use tools, and take action. We are building the infrastructure to unlock them. Litepaper in bio.

BunnyOS

324,018 görüntüleme • 25 gün önce

OpenAI is working on a new experimental feature for Codex called Scratchpad. Users will be able to start multiple Codex chats from a TODO list view, which will be executed in parallel. It will become very instrumental in the upcoming Codex Superapp, where you will be able to trigger a broader range of tasks to achieve your goals. * Not available yet 👀
0:12

OpenAI is working on a new experimental feature for Codex called Scratchpad. Users will be able to start multiple Codex chats from a TODO list view, which will be executed in parallel. It will become very instrumental in the upcoming Codex Superapp, where you will be able to trigger a broader range of tasks to achieve your goals. * Not available yet 👀

🚨 AI News | TestingCatalog

312,933 görüntüleme • 3 ay önce

Introducing Private Swaps. You can now privately swap supported tokens on Privacy Cash, powered by the same protocol that has already processed $173M+ in private transfers, and passed 14 audits.
0:12

Introducing Private Swaps. You can now privately swap supported tokens on Privacy Cash, powered by the same protocol that has already processed $173M+ in private transfers, and passed 14 audits.

Privacy Cash

325,599 görüntüleme • 6 ay önce

Crosschain Swaps are live! Today, we are introducing the Across Swap API for crosschain swaps in a single call. Bridge and Swap are now one action.
0:17

Crosschain Swaps are live! Today, we are introducing the Across Swap API for crosschain swaps in a single call. Bridge and Swap are now one action.

Across

43,417 görüntüleme • 11 ay önce

Example of how it works in Layout Inspector (now embedded in Running Devices window). One can view counts and change the recomposition color as well, defaults to Blue.
0:17

Example of how it works in Layout Inspector (now embedded in Running Devices window). One can view counts and change the recomposition color as well, defaults to Blue.

Chris Sinco

20,161 görüntüleme • 1 yıl önce

Sending and receiving requests in the upcoming Xaman® Wallet 🪝 version: Request in any issued asset too, not only the native asset. And thanks to Pathfinding, the request can be paid in any other currency. You'll recieve what you asked for. Oh and network aware 💪
0:18

Sending and receiving requests in the upcoming Xaman® Wallet 🪝 version: Request in any issued asset too, not only the native asset. And thanks to Pathfinding, the request can be paid in any other currency. You'll recieve what you asked for. Oh and network aware 💪

Wietse Wind - 🪝🛠 Xaman® + XRPL + Xahau

75,610 görüntüleme • 1 yıl önce

Let's GET IT!!! 🌟 We're now playing your requests from coast to coast to coast over the next 5 HOURS on #MostRequestedLive! 💨 Plus LIZZO is joining us in a bit ✨ Who can On Air Romeo play for you tonight on the show??? Request now! 🔥
0:15

Let's GET IT!!! 🌟 We're now playing your requests from coast to coast to coast over the next 5 HOURS on #MostRequestedLive! 💨 Plus LIZZO is joining us in a bit ✨ Who can On Air Romeo play for you tonight on the show??? Request now! 🔥

Most Requested Live

38,053 görüntüleme • 1 yıl önce

I left the Mormon church at 17. Now the same men who ignored me are in my DMs with the wildest requests. You need to hear this. 👇🏻😳
0:15

Sensitive content

I left the Mormon church at 17. Now the same men who ignored me are in my DMs with the wildest requests. You need to hear this. 👇🏻😳

Harley West

51,397 görüntüleme • 11 ay önce

They said it was impossible to make. And I made it. A system that cuts the player character in half. They stay alive and can still interact with the game. I'm taking requests to break another limit. Drop it in the comments. #Roblox #RobloxDev
0:17

They said it was impossible to make. And I made it. A system that cuts the player character in half. They stay alive and can still interact with the game. I'm taking requests to break another limit. Drop it in the comments. #Roblox #RobloxDev

Peter

2,766,436 görüntüleme • 1 ay önce

Tip: Chrome DevTools can now override the content of Fetch/XHR requests! Great for mocking APIs without waiting on backend changes! This and lots more in Chrome 117:
0:16

Tip: Chrome DevTools can now override the content of Fetch/XHR requests! Great for mocking APIs without waiting on backend changes! This and lots more in Chrome 117:

Addy Osmani

306,189 görüntüleme • 2 yıl önce

Today I'm launching a very early release of MLX Model Manager ( A Swift package for quickly and easily adding LLM/VLMs with just a couple of lines of code into your MacOS/iOS applications for local and private inferencing. This is built on the amazing work of the MLX team & what they have done with MLX Model Manager unifies the work they have done with MLXLLM as well as MLXVLM into one package with added abstractions to simplify the usage. I've also added support for Google's new Paligemma2 Vision Model ( You can see a demonstration in the video below! Huge shoutout to Awni Hannun for the creation of MLX, David Koski on leading the charge for MLXVLM and Prince Canuma for the creation of MLX-VLM. Three massive pillars in the MLX community among many others.
0:11

Today I'm launching a very early release of MLX Model Manager ( A Swift package for quickly and easily adding LLM/VLMs with just a couple of lines of code into your MacOS/iOS applications for local and private inferencing. This is built on the amazing work of the MLX team & what they have done with MLX Model Manager unifies the work they have done with MLXLLM as well as MLXVLM into one package with added abstractions to simplify the usage. I've also added support for Google's new Paligemma2 Vision Model ( You can see a demonstration in the video below! Huge shoutout to Awni Hannun for the creation of MLX, David Koski on leading the charge for MLXVLM and Prince Canuma for the creation of MLX-VLM. Three massive pillars in the MLX community among many others.

Kunal Batra

104,815 görüntüleme • 1 yıl önce

✨Sometimes the small details make the difference. ✅ Excited to see the $XRP token listed and recognized on the largest wallet for the first time ever, thanks to the XRPL EVM Sidechain 🚀 🦊 You can try it now on latest MetaMask.eth 🦊 version both extension and mobile. The RippleX team is taking small, giant steps in interoperability for #XRP ⚡️
0:17

✨Sometimes the small details make the difference. ✅ Excited to see the $XRP token listed and recognized on the largest wallet for the first time ever, thanks to the XRPL EVM Sidechain 🚀 🦊 You can try it now on latest MetaMask.eth 🦊 version both extension and mobile. The RippleX team is taking small, giant steps in interoperability for #XRP ⚡️

Peersyst Technology

132,217 görüntüleme • 1 yıl önce

Perplexity Computer is massively multi-model. Computer orchestrates models to run agents in parallel, leveraging Opus to match each task to the model best suited for it. In total, Computer can route work across 19 different models.
0:12

Perplexity Computer is massively multi-model. Computer orchestrates models to run agents in parallel, leveraging Opus to match each task to the model best suited for it. In total, Computer can route work across 19 different models.

Perplexity

534,569 görüntüleme • 5 ay önce