Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

1/ Offline computer-use models are here. Today, one running on our Mac made it all the way to hotel checkout. We ran Qwen3.8-27B from Qwen through Cua Driver. It also turned a flyer into a Calendar event and reconciled receipts. Every model token stayed on the Mac 🧵

Francesco

7,132 subscribers

27,540 Aufrufe • vor 1 Monat •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

1/ Today was the first time offline computer use felt real to us. We ran Muse Glimmer 30B from AI at Meta locally and watched it operate Notes and Reminders on macOS through Cua Driver We didn’t expect a 30B local model to get this far 🧵

1/ Today was the first time offline computer use felt real to us. We ran Muse Glimmer 30B from AI at Meta locally and watched it operate Notes and Reminders on macOS through Cua Driver We didn’t expect a 30B local model to get this far 🧵

Francesco

30,795 Aufrufe • vor 1 Monat

what if i told you... computer use can be faster on local models moondream3 with its photon update today that gives it mac support can see your screen and use it with 1s latency, ty vik here we have whisper+qwen+moondream triple model pipeline working offline flawlessly

what if i told you... computer use can be faster on local models moondream3 with its photon update today that gives it mac support can see your screen and use it with 1s latency, ty vik here we have whisper+qwen+moondream triple model pipeline working offline flawlessly

murat 🍥

391,513 Aufrufe • vor 5 Monaten

Splash is here! A month ago, DFlash 2 ran Qwen3.8-27B at 70 tok/s on an M5 Max. Today, Splash runs it at 144 tok/s on the same Mac ⚡ Getting that speed used to take work. Splash is built around the model, with the DFlash 2 draft already in it. Two commands and you're running.

Splash is here! A month ago, DFlash 2 ran Qwen3.8-27B at 70 tok/s on an M5 Max. Today, Splash runs it at 144 tok/s on the same Mac ⚡ Getting that speed used to take work. Splash is built around the model, with the DFlash 2 draft already in it. Two commands and you're running.

Zhijian Liu

92,333 Aufrufe • vor 16 Tagen

Introducing hybrid compute in Perplexity Computer. Computer can start a task in the cloud, then move to a local model that runs on your Mac. Use it for steps involving private files or sensitive data. Available today in the Perplexity Mac app.

Introducing hybrid compute in Perplexity Computer. Computer can start a task in the cloud, then move to a local model that runs on your Mac. Use it for steps involving private files or sensitive data. Available today in the Perplexity Mac app.

Perplexity

287,969 Aufrufe • vor 1 Monat

Personal Computer is now available to all users in a new Perplexity Mac app. Personal Computer is an advanced version of Perplexity Computer. It operates on any Mac, running tasks across your local files, native Mac apps, the web, and Perplexity’s secure servers.

Personal Computer is now available to all users in a new Perplexity Mac app. Personal Computer is an advanced version of Perplexity Computer. It operates on any Mac, running tasks across your local files, native Mac apps, the web, and Perplexity’s secure servers.

Perplexity

384,613 Aufrufe • vor 5 Monaten

Every big MoE model I test on my 3090 is basically to see how good it is compared to Qwen3.6-27B. "How good is it compared to Qwen3.6-27B?" is the question I get asked the most, and that shows how much people love and, more importantly, trust the 27B 27B is battle tested. It has proven its worth and has nothing left to prove. Now it just needs to make way for the next 27B. Here’s an example video: a Three.js task, same prompt, not oneshot but two shots for all models. All ran on my 3090 + 64GB VRAM Qwen-3.6-27b fully on vram while others have experts offloaded to system ram. Pinned on the left: Qwen3.6-27B-Q5 On the right, i'm switching between Inkling-Small-Q4_K_M DSV4-Flash-0731-UD-IQ1 Ling-3.0-Flash-Q4_K_M Qwen3.6-27B nailed it. The effects and visuals are just spot on.The other models got some things right, but not everything. Second place would have to go to Inkling-Small while DSV4-Flash-0731 and Ling-3.0-Flash failed to capture the full requirements. This is also why we’re all excited for Qwen Qwen3.8-27B!

Every big MoE model I test on my 3090 is basically to see how good it is compared to Qwen3.6-27B. "How good is it compared to Qwen3.6-27B?" is the question I get asked the most, and that shows how much people love and, more importantly, trust the 27B 27B is battle tested. It has proven its worth and has nothing left to prove. Now it just needs to make way for the next 27B. Here’s an example video: a Three.js task, same prompt, not oneshot but two shots for all models. All ran on my 3090 + 64GB VRAM Qwen-3.6-27b fully on vram while others have experts offloaded to system ram. Pinned on the left: Qwen3.6-27B-Q5 On the right, i'm switching between Inkling-Small-Q4_K_M DSV4-Flash-0731-UD-IQ1 Ling-3.0-Flash-Q4_K_M Qwen3.6-27B nailed it. The effects and visuals are just spot on.The other models got some things right, but not everything. Second place would have to go to Inkling-Small while DSV4-Flash-0731 and Ling-3.0-Flash failed to capture the full requirements. This is also why we’re all excited for Qwen Qwen3.8-27B!

AJ

11,670 Aufrufe • vor 1 Monat

Alright guys, wow. Qwen 3.8 27B is basically Qwen 4. What we have here is one of the best one-shot shark survival games I've made with any model. I ran this same prompt through fable, and the biggest thing all models struggle with in this test is the top-down view of the sharks. Fable even had all of the fins reversed and details jumbled on the first turn. Before now, it was really a 2 to 8 turn test to get something final regardless of model. Qwen 3.8 27B just nailed this in one output, no harness at all, just purely the model thoroughly thinking before outputting the final result. On every asset used, different shark variants, everything, it all looks incredibly tight. The boat movement, shark speed and engagement, everything is so much better than I expected, and I was expecting a lot. Imagine what 8 turns would do in a harness? This confirms to me that while Qwen 3.8 27B thinks a lot, for the first time in a local model on the base weights, IT MIGHT ACTUALLY BE WORTH IT This is a Frontier Lab model result, and it ran on my 5090 at 60tps in Q5_K_M. I am just in complete astoundment at what Qwen has accomplished here, and I am incredibly grateful that this model is open source. The speed will also increase drastically with optimisations. This is just an incredible day. What a blessing. More to come!

Alright guys, wow. Qwen 3.8 27B is basically Qwen 4. What we have here is one of the best one-shot shark survival games I've made with any model. I ran this same prompt through fable, and the biggest thing all models struggle with in this test is the top-down view of the sharks. Fable even had all of the fins reversed and details jumbled on the first turn. Before now, it was really a 2 to 8 turn test to get something final regardless of model. Qwen 3.8 27B just nailed this in one output, no harness at all, just purely the model thoroughly thinking before outputting the final result. On every asset used, different shark variants, everything, it all looks incredibly tight. The boat movement, shark speed and engagement, everything is so much better than I expected, and I was expecting a lot. Imagine what 8 turns would do in a harness? This confirms to me that while Qwen 3.8 27B thinks a lot, for the first time in a local model on the base weights, IT MIGHT ACTUALLY BE WORTH IT This is a Frontier Lab model result, and it ran on my 5090 at 60tps in Q5_K_M. I am just in complete astoundment at what Qwen has accomplished here, and I am incredibly grateful that this model is open source. The speed will also increase drastically with optimisations. This is just an incredible day. What a blessing. More to come!

Kyle Hessling

24,917 Aufrufe • vor 1 Monat

THIS DEVELOPER RAN THE LARGEST AI MODEL IN THE WORLD ON 5 MAC STUDIOS - AND IT COST 100X LESS THAN WHAT OPENAI USES 27:47 he says it after hours of setup - Llama 3.1 405B running locally on five Mac Studios - a model that normally requires 42 GPUs at $1,600 each or an entire data center 320GB unified memory combined - every Mac Studio adds its 64GB into one shared pool - and a model that needs 1TB of VRAM just distributes across all five it launched, it responded and not a single token went to OpenAI or Google - everything local, everything private, everything yours and 100x cheaper 5 Mac Studios, 46 watts for all of them in idle - less than one light bulb per machine what OpenAI keeps behind a subscription he ran at home with a one-time purchase in a few clicks

THIS DEVELOPER RAN THE LARGEST AI MODEL IN THE WORLD ON 5 MAC STUDIOS - AND IT COST 100X LESS THAN WHAT OPENAI USES 27:47 he says it after hours of setup - Llama 3.1 405B running locally on five Mac Studios - a model that normally requires 42 GPUs at $1,600 each or an entire data center 320GB unified memory combined - every Mac Studio adds its 64GB into one shared pool - and a model that needs 1TB of VRAM just distributes across all five it launched, it responded and not a single token went to OpenAI or Google - everything local, everything private, everything yours and 100x cheaper 5 Mac Studios, 46 watts for all of them in idle - less than one light bulb per machine what OpenAI keeps behind a subscription he ran at home with a one-time purchase in a few clicks

Noisy

21,553 Aufrufe • vor 3 Monaten

You can now run Qwen 3.6 27B on <10GB of memory and retain 90% of the intelligence. Today, PrismML dropped Bonsai 27B - which takes their unique compression approach they have already successfully applied to Qwen3.6 8B and Flux2-Klein and applied it to a properly smart model. Here is it using an entire computer for deep research. Long horizon agentic calls already are strong with Qwen3.6 27B and they still are here - just on 10x less memory.

You can now run Qwen 3.6 27B on <10GB of memory and retain 90% of the intelligence. Today, PrismML dropped Bonsai 27B - which takes their unique compression approach they have already successfully applied to Qwen3.6 8B and Flux2-Klein and applied it to a properly smart model. Here is it using an entire computer for deep research. Long horizon agentic calls already are strong with Qwen3.6 27B and they still are here - just on 10x less memory.

Tim Carambat

63,449 Aufrufe • vor 2 Monaten

We turned Qwen3.8-27B into a multimodal decision model. It beat Pokémon FireRed’s elite four and champion with sub-100 ms decisions from live game state. With SGLang’s native /v1/decisions, you can now turn LLMs and VLMs into classification and scoring models. We also added /v1/systemone so Jev-like open models can work with the TypeSafe SDK.

We turned Qwen3.8-27B into a multimodal decision model. It beat Pokémon FireRed’s elite four and champion with sub-100 ms decisions from live game state. With SGLang’s native /v1/decisions, you can now turn LLMs and VLMs into classification and scoring models. We also added /v1/systemone so Jev-like open models can work with the TypeSafe SDK.

SGLang

249,875 Aufrufe • vor 5 Tagen

I took Qwen3.8-27B apart to see how it works inside. The plan was to carve a MoE out of it. Every ffn neuron tapped, all 1,114,112 of them. 3.92M tokens pushed through. 87 minutes on the 4x3090. The result surprised me. Neurons that fire on more than 90% of tokens: 2. Thats what youre looking at, one frame per token. Full numbers below 🧵

I took Qwen3.8-27B apart to see how it works inside. The plan was to carve a MoE out of it. Every ffn neuron tapped, all 1,114,112 of them. 3.92M tokens pushed through. 87 minutes on the 4x3090. The result surprised me. Neurons that fire on more than 90% of tokens: 2. Thats what youre looking at, one frame per token. Full numbers below 🧵

Alexey Fateev

35,863 Aufrufe • vor 1 Monat

Im done with Qwen3.8 27B 😎 Atlas covers it completely now: all 1,199 tensors, the full architecture, and what happens inside the model while it runs 🚀 The final part is the Living Model. I ran English, code and agent traces through Qwen and mapped signal flow across all 64 layers, activation quantization, every full attention layer, linear memory, 1.1M neurons, Vision, and the damage from swapping each layer to INT4. Everything comes from the actual weights or real runs. No placeholder data anywhere. Dark mode and a proper mobile view are in too. It finally feels like a product.

Im done with Qwen3.8 27B 😎 Atlas covers it completely now: all 1,199 tensors, the full architecture, and what happens inside the model while it runs 🚀 The final part is the Living Model. I ran English, code and agent traces through Qwen and mapped signal flow across all 64 layers, activation quantization, every full attention layer, linear memory, 1.1M neurons, Vision, and the damage from swapping each layer to INT4. Everything comes from the actual weights or real runs. No placeholder data anywhere. Dark mode and a proper mobile view are in too. It finally feels like a product.

Alexey Fateev

42,238 Aufrufe • vor 1 Monat

Darkbloom is the first model provider to support Ternary Bonsai 2 27B -- concentrated intelligence that fits on your phone. Try it now: First 250 users get 100 million free tokens; PrismML's new flagship model: - a ternary compression of Qwen3.8 27B at 2bits per parameter. - 8.5 GB total, 5x smaller than original - keeps 98.2% of the Qwen's FP16 benchmark performance. - 75% cheaper than Qwen 27B. Qwen3.8 27B already operates comparably with Opus 4.6 and 5.6 Luna on certain tasks. This one does it in the memory of a phone. 262K context, image input, Apache 2.0. From our first run on the network, on a single M5 Max with no caching: - 35 tok/s decode at 1K context, - 31 tok/s at 10K, - 19 tok/s at 50K. But we expect more performance gain coming in a few weeks! That's a full 27B reasoning model running comfortably on any Mac. 1,000+ Macs are serving on Darkbloom right now. Go try it out!! Thank you to Babak Hassibi Sahin Lale Omead Pooladzandi Reza Sadri Tushar Bansal Evan Walters and the whole PrismML team. This is exactly the kind of model Darkbloom was built for. You can read the essay by Bonsai on Why Local AI Matters:

Darkbloom is the first model provider to support Ternary Bonsai 2 27B -- concentrated intelligence that fits on your phone. Try it now: First 250 users get 100 million free tokens; PrismML's new flagship model: - a ternary compression of Qwen3.8 27B at 2bits per parameter. - 8.5 GB total, 5x smaller than original - keeps 98.2% of the Qwen's FP16 benchmark performance. - 75% cheaper than Qwen 27B. Qwen3.8 27B already operates comparably with Opus 4.6 and 5.6 Luna on certain tasks. This one does it in the memory of a phone. 262K context, image input, Apache 2.0. From our first run on the network, on a single M5 Max with no caching: - 35 tok/s decode at 1K context, - 31 tok/s at 10K, - 19 tok/s at 50K. But we expect more performance gain coming in a few weeks! That's a full 27B reasoning model running comfortably on any Mac. 1,000+ Macs are serving on Darkbloom right now. Go try it out!! Thank you to Babak Hassibi Sahin Lale Omead Pooladzandi Reza Sadri Tushar Bansal Evan Walters and the whole PrismML team. This is exactly the kind of model Darkbloom was built for. You can read the essay by Bonsai on Why Local AI Matters:

Gajesh

48,051 Aufrufe • vor 16 Tagen

PERPLEXITY 🔥: A new Hybrid mode is coming soon on Mac, letting local models handle some subtasks. > Gemma 4 (for 16 GB machines), Qwen3.6, and Perplexity's own model (For 32 GB machines) are currently supported. > "In Hybrid mode, Computer orchestrates in the cloud and delegates suitable subtasks to a model on your Mac." > "Local models run on your Mac's own memory and processor — the more capable your machine, the larger the models it can run." > "Privacy Gate is a small model that runs entirely on your Mac. It inspects anything headed to the cloud for personal or sensitive information — and if it finds any, you decide how to handle it before anything is sent." That would be huge 👀

PERPLEXITY 🔥: A new Hybrid mode is coming soon on Mac, letting local models handle some subtasks. > Gemma 4 (for 16 GB machines), Qwen3.6, and Perplexity's own model (For 32 GB machines) are currently supported. > "In Hybrid mode, Computer orchestrates in the cloud and delegates suitable subtasks to a model on your Mac." > "Local models run on your Mac's own memory and processor — the more capable your machine, the larger the models it can run." > "Privacy Gate is a small model that runs entirely on your Mac. It inspects anything headed to the cloud for personal or sensitive information — and if it finds any, you decide how to handle it before anything is sent." That would be huge 👀

🚨 AI News | TestingCatalog

41,281 Aufrufe • vor 1 Monat

1/ Singapore, you turned our event into something truly unforgettable. From the moment you stepped through KOMA’s 20m Torii gates, we knew it would be remarkable. The venue was a dream, but it was your energy that made it extraordinary. Let’s relive it together 🧵👇

1/ Singapore, you turned our event into something truly unforgettable. From the moment you stepped through KOMA’s 20m Torii gates, we knew it would be remarkable. The venue was a dream, but it was your energy that made it extraordinary. Let’s relive it together 🧵👇

Azuki Singapore

42,943 Aufrufe • vor 2 Jahren

Qwen3.8-Flash-Next from Qwen has day-0 support in Atomic Agent! 125B main model, 51B N-gram embeddings, 6B activated per token and 62.5 on SWE-bench Pro. We gave it a folder and it checked every file to sort them by content. Total: 25 steps + 230K tokens ≈ $0.07

Qwen3.8-Flash-Next from Qwen has day-0 support in Atomic Agent! 125B main model, 51B N-gram embeddings, 6B activated per token and 62.5 on SWE-bench Pro. We gave it a folder and it checked every file to sort them by content. Total: 25 steps + 230K tokens ≈ $0.07

Atomic Agent

44,442 Aufrufe • vor 1 Monat

Qwopus 3.6-27b Coder I had a lot of requests to test it, so I did. I ran the same tests I’ve done on other models. It scored lower on tool-eval-bench than both Qwen 3.6 27b and Qwen 3.6 35b. It also produced broken single-file Tetris and Solar System HTML demos, even after 3 fresh attempts. In the Tetris html, the game stalled when you completed a line. It also randomly changed the pieces when moving them left or right. In the Solar System html, clicking on the sun or any planet broke the rendering — the objects just disappeared. Conclusion: The regular Qwen 3.6 27b and 35b models performed better. What do you think of Qwopus 3.6-27b Coder? Full results & RAW files: Full prompts in the posts below.

Qwopus 3.6-27b Coder I had a lot of requests to test it, so I did. I ran the same tests I’ve done on other models. It scored lower on tool-eval-bench than both Qwen 3.6 27b and Qwen 3.6 35b. It also produced broken single-file Tetris and Solar System HTML demos, even after 3 fresh attempts. In the Tetris html, the game stalled when you completed a line. It also randomly changed the pieces when moving them left or right. In the Solar System html, clicking on the sun or any planet broke the rendering — the objects just disappeared. Conclusion: The regular Qwen 3.6 27b and 35b models performed better. What do you think of Qwopus 3.6-27b Coder? Full results & RAW files: Full prompts in the posts below.

Mia

11,183 Aufrufe • vor 3 Monaten

local LLMs on Mac are getting good. but the workflow around models is still messy. you have models in: •⁠ ⁠LM Studio •⁠ ⁠Ollama •⁠ ⁠Hugging Face cache •⁠ ⁠random folders •⁠ ⁠manual downloads and every runtime expects something slightly different. we built ModelHub to clean up this layer. it’s a native macOS menu bar app for discovering, downloading, and managing local LLMs. not a replacement for Ollama, oMLX or LM Studio. it sits beside them. Ollama = run models MLX = Apple Silicon acceleration LM Studio = local model workspace Hugging Face = model ecosystem ModelHub = model discovery + management layer we’re live on Product Hunt today. would love feedback from people running local models on Mac.

local LLMs on Mac are getting good. but the workflow around models is still messy. you have models in: •⁠ ⁠LM Studio •⁠ ⁠Ollama •⁠ ⁠Hugging Face cache •⁠ ⁠random folders •⁠ ⁠manual downloads and every runtime expects something slightly different. we built ModelHub to clean up this layer. it’s a native macOS menu bar app for discovering, downloading, and managing local LLMs. not a replacement for Ollama, oMLX or LM Studio. it sits beside them. Ollama = run models MLX = Apple Silicon acceleration LM Studio = local model workspace Hugging Face = model ecosystem ModelHub = model discovery + management layer we’re live on Product Hunt today. would love feedback from people running local models on Mac.

sabesh 📟

31,497 Aufrufe • vor 4 Monaten

John Wick scenes are one of the hardest to track. we ran our subnet vision models on one of them. Shot at night, barely any light. The camera whipping around, cars sliding sideways, people cutting through the gaps, all of it smeared with motion blur. this is the footage most models fall apart on. Ours held it. every car and every person detected, outlined, and tracked, each one carried under its own ID from the moment it enters frame to the moment it leaves. thousands of unique tracks across the clip, through the dark and the chaos, without losing the thread. And the model doing it is smaller than you would ever guess. no giant model, no cloud.

John Wick scenes are one of the hardest to track. we ran our subnet vision models on one of them. Shot at night, barely any light. The camera whipping around, cars sliding sideways, people cutting through the gaps, all of it smeared with motion blur. this is the footage most models fall apart on. Ours held it. every car and every person detected, outlined, and tracked, each one carried under its own ID from the moment it enters frame to the moment it leaves. thousands of unique tracks across the clip, through the dark and the chaos, without losing the thread. And the model doing it is smaller than you would ever guess. no giant model, no cloud.

Score

22,210 Aufrufe • vor 1 Monat