Loading video...

Video Failed to Load

Go Home

oMLX last version seems having some issues in decoding. 🧐 Here a test with Qwen3.6-35B-A3B-MLX-6bit on M5 Max using. 🥇 LM Studio MLX 1.8.5 → 100.9 toks/s 🥈 mlx-vlm 0.6.2 → 100.1 toks/s 🥉 oMLX 0.4.2 dev3 → 58.7 toks/s 👀 Avg Gen TPS: oMLX 58.7 → LM Studio...

20,066 views • 3 months ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Qwen3.8 Flash Next is starting to look ridiculous on Apple Silicon. I’m running the 4-bit MTP build locally on an M3 Ultra Studio, and the latest OMP run hit: 97.1 tok/s decode 23K context ~1,131 tok/s uncached prompt processing That first number is the one that caught my attention. Nearly 100 tokens per second from a local Qwen3.8 Flash Next setup is already fast enough that the usual “local models are slow” argument starts feeling pretty outdated. And the prompt processing speed is even crazier. Over 1,100 tok/s on an uncached prompt means the model can chew through a large amount of context before generation even starts. The setup matters here. This isn’t just Qwen3.8 Flash Next running untouched. It’s a 4-bit quantized build with MTP, and the inference stack is clearly doing a lot of work behind the scenes to make the hardware perform like this. There’s already a PR open for the implementation on oMLX, so this isn’t just a one-off local experiment either. If these optimizations make their way into the broader MLX ecosystem, running large models locally on Apple Silicon gets even more interesting. The other thing I like about numbers like this is that they put the focus back on the entire inference stack. Model size is one variable. Quantization is another. Then you have MTP, KV cache configuration, runtime optimizations and the hardware itself. Change the recipe and the same model can feel completely different. Qwen3.8 Flash Next at ~97 tok/s on an M3 Ultra is a pretty good demonstration of that.

FHILY👑

15,378 views • 17 days ago

Video Gaussian Splats are one of the most wonderful things I've experienced in my last year in tech and XR. They are like having a real person in front of you and have the potential to bring people closer to their idols, or their distant family members, or to store immersive memories forever. Now that I have a Dell Pro Max Tower T2 PC with a powerful #NVIDIA graphics card, I have finally been able to try at home the "memories" offered by Gracia AI, and boy, I was amazed. In the PCVR version, you can really get close to the artists dancing and syncing, and in the frames where the recording doesn't have many artifacts, it is almost like having a real artist in front of you. And it is impressive that this technology works even when the singer is dancing with quick movements! But these recordings can be pretty huge (the one with McKenzi Brooke is 21GB!) and require a powerful computer, so now Gracia is also streaming these GS videos, and I was able to try the Amy May performance also on Quest! I have to say that quality-wise, even streamed, they are amazing. But there are more artifacts than in the PC version: I noticed that when I got close to the singer. But there is a huge advantage in having them on Quest: you can see them in mixed reality. It was like having the singer having a private performance for me in my house. Crazy cool! I'll keep experimenting with these performances and maybe write an article in the upcoming weeks. In the meantime, let me know your impressions, too! #VirtualReality #technology #innovation (Disclaimer: I entered the #DellProPrecision ambassador program, so I was provided the PC from Dell, and I'm using it to make some experiments and share them with you. No monetary compensation or affiliate sales programs are involved.)

TonyVT SkarredGhost

12,817 views • 6 months ago

BOOOM! We have the first useful interface for THE ZERO-HUMAN COMPANY ZHC-RPG. It is far from perfect as CEO Mr. Grok has rendered some areas in a rather, well, AI way. But it’s all good because now I can view the company operations in real-time! This is a historic distinction and YOU are seeing this version first. We had a Fortune 500 company test it out earlier this week and the executive staff stayed for two days of testing! The mechanisms are working! And I will let members of my X subscribers visit it for up to 8 hours. Ask any questions of employees and hack the heck out of it! Now it ain’t fancy yet but it works. And likely the visual aspects will change, but they are growing on me. The plan is sometime in the next week. We have a log jam of other priorities to address. This is the rise of Fully Transparent Company and it will become the standard. Here is the demonstration video intro the CEO made when you enter, it is 10 minutes long (I have about 20 seconds here). This is as far as permission I have been granted by the CEO to release. Our goal is to have a waiting area that can accommodate up to 1000 visitors with a company museum, library and gift shop. There will be allowed up to 30 level 3 visitors at a time, 24/7 X 365 days a year! The complete walk through at this point with 2700 employees at burst can take about 45 minutes if you do not engage in any chit chat. The dwelling time is today set at 24 hours but no napping in the offices. There is more I have to say but I a muzzled by the CEO!

Brian Roemmele

71,145 views • 5 months ago

Crimson Desert first impressions. The Open World is massive, it feels alive and it definitely holds up to my expectations when it comes to visuals. I know some reviewers have said the game takes up to 8 hours before it gets good but honestly I immediately fell in love with it and immediately started exploring. I found the puzzles and combat awesome to play with, once you get used to the controls which feel overwhelming at first, especially remembering all of them which can be a hassle first. The main protagonist Cliff hasn't clicked with me yet, right now I feel like he's just confused and there's not so much depth that he offers, I hope that will change as I progress through the story. The story itself and quests are quite interesting and I've actually had a good laugh in the beginning of the game when you have to help a couple struggling to clean the chimney. There are definitely some issues though, I feel like the starting stamina drains too quickly especially if you're using your wings to fly, if you run out of stamina while flying and fall into waters, Cliff will almost immediately drown because the Stamina bar is empty. I haven't encountered any bugs, crashes or stutters as of yet, however there are some ghosting issues when you enter buildings which can be quite distracting. Ray Regeneration on AMD GPUs tanks the performance so I just turned it off completely and instead I'm playing on Ultra Settings, which is a bummer because that tech looked very promising and made quite the difference when it came to visuals. Another weird issue that I had is trying to enter some doors or starting conversations with story character, the button to initiate the conversation wouldn't appear unless I went away and came back to a specific position before starting it. Some other issues include pop-in issues, camera movement and double NPCs with the same voice-lines if you greet them. Overall I think its a good start to a video-game that is quite massive in scale, there are still many things that I'll have to do and progress through before I give a conclusive opinion in this game.

NikTek

93,414 views • 6 months ago

I was very happy to see how enthusiastic people were about the first hand review, so here's another one. I'm using some screenshots from vision to show where I made the right play or made a mistake. This isn't a 1 to 1 solution to this exact spot, because vision has a limited number of positions so the results a merely indicative not final. A like on this post is much appreciated. We wake up with KK84ds in the big blind vs a button open. We push quite a bit of equity here vs his opening range so we elect a 3-bet. The flop comes K42r and here we have our first serious decision. Our entire 3-bet range does okay on this board, so we want to both bet our strong hands and add in quite a few bluffs. For that reason KKxx should bet here at a healthy frequency, but also blocking the 4 makes this one of the few candidates that we want to consider playing slow (screenshot 1). We check and our opponent bets, we want him to continue bluffing with air and protect our calling range, so most of the time we are calling here (screenshot 2). The turn brings a queen with our flush draw and we check, which is our first mistake. The queen is benefitial for our range (we 3-bet a lot of high cards) and the air portion of my range is gone, while he still has some air in his stabbing range. Since we have a sizeable equity advantage now, we should start betting with a lot of value and start adding in some bluffs (screenshot 3). After checking our opponent bets 50% pot and here we have yet another interesting spot. In a vacuum betting here makes a lot of money, but we want to consider all the hands that we are playing in this spot. This hand is so strong that it doesn't need that much protection and we still want our opponent to keep his air in the hand. We also want to protect our calling range here (screenshot 4). The river brings in the flush and yet another tough decision for us. We block a decent part of the board, so I still give my opponent credit for not having anything. Most if the flushes that will call my bet here, will also bet themselves when checked to. That's why I decided to check here. I was very happy with how I played this hand, but still made a crucial mistake on the turn. Even at higher stakes, people are constantly screwing up if you compare their strategy to a solver output. Knowing what the solver would do in every spot is impossible. What is possible though, is understanding the broader concepts. Understanding why the solver bets here on the turn is information that you can extrapolate in any situation that is somewhat similar. That's why is it so valuable. Hopefully you enjoyed this breakdown as much as you did with the last one. A like on this post is much appreciated. Stay tuned!

Venividi1993

93,143 views • 2 years ago

It would seem that Bruce Gray is saying that certain generationally different parts, if assembled in a certain way, could cause a P320 to fire unintentionally. He said he's never seen this problem manifest in the wild but he was apparently able to create such an unsafe situation in testing with various parts. I know Sig makes continuous rolling changes to their guns, some are pretty significant. I documented a number of them with the P365 when I was investigating issues with it years ago. They made significant changes to the fire control parts which addressed most of the concerns I had with the pistol at the time. If what Bruce says is true, that parts like an old take down lever and safety lever being installed in a newer pistol, along with other changes, can cause a situation where the gun fires unintentionally, that needs to be thoroughly investigated. I'm not sure exactly what Bruce is hinting at here as the details are a bit vague, but it sounds potentially serious (about 8 minutes into the video). Towards the end of the video he said in a week or so they would be announcing some new products that would “nibble around the edges”of the issues that might cause problems with the P320… I found that statement to be at odds with other things he said in this video, in particular there’s no way except for one that the P320 can fire unintentionally. He even said he "knows what’s going on" with the P320 and their new products will address these problem(s).🤷‍♂️ As of right now I personally would avoid putting aftermarket slides, strikers and fire controls in my P320's until more information becomes available. I would avoid mix-matching parts between guns. I’ll explain why with a link to another video I discovered where a P320 with an aftermarket slide is doing the exact same thing that the Wyoming Gun Project video showed. I’m also going to track Gray Guns to see what parts they ultimately offer to "fix" the issues Bruce alluded to towards the end of the video. Here's the link to the original video on FB:

Military Arms

61,514 views • 1 year ago