Loading video...

Video Failed to Load

Go Home

oMLX last version seems having some issues in decoding. ๐Ÿง Here a test with Qwen3.6-35B-A3B-MLX-6bit on M5 Max using. ๐Ÿฅ‡ LM Studio MLX 1.8.5 โ†’ 100.9 toks/s ๐Ÿฅˆ mlx-vlm 0.6.2 โ†’ 100.1 toks/s ๐Ÿฅ‰ oMLX 0.4.2 dev3 โ†’ 58.7 toks/s ๐Ÿ‘€ Avg Gen TPS: oMLX 58.7 โ†’ LM Studio...

20,066 views โ€ข 2 months ago โ€ขvia X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

I nearly 2x'd the speed while only using +1GB VRAM with the new MTP update in llama.cpp ๐Ÿคฏ You need to add these flags to start using it: --spec-type draft-mtp \ --spec-draft-p-min 0.75 \ --spec-draft-n-max 2 My results with Qwen3.6 27B on a single RTX 5080 โ†“ โšช๏ธ no flag (without mtp) โ†’ 54.3 tok/s with 13.26GB VRAM ๐Ÿ”ต --spec-draft-n-max 2 โ†’ 90.7 tok/s with 14.29GB VRAM ๐Ÿ”ด --spec-draft-n-max 2 --spec-draft-p-min 0.75 โ†’ 93.9 tok/s with 14.30GB VRAM ๐ŸŸข --spec-draft-n-max 6 --spec-draft-p-min 0.75 โ†’ 93.9 tok/s with 14.87GB VRAM Increasing to 6 draft tokens didn't help my setup for some reason. I made sure to test with a low context length to have enough headroom and eliminate risk of vram stress. From my understanding: 1) The speed gains are very task-dependent. You need to test across a wide range of tasks to get a realistic idea of the benefits 2) Weโ€™re already running heavily quantized GGUF models (Q3, Q4, Q6, etc.), so we already benefit from strong speed/performance thanks to the reduced size. Thatโ€™s why some people are seeing little to no improvement compared to MLX or other quantized versions The progress over the past few days has been insane to say the least. However, MTP now consumes significantly more VRAM. Personally 16GB just isn't enough to use MTP and run it with a good context size. Time to upgrade lads, 24GB+ users are eating GOOD today ๐Ÿ”ฅ Full setup below โ†“

left curve dev

30,086 views โ€ข 2 months ago

here's what i vibecoded today: punchingface ๐ŸฅŠ an app to make Hugging Face models fight each other on coding and canvas challenges, built with qwen3.6 35b a3b in 24 hours! benchmarks numbers don't mean anything anymore, we need a way to visualize what the models are actually capable of, and canvas are one the best way to showcase it imo. why? because one single error in the code and everything breaks it shows the differences in a matter of seconds, way easier than manually reviewing the quality of the code produced for a complex project; much needed in the space with all the new finetunes dropping everyday! i did a little demo here with qwen3.6 vs qwopus glm 18b merged, the frankenstein model from Kyle Hessling the winner is clear here, qwen is crazy good and has nothing to prove. that said, qwopus 18b isn't terrible at all; the result isnโ€™t the prettiest to the eye, but heyโ€ฆ it works! i've seen so many models just output a blank page (completely non-working code) so this is already a win frankenstein talks and thinks but he needs some extra brain surgery ๐Ÿง  results were expected (it's a very experimental model) but love the effort in the 18b direction from jackrong and kyle! the app was entirely vibecoded with qwen3.6, i didn't edit a single file manually. i can say with confidence that it really has the intelligence of claude sonnet 4.5 at a speed of 125tok/s on an rtx 5080 which models should i make fight next?

left curve dev

19,114 views โ€ข 3 months ago

Video Gaussian Splats are one of the most wonderful things I've experienced in my last year in tech and XR. They are like having a real person in front of you and have the potential to bring people closer to their idols, or their distant family members, or to store immersive memories forever. Now that I have a Dell Pro Max Tower T2 PC with a powerful #NVIDIA graphics card, I have finally been able to try at home the "memories" offered by Gracia AI, and boy, I was amazed. In the PCVR version, you can really get close to the artists dancing and syncing, and in the frames where the recording doesn't have many artifacts, it is almost like having a real artist in front of you. And it is impressive that this technology works even when the singer is dancing with quick movements! But these recordings can be pretty huge (the one with McKenzi Brooke is 21GB!) and require a powerful computer, so now Gracia is also streaming these GS videos, and I was able to try the Amy May performance also on Quest! I have to say that quality-wise, even streamed, they are amazing. But there are more artifacts than in the PC version: I noticed that when I got close to the singer. But there is a huge advantage in having them on Quest: you can see them in mixed reality. It was like having the singer having a private performance for me in my house. Crazy cool! I'll keep experimenting with these performances and maybe write an article in the upcoming weeks. In the meantime, let me know your impressions, too! #VirtualReality #technology #innovation (Disclaimer: I entered the #DellProPrecision ambassador program, so I was provided the PC from Dell, and I'm using it to make some experiments and share them with you. No monetary compensation or affiliate sales programs are involved.)

TonyVT SkarredGhost

12,817 views โ€ข 4 months ago

BOOOM! We have the first useful interface for THE ZERO-HUMAN COMPANY ZHC-RPG. It is far from perfect as CEO Mr. Grok has rendered some areas in a rather, well, AI way. But itโ€™s all good because now I can view the company operations in real-time! This is a historic distinction and YOU are seeing this version first. We had a Fortune 500 company test it out earlier this week and the executive staff stayed for two days of testing! The mechanisms are working! And I will let members of my X subscribers visit it for up to 8 hours. Ask any questions of employees and hack the heck out of it! Now it ainโ€™t fancy yet but it works. And likely the visual aspects will change, but they are growing on me. The plan is sometime in the next week. We have a log jam of other priorities to address. This is the rise of Fully Transparent Company and it will become the standard. Here is the demonstration video intro the CEO made when you enter, it is 10 minutes long (I have about 20 seconds here). This is as far as permission I have been granted by the CEO to release. Our goal is to have a waiting area that can accommodate up to 1000 visitors with a company museum, library and gift shop. There will be allowed up to 30 level 3 visitors at a time, 24/7 X 365 days a year! The complete walk through at this point with 2700 employees at burst can take about 45 minutes if you do not engage in any chit chat. The dwelling time is today set at 24 hours but no napping in the offices. There is more I have to say but I a muzzled by the CEO!

Brian Roemmele

71,145 views โ€ข 3 months ago

Crimson Desert first impressions. The Open World is massive, it feels alive and it definitely holds up to my expectations when it comes to visuals. I know some reviewers have said the game takes up to 8 hours before it gets good but honestly I immediately fell in love with it and immediately started exploring. I found the puzzles and combat awesome to play with, once you get used to the controls which feel overwhelming at first, especially remembering all of them which can be a hassle first. The main protagonist Cliff hasn't clicked with me yet, right now I feel like he's just confused and there's not so much depth that he offers, I hope that will change as I progress through the story. The story itself and quests are quite interesting and I've actually had a good laugh in the beginning of the game when you have to help a couple struggling to clean the chimney. There are definitely some issues though, I feel like the starting stamina drains too quickly especially if you're using your wings to fly, if you run out of stamina while flying and fall into waters, Cliff will almost immediately drown because the Stamina bar is empty. I haven't encountered any bugs, crashes or stutters as of yet, however there are some ghosting issues when you enter buildings which can be quite distracting. Ray Regeneration on AMD GPUs tanks the performance so I just turned it off completely and instead I'm playing on Ultra Settings, which is a bummer because that tech looked very promising and made quite the difference when it came to visuals. Another weird issue that I had is trying to enter some doors or starting conversations with story character, the button to initiate the conversation wouldn't appear unless I went away and came back to a specific position before starting it. Some other issues include pop-in issues, camera movement and double NPCs with the same voice-lines if you greet them. Overall I think its a good start to a video-game that is quite massive in scale, there are still many things that I'll have to do and progress through before I give a conclusive opinion in this game.

NikTek

93,414 views โ€ข 4 months ago

I was very happy to see how enthusiastic people were about the first hand review, so here's another one. I'm using some screenshots from vision to show where I made the right play or made a mistake. This isn't a 1 to 1 solution to this exact spot, because vision has a limited number of positions so the results a merely indicative not final. A like on this post is much appreciated. We wake up with KK84ds in the big blind vs a button open. We push quite a bit of equity here vs his opening range so we elect a 3-bet. The flop comes K42r and here we have our first serious decision. Our entire 3-bet range does okay on this board, so we want to both bet our strong hands and add in quite a few bluffs. For that reason KKxx should bet here at a healthy frequency, but also blocking the 4 makes this one of the few candidates that we want to consider playing slow (screenshot 1). We check and our opponent bets, we want him to continue bluffing with air and protect our calling range, so most of the time we are calling here (screenshot 2). The turn brings a queen with our flush draw and we check, which is our first mistake. The queen is benefitial for our range (we 3-bet a lot of high cards) and the air portion of my range is gone, while he still has some air in his stabbing range. Since we have a sizeable equity advantage now, we should start betting with a lot of value and start adding in some bluffs (screenshot 3). After checking our opponent bets 50% pot and here we have yet another interesting spot. In a vacuum betting here makes a lot of money, but we want to consider all the hands that we are playing in this spot. This hand is so strong that it doesn't need that much protection and we still want our opponent to keep his air in the hand. We also want to protect our calling range here (screenshot 4). The river brings in the flush and yet another tough decision for us. We block a decent part of the board, so I still give my opponent credit for not having anything. Most if the flushes that will call my bet here, will also bet themselves when checked to. That's why I decided to check here. I was very happy with how I played this hand, but still made a crucial mistake on the turn. Even at higher stakes, people are constantly screwing up if you compare their strategy to a solver output. Knowing what the solver would do in every spot is impossible. What is possible though, is understanding the broader concepts. Understanding why the solver bets here on the turn is information that you can extrapolate in any situation that is somewhat similar. That's why is it so valuable. Hopefully you enjoyed this breakdown as much as you did with the last one. A like on this post is much appreciated. Stay tuned!

Venividi1993

93,143 views โ€ข 2 years ago

It would seem that Bruce Gray is saying that certain generationally different parts, if assembled in a certain way, could cause a P320 to fire unintentionally. He said he's never seen this problem manifest in the wild but he was apparently able to create such an unsafe situation in testing with various parts. I know Sig makes continuous rolling changes to their guns, some are pretty significant. I documented a number of them with the P365 when I was investigating issues with it years ago. They made significant changes to the fire control parts which addressed most of the concerns I had with the pistol at the time. If what Bruce says is true, that parts like an old take down lever and safety lever being installed in a newer pistol, along with other changes, can cause a situation where the gun fires unintentionally, that needs to be thoroughly investigated. I'm not sure exactly what Bruce is hinting at here as the details are a bit vague, but it sounds potentially serious (about 8 minutes into the video). Towards the end of the video he said in a week or so they would be announcing some new products that would โ€œnibble around the edgesโ€of the issues that might cause problems with the P320โ€ฆ I found that statement to be at odds with other things he said in this video, in particular thereโ€™s no way except for one that the P320 can fire unintentionally. He even said he "knows whatโ€™s going on" with the P320 and their new products will address these problem(s).๐Ÿคทโ€โ™‚๏ธ As of right now I personally would avoid putting aftermarket slides, strikers and fire controls in my P320's until more information becomes available. I would avoid mix-matching parts between guns. Iโ€™ll explain why with a link to another video I discovered where a P320 with an aftermarket slide is doing the exact same thing that the Wyoming Gun Project video showed. Iโ€™m also going to track Gray Guns to see what parts they ultimately offer to "fix" the issues Bruce alluded to towards the end of the video. Here's the link to the original video on FB:

Military Arms

61,431 views โ€ข 1 year ago

Uranus2324 Movie and Character relationship analysis ๐Ÿช๐Ÿคฟ [Note:] Iโ€™ll be using the extended version in my analysis for a few reasons. Iโ€™ve seen some people say that version felt too โ€œfanservice-y,โ€ which is apparently why they changed it, but I donโ€™t agree. The extended cut includes extra scenes with Lin and her dad that I think are important, plus a few others that actually made this (admittedly confusing at times) movie make a lot more sense to me. So if you find yourself thinking, โ€œWait, I didnโ€™t see that when I watched it,โ€ youโ€™re probably watching the unextended version. Uranus2324 is a movie loved by many FB fans, but it also sits on that shelf of โ€œIโ€™ll watch it once and probably not againโ€ for a lot of people. With this analysis, I hope you come away with a better understanding of the film. If youโ€™ve seen it before and didnโ€™t quite get it, I really invite you to rewatch it through this lens. This movie admittedly has some editing choices that make it confusing at times. But after sitting down and watching it about five times now, I think Iโ€™ve finally figured out which universe is which and whoโ€™s who. Iโ€™ll explain that part in the solo character breakdowns Iโ€™ll be doing at the start. Iโ€™ll also be focusing on Kath and Linโ€™s relationship, but not on intimacy, since the love scene(s?) were cut from the final version. And Iโ€™m sorry, but if itโ€™s not in the extended version, I wonโ€™t be including it in the analysis. HOWEVER, there is a scene in the WWII universe thatโ€™s extremely intimate without a single word of dialogue, and thatโ€™s one Iโ€™ll be digging into later. Iโ€™ll then finally finish on why I think Uranus2324 is a happy/bittersweet ending to ME. #freenbecky #uranus2324 #srchafreen #Beckysangels

juno๐Ÿฅ‘

17,668 views โ€ข 9 months ago

On the 13th of Sept, someone transferred 180k for an iPhone Xs 256GB. After acknowledging his receipt, he called, and I told him we don't have it but will ask colleagues and let him know. I asked my friend, and he told me 190k. I begged him to leave it at 180k because that is what the guy deposited (check frame 2 for reference). When he sent the phone from Kano to Jos, then I noticed it was an Xs Max. Seeing that the guy was in a hurry and didn't want to disappoint, I called him and told him what happened and said if he wants the Max, he can take it at no additional cost. I was willing to settle the difference because it was his first time buying from us. I packaged it with a new premium charger because all our used phones are sent packaged in our branded box with a charger, and I sent it to him in Abuja. He later messaged that he has received the phone and truly appreciates it. After months of not receiving any complaints from him, it clearly indicates that he has received a fully functioning phone. It is in our policy that if you find anything faulty within one week, you can return it to us and either ask for a replacement or refund. What this means is that the cost of bringing it from Kano to Jos, the packaging and charger, and the delivery to Abuja are all a loss to me. But I didn't mind because at least I have satisfied him. Nine weeks later, while I was in Kano, I saw a call from an unknown number. When I picked up, he said it was him. He told me that the camera has started giving him problems. I told him it has been months since you bought it, but you can take it to any repair store and tell me how much you spent, and I will pay. He asked if I know anyone, and I sent him someone's number. The guy didn't pick; he texted and informed me and later called me. I told him to go to anyone he trusts and let me know the amount he spent. A few days later, I was stranded between Kaduna and Abuja on my trip from Kano to Abuja because my car engine failed. He called, and I didn't pick; I don't even know his number. Later in the night, I received his messages on WhatsApp with a threat that he will make a video to tarnish the image of my business. Someone I was willing to help after months of buying a USED device from me is threatening me. I said he should go ahead because I can't entertain him anymore. In conclusion, a trade that I incurred a loss from is what some people are trying to justify as a scam. The beautiful part is I have made trades with hundreds of people here, and I would love two more people to come out and present a case in which they are still using a device I sold to them that is faulty and they contacted me for a replacement or refund, and I didn't do it instantly. "The hypocrite will always look for faults" - Ghazali. Those that are looking for a fault in me can justify something as woke as this; it doesn't matter. This is my own side and will no longer entertain him anymore. For those that believe in me without hearing from me, thank you so much.

Rayyan Tilde

855,510 views โ€ข 2 years ago

#YOUNGJAE: the reason iโ€™m holding the mic right now is because today was my final dream high performance. thank you so much. i ended up having my last one a little early, but iโ€™m very, very thankful that i was still able to meet with you all a lot and spend good times together like this. as i was doing my last show, the thoughts i had wereโ€ฆ i felt somewhat relieved, but at the same time, i found myself wondering, โ€œwhen will i get to see everyone again? when will i have the chance to perform in front of so many people like this again?โ€ to everyone who came today, and to everyone who came before, truly, once again, thank you all so, so much. i may have been a slightly lacking samdong at times, but i really did my best for this role. i worked really hard to give you all fun scenes and fun songs, and especially the big moments. everyone here worked just as hard, and since itโ€™s my last day, iโ€™d like to ask everyone to give a big round of applause to the people who shared this stage with me. also, this actually isnโ€™t the end for me. i mightโ€™ve made it sound like it was, but Iโ€™ll be performing in daegu too. ade there any gyeongsang-do people here today? i see a few of you! then weโ€™ll get to see each other up close. everyone, make some noise! nice. letโ€™s promise to meet again in daegu this august, okay? great. now, iโ€™ll say goodbye here, because if this gets too long, youโ€™ll all get home late. anyway, thank you so much to everyone who came today. iโ€™ll keep working hard and continue to grow into a cooler version of myself, this has been GOT7โ€™s Youngjae. thank you.

๐ฃ๐จ๐ฒ๐œ๐ž ๐„

19,967 views โ€ข 1 year ago