Loading video...

Video Failed to Load

Go Home

Compared Qwen3.6 35B and 27B in the same conditions with Google TurboQuant Device: MacBook Pro M5Max 64GB RAM Outputs characteristics: Qwen3.6 35B: 6672 tokens, 2m 10s, 65 tok/s Qwen3.6 27B: 7344 tokens, 5m 22s, 24 tok/s Conclusion: Both models were asked to draw waves using HTML, 35B responded quickly...

55,540 views • 2 months ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Most recent diffusion language model research (that I’ve seen) seems to be using masking as the noising process. It looks like, however, most closed-source models (Google Gemini Diffusion and possibly Inception Labs’ Mercury) use a different noising process, where instead of masking tokens, they replace them with different tokens (either with a random token or a semantically similar token). I wondered how they were getting such high throughput with the latter noising process, since I believed that optimizing inference with KVCache approximation would be more difficult (for various reasons). I visualized this noising process with tiny-diffusion and compared it to normal unmasking, and was very surprised to see how fast the generation “settles” into a reasonable output, and then only slightly refines afterwards, requiring much fewer steps in total. Unmasking (where tokens are never remasked, the typical implementation) is inherently limited in generation speed by the fact that an increase in tokens decoded per step leads to more errors due to the mismatch between individual and marginal token probability distributions we sample from. The token replacement noising process seems to have a much different set of characteristics. Because we sample each token per step, every token makes “progress” towards the final output each iteration (in addition to *potentially* giving other tokens more information in future steps). Generally, masking has outperformed other noising processes, which is probably why most research focused on it (using smaller models). But the paper referred to in the retweet shows that random replacement as a noising process may scale better as model size increases. Big labs might have noticed these results much earlier (due to having drastically more training resources and being able to test larger models), which may explain the discrepancy in the choice of noising process. I’m gonna test this with larger models, since tiny-diffusion only has 10M parameters.

nathan (in sf)

40,440 views • 6 months ago

HTML Artifacts are a big part of how I work with agents now. Artifacts can be more than just static files. When combined with agents, they can take action or help you take action. This unlocks all kinds of interesting ways to work with agents. This is clearly the future. Check out this writing and scheduler artifact I built in a few minutes. It uses a bit of HTML and JS. All the data is in markdown (Obsidian vaults), so the agent can access and modify it at any time. No DB needed. No sophisticated functionalities. The agent decides all that for me based on the skills, context, and memory it has access to. The best part about this simple stack is that all the important information stays with me. This has allowed me to build a recursive self-improving system and automations that can better tap into coding agents like Codex or Claude Code. I could have paid or built an entire app for scheduling posts, and there are so many of them out there. But I don't need to. I've realized a simple artifact does the job. And the simplicity of it is actually an advantage. Very little maintenance for very high returns on personalization, time, and efficiency. The other benefit of this is that I can add features as I please. That level of personalization feels magical, and we should all be pursuing more of it. All of this just keeps compounding. Of course, this example is just about writing. But I have similar artifacts for research, design, experimentation, evaluation, and so much more. And no, I didn't actually publish the post example I shared in the clip. It was just for demonstration purposes. I actually spend more time than this when writing together with agents. Lastly, having built my own agent orchestrator tool has made me realize that simplifying the tool stack is a superpower. If you are curious about how all this works, I will do a live session next week:

elvis

18,374 views • 2 months ago

🚀Just launched: Amazon Q, the most capable GenAI-powered assistant is generally available today: Customers are using Q to transform how their teams get work done. When employees chat with Amazon Q, it provides immediate, relevant information and advice to help streamline tasks, speedup decision-making, and help spark creativity and innovation at work. . Early indications signal Amazon Q could help our customers’ employees become more than 80% more productive at their jobs; and with the new features we’re planning on introducing in the future, we think this will only continue to grow. 🟠 Amazon Q Developer allows developers to spend more time coding and less time on maintenance and performing other tedious, repetitive tasks. Q assists developers and IT professionals (IT pros) with all of their tasks—from coding, testing, and upgrading applications, to troubleshooting, performing security scanning and fixes, and optimizing AWS resources. Q also comes with Q Developer Agents which can autonomously perform range of tasks and we expect it to be the state of the art accuracy in benchmarks like SWE-Bench. 🟠 Amazon Q Business empowers employees to be more data-driven, and helps customers make better, faster decisions using company knowledge and data. Q Business is a generative AI–powered assistant that can answer questions, provide summaries, generate content, and securely complete tasks based on data and information in enterprise systems 🟠 Amazon Q Apps, a new and powerful capability of Amazon Q Business, enables employees to use natural language to quickly and securely build their own generative AI applications to automate daily tasks without requiring any prior coding experience. Employees simply describe the type of app they want, in natural language, and Q Apps will quickly generate an app that accomplishes their desired task, helping them streamline and automate their daily work with ease and efficiency.

Swami Sivasubramanian

25,216 views • 2 years ago

The future of footwear may not be manufactured in bulk. It may be fabricated around you. That is what makes this shift so interesting to me. 3D-printed footwear is moving from novelty to a real industrial model, with market forecasts pointing to rapid growth over the next decade. At the same time, brands and manufacturers are using additive manufacturing, digital design, and custom-fit workflows to shorten development cycles and make more personalized products viable. What is new here is not just the printer. It is the system around it: → scan the foot → model the fit digitally → print the part on demand → produce closer to the customer That matters. Because once footwear becomes data-driven and locally fabricated, several things change fast: → fit gets more personal → prototyping gets faster → waste drops because you do not overproduce → inventory pressure falls because you do not need to guess demand the same way To me, that is the bigger signal. This is not just about a better sneaker. It is about a different manufacturing logic. Formlabs notes that 3D printing already enables customized orthotics with better biomechanical precision, lower material waste, and simpler digital workflows. McKinsey has also pointed to digitization and 3D design as a way to shorten design cycles and reduce sampling iterations in apparel and footwear. And once that logic matures, the use cases get much bigger: → custom athletic footwear built from gait and pressure data → hospitals producing orthotics faster and closer to the patient → micro-factories making products on demand instead of stocking shelves → footwear designed for one body, not an average body That is why I think this matters now. The question is no longer whether personalized fabrication is possible. It is whether brands move fast enough before customers start expecting every product to fit like it was made only for them. Would you actually wear a shoe fabricated around your own biometric data? #AI #3DPrinting #Footwear #Manufacturing #Innovation #FutureOfWork #RetailTech #Customization #Technology

Pascal Bornet

47,443 views • 2 months ago

Europe is quietly becoming what the United States once promised the world. More and more people are looking at their best years ahead and choosing a place where everyday life is designed to work. Where the future feels stable enough to plan for. Where safety is not a luxury product. Where you can build a good life without gambling your health, your family, or your dignity on one bad month. In much of Europe, the “dream” is not about becoming a billionaire. It is about becoming unafraid. It is the freedom of walking home at night without scanning every shadow. The comfort of knowing that if you get sick, you do not need to calculate whether you can afford to be treated. The relief of having a society that still believes children should carry backpacks, not trauma, and definitely not weapons. The calm of streets built for human beings, not just cars. The ability to take a holiday without feeling like you are committing career suicide. The basic decency of labor protections that assume you are a person first and a resource second. And then there is the part people underestimate until they live it: the texture of life. The cities are older and more beautiful than you expect. The distances are smaller. Weekends are real. Food is real. Public spaces are not just decorative, they are functional. Parks are full. Cafes are full. Trains take you somewhere, often across borders, without turning travel into a stress test. You can live in one country, work with another, and visit a third like it is normal because, in many places, it is. The European dream is also a quiet confidence in the social contract. That if you contribute, the system does not abandon you. That you can raise a family without feeling like you are one accident away from ruin. That “getting ahead” does not require burning out. That a good society is one where normal people can live normal lives and still feel proud of them. This is why more and more Americans are not just visiting Europe, but staying. Some come for studies and never leave. Some arrive for a job and realise the lifestyle is the real promotion. Some originally planned a one year experiment and then cannot imagine going back to a place where stress is treated as a personality trait and insecurity is marketed as freedom. Europe is not perfect. It has bureaucracy. It has politics. It has problems that deserve criticism. But in many European countries, life is still built around a simple idea: society should reduce fear, not monetise it. That is the new dream. And people can feel it the moment they arrive. If you could choose one thing to trade for a better life, what would it be: more income, or more security? And what do you think your country would have to change for people to stop leaving, and start staying? Stay connected, Follow Gandalv Gandalv

Gandalv

988,824 views • 4 months ago

🌟 "SHOULD I BUY AN IPHONE FOR TRACKING?" 🌟 tl;dr at bottom I've been using a facecam and Nvidia tracking for a long time and upgrading to a used iphone 13 combined with vbridger, the difference is HUGE. Here is my take on it! Why is Facecam > iPhone? ✅️ More affordable, esp for those using android phones ✅️ More convenient. If you launch Vtubestudio, there's a setting where your webcam automatically turns on, which is great. ✅️ Can track pretty well in the dark IF you already have a good webcam for night tracking. ❌️❌️ Stiff tracking at times ❌️ Not good at tracking specific mouth movement Why iPhone > Facecam? ✅️✅️ You can make the most of your model, since movement along the X and Y axes are a lot more accurate and wider. Also tracks eyes and overall face better. ✅️ More EXPRESSIONS. If your rigging allows for it, things like cheek puff, and tongue are able to be tracked. As far as I know, I cannot do this on facecam. ❌️❌️ WAY more expensive or requires that you have an iPhone already. Needs more set-up (need phone stand right in front of you, need to hook your phone up to a charger at all times, phone could possibly overheat as well if it's old, so you might need a cooler). TL;DR For me, if you have an extra 200 to spare for WAY better tracking, I would 1000% recommend buying a used iPhone on Amazon. iPhone X is the BARE minumum, I would recommend 12/13 so that your phone does not overheat. I do not need to use a cooler for my used iPhone 13. Being able to use my rigging to its fullest makes the model feel so so so different (in a good way). Feel free to reply with any questions, I will try to answer them!

Minori 🎀🍰💢 || bakaneko vampire :3

309,398 views • 1 year ago