Made a quick haptic feedback prototype for hand-tracking interactions... with a voxel. Felt fun and engaging. It's another level of immersiveness (unfortunately, the video is not able to convey this). Visual design alone can make an interactive experience great, but if you want to make it exceptional, DIFFERENT, this is where haptic design plays the key role. The device on my wrist is from the Hapticlabs.io Prototyping Kit (the thing on my index fingertip is called Linear Resonant Actuator). It's a beautiful, simple-to-use tool. Found a good case for it in my experiments :) To get hand-tracking data, I used the Leap Motion controller (Computer Vision Camera), which is excellent for quick prototypes like this. I saw people experimenting with gloves to build a solid haptic feedback system for XR. It's great for advanced immersive experiences (video games/simulators/interactive entertainment). But for many day-to-day use cases (productivity/OS/media entertainment), having just a "simple" thimble that provides the haptic feedback for the "touching" fingertip will already significantly improve the UX. Hope we will have something like this from our major XR vendors in the near future.show more

I concur with this If she can get her... lawyers to do an apology video for it then it takes a different dimension. The media will have a field day on this. What is good for the goose is good for the gander.show more

I've been testing out Windows 11's new Haptic Signals... feature on compatible hardware, and I think I love it. I'm someone who yearns for small UX details like this, and I'm so happy to see Microsoft leaning into subtle but quality UX implementations like haptics across the Windows Shell. These new Haptic Signals provide a subtle bump when interacting with certain UI elements and actions, such as snapping app windows or dragging files in File Explorer. The feedback response feels great and intentional, and makes using the OS feel more satisfying. There's still room for improvement, but I'd be lying if I said I wasn't impressed with this first implementation. It's only supported on a handful of devices for now, but that should change over time. I've always loved the haptic feedback layered throughout Google Pixel phones, and now Windows is getting its own version of it. More UX niceties like this, please!show more

Been a while since I did a #Flutter UI... challenge so I dug this one up from my bookmarks. Was super fun to build! ✨ The rubber band effect, different gesture handling, haptic feedback and other details together create a great interactive feel! Details and code 👇🏻 #FlutterDevshow more

been experimenting with this for a few hours, lots... of different ideas for how to improve it but here you can rly see how hard it is to move, the only thing i can do is wiggle and flap my hand 😵‍💫show more

Thanks to Boz for the cake. My favorite part... not mentioned in the keynote: the haptic feedback in the wristband feels amazing ! Full write-up and more video coming soon.show more

I got eye tracking working with the look at... shader. It's all on one material and obviously it's not perfect but it's a good start. You can make it so it only does this in the camera to make sure you're always looking at the camera for photos.show more

Force feedback demo Force feedback is when joystick is... pushing on your hand when something is pushing on the robot arm. Feeling the force - so much helpful to control the robot, that done well it allows you to do tasks even without visual feed. You can make an experiment: close your eyes - you can easily get the headphones out of the case. Also, visual information is often not enough. For example, you're trying to pull out a usb connector, but you pull it at the wrong angle, causing it to get stuck. Visually, nothing changes, but the pressure is intense and you can break the connector. Surgical robots have been using force feedback for years, and there are also 3D styluses which use this feature, proving that the technology works and is useful. But in modern robots with AI, it's hardly ever implemented. Although it's useful for both teleoperation and AI model. That's one of the reasons why we are building our robotic arms starting with off the shelf motors rather than taking the whole off the shelf arm. There are still a range of easy wins that can be made iterating robot hardware.show more

So, by now I'm sure you saw the AI... fanart recreation of the Princess Mononoke trailer. It got a LOT of feedback, mostly from people telling the creator what a terrible thing he did and how AI assisted workflows can never be used for anything good or meaningful and most of all that it can never be used for art. That's such nonsense. Of course it can. If it's wielded by artists and great storytellers, great things will come of it. If you hand a violin to someone on the street they'll be able to make it make sounds.. if you hand it to a talented musician it becomes a conveyer of thoughts, emotion and art. Here's a small scene from Mononoke that I did an AI take on.. it's far from perfect and to animate this properly would require much more work. The AI workflows we have today are lacking so many control elements. But to think those things won't come.. come on. Of course they will. But most importantly, in a way where they don't overtake the art completely, but instead acts like an "amplifier" of the artists using the tools. This technology will be in most of our creative tools in the very near future with full controllability. Oh and I never liked the idea of turning old disney classics into live-action films, or doing the same with the beautiful work of Studio Ghibli. But for the purpose of this post I hope you'll forgive me ;-) #art #animationshow more

Building a personal knowledge base for my agents is... increasingly where I spend my time these days. Like Andrej Karpathy, I also use Obsidian for my MD vaults. What's different in my approach is that I curate research papers on a daily basis and have actually tuned a Skill for months to find high-signal, relevant papers. I was reviewing and curating papers manually for some time, but now it's all automated as it has gotten so good at capturing what I consider the best of the best. There are so many papers these days, so this is a big deal. You all get to benefit from that with the papers I feature in my timeline and on DAIR.AI. The papers are indexed using tobi lutke qmd cli tool (all of it in markdown files along with useful metadata). So good for semantic search and surfacing insights, unlike anything out there. I am a visual person, so I then started to experiment with how to leverage this personal knowledge base of research papers inside my new interactive artifact generator (mcp tools inside my agent orchestrator system). The result is what you see in the clip. 100s of papers with all sorts of insights visualized. I keep track of research papers daily, so believe me when I tell you that this system is absolutely insane at surfacing insights. This is the result of months of tinkering on how to index research and leverage agent automations for wikification and robust documentation. But this is just the beginning. The visual artifact (which is interactive too) can be changed dynamically as I please. I can prompt my agent to throw any data at it. I can add different views to the data. Different interactions. I feel like this is the most personalized research system I have ever built and used, and it's not even close. The knowledge that the agents are able to surface from this basic setup is already extremely useful as I experiment with new agentic engineering concepts. I feel like this knowledge layer and the higher-level ones I am working on will allow me to maximize other automation tools like autoresearch. The research is only as good as the research questions. And the research questions are only as good as the insights the agents have access to. Where I am spending time now is on how to make this more actionable. I am obsessed about the search problem here. The automations, autoresearch, ralph research loop (I built one months ago) are easier to build but are only as good as what you feed them. Work in progress. More updates soon. Back to building.show more

Xabi Alonso’s message to all Madrid fans: “I want... Madridistas to be proud of the team they watch. When they watch the team, I want them to say: Yeah, that’s my Madrid.” “This is a very special day for me. I will remember it for life. This is my home.” “I feel the excitement of the Real Madrid fans. This is a big moment for everyone. As soon as I stepped foot in Valdebebas my feeling and love for Real Madrid appeared again, but it never left me.” “I feel like I was born again today. Thank you Florentino, for trusting me with this job. From the first day you sat on the bench of Real Madrid’s U14 in 2018… we knew where you would end up. Right here”. “We have a great team, with fantastic players. We’ll have a very good future. I want to build a great team. With the ambition that we will achieve great things.” “I want to talk about Carlo... He was my coach, a great person, a coach who left his mark on me, and probably without his mastery and the learning I received from him, I wouldn’t be here. I take up his legacy with great honor and pride.” Real Madrid C.F.show more

highlighter [text] experimenting with UILabel extensions to bring back... everyones favourite item in the pencil case - the highlighter. when highlighting, It also gives a subtle and continuous haptic feedback to mimic the squeaky friction on paper.show more

I know this is hard for some of you... but I promise this is the highest use of your time while you’re in school - I know today is day 1 for a lot of you and I hope this leads to something great - parents send this to the kids today - extra important for the college kids ✅show more

Don't you have a haptic chair for VR gaming?... Don't worry, your friendly humanoid robot can help you with that! In a recent research paper from the University of Colorado, researchers experimented with using a humanoid robot to literally grab your chair and move it during VR racing sessions to make the game more realistic. And from the users' feedback, it seemed to work. I guess they took inspiration from those viral videos, where in some low-budget arcades, the owner literally moved the station with his own hands. I can't wait for the fail videos caused by this technology... Full video is available here: #VirtualReality #VR #technologyshow more

Everyone keeps calling the Apple Vision Pro's UI "Magical"... I NEEDED to try it out for myself. The Quest Pro is capable of it so I made a demo using eye tracking and hand tracking replicating the Apple UI. Its really good. APK for everyone to try the "Vision UI Experience" soon, Video with my takeaways Sooner.show more

I just built my own wiki generator plugin for... my agents. My agents can now generate wikis for anything I ask. One of my favorite wikis is called PaperWiki. This is a great example of what Andrej Karpathy describes. It uses obsidian vaults to organize papers, retrieve LLM-generated summaries, diagrams, and other advanced views for paper exploration. When Obsidian UI is not enough, I use my own artifact generator inside my agent orchestrator (see clip for example). This allows my agents to build any kind of view or exploration feature that I need. The papers are all curated with automations and several rules/patterns I have manually built over the years. On the surface, this looks basic. But behind the scenes, there are advanced search capabilities, connections, metadata, derived data, and other interesting bits of information that are extremely useful for my research agents. This is mostly built for agents. The artifact preview is just a high-level way to validate and quickly assess the quality of the wiki, suggest improvements, and it's also great for research. I use tobi lutke's qmd for all search capabilities. Everything is markdown. The summaries and even the diagrams. The wiki updates on its own based on several automations I have optimized over the past couple of weeks. The wiki grows and self-improves based on several requirements important for my research use cases. This is as personalized as it gets. There is nothing like it out there. And I use my research expertise to continue improving it over time. This is a vanilla wiki. There are so many things I want to build on top of this. Different aggregations, views, artifacts, etc. All to help automate more of my research work and accelerate productivity. I think the biggest leverage here is how powerful this could be for discovery and experimentation. One of my goals is to use it to find deeper connections and insights that would otherwise elude the top human researchers and use those to generate interesting new hypotheses and research experiments. That way, my agents can use autoresearch to explore research ideas at the frontier. Stay tuned for more.show more

I'm currently working on a Rogue-like action game for... the GBA. With roughly 10 minute runs it fits perfectly for a portable console. The first test version will be available soon. Once that is out, I really hope for your feedback and suggestions to make it a great game.show more

I enjoy @DaHeckSaJerry's art a lot so I wanted... to do a thing just to do something for me for the day. Not sure of Reynard and Cauli's headcanon voice so I could probably try again with feedback but it was fun to make a little dub after so long ^^; Hope it's alright!💖show more

Blades of the Guardians episode two is crazy. There... are many battles, but I would like to draw attention to this one. We also have hand to hand combat, and it's just as good. Strong choreography with great use of the 3D camera, and the variety of techniques is impressive.show more

Happy Monday….I took down my post yesterday about this... because sometimes it’s better to see a video than to read words on a screen. This is another reason why they want to muffle Harbaugh. He’s advocating for the players that make the system what it is. He wants kids to share in the revenue that they help to generate. This isn’t the conversation that anyone in collegiate sports want to hear. Kids aren’t aware of what all of the system entails economically and they dont know all of the moving parts. Harbaugh understands and he can help to champion the cause while educating kids who wouldn’t necessarily have the experiences or resources to “get it”. This statement should make him a hero to all future, current and former players. All you have to do is ask yourself “would my coach ever advocate for us like this, has my coach ever advocated for me like this and what would make someone take a stand like this?” S/O @bklynplayboy for the video and Nate Ortiz for the edit 🫡show more