Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Prototyped another iteration of a hand-tracking-based BoxelXR toolbar. This time, it's a circular menu spawned in front of a user once the index pinch is triggered. Notes: 1) It works great with four elements, but it's hard to scale for a higher number; 2) The selection interaction is forgiving...

11,746 Aufrufe • vor 2 Jahren •via X (Twitter)

5 Kommentare

Profilbild von P
Pvor 2 Jahren

One of the best examples of reinventing interfaces for XR I've seen so far. Incredibly elegant, given how simple yet powerful this is. Hats off.

Profilbild von Lubos
Lubosvor 2 Jahren

Beautiful. Pinch & drag is a way to go for the menus. Minimalist and easy to use.

Profilbild von Tim Arterbury
Tim Arterburyvor 2 Jahren

Amazing!! Love this idea! 💡

Profilbild von Jimmy6DOF
Jimmy6DOFvor 2 Jahren

loving this work and thanks for the unity project starter files I played with vr-slider but this has come a long way since then keep innovating 🤩 !!

Profilbild von Illuminated Reality Studios
Illuminated Reality Studiosvor 2 Jahren

Could you do the 2 hand pinch stretch gesture to scale it up to more buttons on the fly

Ähnliche Videos

AI instead of UI The last few years radically changed how we think about digital products & product design process in general. What we are witnessing right now is a transition where AI is no longer just a feature; it is becoming the infrastructure of interaction. For decades, UI design was rooted in the concept of “Happy Path,” a series of static, linear screens (routes from A to B) designed to funnel users toward a goal. This “one-size-fits-all” approach assumes that all users have the same mental model, which is far from the truth. The rise of AI tools like ChatGPT and Gemini is showing that we are moving into an era of Generative Interfaces. Instead of a designer pre-determining every button and menu, the interface is synthesized in real-time based on user actions. Back in 2019, Gleb Kuznetsov and I were working on the concept of morphing Interface, the idea of a UI that adapts its structure based on user intent. The great thing about this UI is that it was highly dynamic: different users saw different content/contextual actions based on their behavior. This concept was crazy in 2019, but it is highly relevant to the modern state of the product design process. And I strongly believe that it represents the future of UI design. We will move beyond the “AI chatbox" crutch Yes, many products today treat AI as a sidecar (think of Copilots or chatbots pinned to the side of a traditional dashboard), but this is a transitional phase. Why? Because adding a chat window to a 20-year-old software layout is like putting a jet engine on a horse-drawn carriage. That's why the future isn't "AI as an add-on"; it is AI as the Operating System. AI will power generative interfaces that are rooted in anticipatory design: UI won’t wait for a command; it will surface tools based on the user's current environmental context and historical behavior. This evolution changes the very nature of product design, and we will move away from designing pages/screens and toward designing systems of logic.

Nick Babich

53,320 Aufrufe • vor 5 Monaten

AG-UI makes building agentic applications dramatically easier. Here's how it works. This is a model for a simple chatbot: User → LLM → Response But interactive agents that render UI, pause for approvals, and ask users for input need a much more complex model. When building these agents, a response from the LLM will include a series of state changes as the agent runs: • Agent started a task • Agent called a tool • Agent updated its state • Agent streams these tokens • Agent is waiting on a human • Agent is resuming the task The Agent-User Interaction Protocol (AG-UI) treats the LLM response as a stream of events rather than a text endpoint. In practice, here is what you get as an agent runs: 1. Lifecycle events so your UI knows where the agent is. 2. Text messages that stream tokens. 3. Tool calls so your UI can prefill a form with any required arguments. 4. State updates that keep your UI in sync with the agent. 5. Special events for human approvals, rich media, and custom needs. All of these events travel over standard transports (SSE, WebSockets, or plain HTTP) as JSON. As a result, you can build a frontend that stays in sync with the agent's progress without having to invent a custom process to make this happen. For example, building a human-in-the-loop workflow becomes an off-the-shelf component you can integrate rather than build from scratch. CopilotKit🪁 is the creator of AG-UI, and you can use it when building frontend applications pretty much anywhere: • React • Angular • Vue • React Native • Slack • Teams • Discord • WhatsApp • Telegram Here is the link for you to check it out: Thanks to the CopilotKit team for partnering with me on this post.

Santiago

17,438 Aufrufe • vor 27 Tagen