Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Introducing Generative Interfaces - a new paradigm beyond chatbots. We generate interfaces on the fly to better facilitate LLM interaction, so no more passive reading of long text blocks. Adaptive and Interactive: creates the form that best adapts to your goals and needs!

Yanzhe Zhang

1,101 subscribers

65,877 views • 1 year ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

8 Comments

Yanzhe Zhang1 year ago

Website: Paper: Code:

Yanzhe Zhang1 year ago

To achieve this, user queries are first mapped into structured intermediate representations and then decoded into UI code. An iterative refinement process applies adaptive reward functions to optimize the generated interfaces.

Yanzhe Zhang1 year ago

We ask human annotators to compare our generative interfaces (GenUI) with conversational interfaces (ConvUI) and interfaces generated through Claude artifacts (Instructed UI). GenUI wins a LOT.

Yanzhe Zhang1 year ago

Human preferences vary across different domains, suggesting a balance between generative interfaces and conversational ones to optimize user experience.

Yanzhe Zhang1 year ago

Joint work with @CHEN_JIAQI_00 @zhangyt0704 @EchoShao8899 @Diyi_Yang !

Aristotelis Economides1 year ago

i'm trying to understand what's the contribution of the paper. is it just that humans prefer GUIs over text, or do you also have any new way of improving GUI generation

Siyang Liu1 year ago

This video is fantastic! I hope I could make such a wonderful short video that clearly demonstrates the contributions of my work. May I know what tools did you use for making this video? Generative UI? When presenting Finite State Machine, how to make the animation effect?

cannedapricots1 year ago

kind of a longwinded way to describe a coding agent. although we appreciate the preference studies

Related Videos

It's here! Episode 2 of Interfaces that think. It's a controversial one on using AI to change how we read long form text.

It's here! Episode 2 of Interfaces that think. It's a controversial one on using AI to change how we read long form text.

Tareq Ismail

35,827 views • 2 days ago

Introducing Poe Apps: a new, easy way to create and use visual interfaces into any combination of the 100+ text, image, video, and audio models on Poe. (1/5)

Introducing Poe Apps: a new, easy way to create and use visual interfaces into any combination of the 100+ text, image, video, and audio models on Poe. (1/5)

Poe

66,926 views • 1 year ago

😅 is anyone else getting sick of chatbots? I wrote down a few thoughts on why chatbots are not the future of interfaces and how we can be more thoughtful:

😅 is anyone else getting sick of chatbots? I wrote down a few thoughts on why chatbots are not the future of interfaces and how we can be more thoughtful:

Amelia Wattenberger 🪷

259,503 views • 3 years ago

Today, we're sharing new research on Solaris, our first Interface World Model. Solaris is a new kind of operating system that generates interactive interfaces frame by frame, in real time, with no code. We find that Solaris outperforms frontier LLMs when generating new interfaces, across structural similarity and information retention. Read more and request early access at the link below.

Today, we're sharing new research on Solaris, our first Interface World Model. Solaris is a new kind of operating system that generates interactive interfaces frame by frame, in real time, with no code. We find that Solaris outperforms frontier LLMs when generating new interfaces, across structural similarity and information retention. Read more and request early access at the link below.

Runway

745,278 views • 1 month ago

(1/3) The hemodynamic interfaces paradigm proposed by Philippe Rola et al. is probably the most comprehensive paradigm for assessing shock. Not going to lie, its a bit complicated. I comprehensive calculator with theory and practice tips to help you understand the interfaces as part of a NEW project ShockCalcs👇

(1/3) The hemodynamic interfaces paradigm proposed by Philippe Rola et al. is probably the most comprehensive paradigm for assessing shock. Not going to lie, its a bit complicated. I comprehensive calculator with theory and practice tips to help you understand the interfaces as part of a NEW project ShockCalcs👇

Ross Prager

30,629 views • 1 year ago

today, we're bringing group chats to AI. the old interactions were chatbots and vibe-coded interfaces. today that changes. you can use folk to plan group meetings, schedule trips, research the web for you, all through your text messages.

today, we're bringing group chats to AI. the old interactions were chatbots and vibe-coded interfaces. today that changes. you can use folk to plan group meetings, schedule trips, research the web for you, all through your text messages.

Arlan

17,312 views • 4 months ago

MCP servers were stuck on text and data. Not anymore. 👀 Proposed by Anthropic, OpenAI, and the MCP-UI community, the new MCP Apps Extension standardizes interactive interfaces with security built in. Here's what you need to know. ▶️

MCP servers were stuck on text and data. Not anymore. 👀 Proposed by Anthropic, OpenAI, and the MCP-UI community, the new MCP Apps Extension standardizes interactive interfaces with security built in. Here's what you need to know. ▶️

GitHub

60,969 views • 9 months ago

New generative UI experiences in the Google Gemini and AI Mode in Search use Gemini 3’s multimodal understanding capabilities to make entire user interfaces for you from scratch — dynamically delivering what you need in a visual and interactive way. Google Research software engineer Yaniv Leviathan shares more about the process of building generative UI (hint: so much fun that the team couldn't stop playing with it) and how he's been using it so far.

New generative UI experiences in the Google Gemini and AI Mode in Search use Gemini 3’s multimodal understanding capabilities to make entire user interfaces for you from scratch — dynamically delivering what you need in a visual and interactive way. Google Research software engineer Yaniv Leviathan shares more about the process of building generative UI (hint: so much fun that the team couldn't stop playing with it) and how he's been using it so far.

Google

138,435 views • 10 months ago

"Maybe the right UI for AI is a generative UI." Here's my new interview with Stephen Chau featuring a live demo of Cove's ground-breaking visual AI interface that breaks free from chatbots. We had a great chat about: - Real world use cases for visual AI interfaces - Generative UI and just-in-time AI apps - How Stephen scaled Uber Eats to $25B ARR Some quotes from Stephen Chau: "In computing, we moved from the command line to graphic user interfaces. Chatbots are like the command line era of AI. What's next is this..." "Imagine the entire layout of the workspace and all its contents is something made just in time, based on what you're trying to do..." "Our goal with Uber Eats was to build a business that's the same size as the Rides business. Here's what mattered..." 📌 Watch now:

"Maybe the right UI for AI is a generative UI." Here's my new interview with Stephen Chau featuring a live demo of Cove's ground-breaking visual AI interface that breaks free from chatbots. We had a great chat about: - Real world use cases for visual AI interfaces - Generative UI and just-in-time AI apps - How Stephen scaled Uber Eats to $25B ARR Some quotes from Stephen Chau: "In computing, we moved from the command line to graphic user interfaces. Chatbots are like the command line era of AI. What's next is this..." "Imagine the entire layout of the workspace and all its contents is something made just in time, based on what you're trying to do..." "Our goal with Uber Eats was to build a business that's the same size as the Rides business. Here's what mattered..." 📌 Watch now:

Peter Yang

74,721 views • 1 year ago

INTRODUCING Notte Building the agentic internet with the strongest web browser for LLM agents. We transform ANY webpage into structured text, enabling better web understanding and navigation. Plug any LLM to to build your own AI agent

INTRODUCING Notte Building the agentic internet with the strongest web browser for LLM agents. We transform ANY webpage into structured text, enabling better web understanding and navigation. Plug any LLM to to build your own AI agent

Notte

225,226 views • 1 year ago

Last week OpenAI launched ChatGPT Canvas, an interface that displays text, code, and visualization outputs. In the enterprise, we rely on more structured, trusted UX elements -- record details, lists, dropdowns, dashboards. Salesforce Page Layouts and Dynamic Forms control how components are presented, but it's time-consuming and hard to anticipate what data and workflows each user will need. But what if it didn't have to be this way? So excited to share the new Salesforce Generative Lightning UX ⚡️which dynamically generates layouts including tables, charts, news, Lightning components, powered by Agentforce. 🔹 Empowers CRM teams with ready access to essential info and insights, and ability to take action by talking or typing 🔹 Personalized to each user and adapts dynamically to each job to be done 🔹Secure and trusted, respecting data-sharing rules and permissions configured in your Salesforce instance We know AI can generate code, text, and video. Now AI can dynamically generate enterprise UX/UI too. You'll never experience enterprise apps the same again. 🤯 In pilot starting now. Look forward to your feedback so that we can productize next year! Salesforce Research Blog: Generative Lightning on AppExchange: #GenAI #UI #UX #Interfaces #Design #PageLayouts

Last week OpenAI launched ChatGPT Canvas, an interface that displays text, code, and visualization outputs. In the enterprise, we rely on more structured, trusted UX elements -- record details, lists, dropdowns, dashboards. Salesforce Page Layouts and Dynamic Forms control how components are presented, but it's time-consuming and hard to anticipate what data and workflows each user will need. But what if it didn't have to be this way? So excited to share the new Salesforce Generative Lightning UX ⚡️which dynamically generates layouts including tables, charts, news, Lightning components, powered by Agentforce. 🔹 Empowers CRM teams with ready access to essential info and insights, and ability to take action by talking or typing 🔹 Personalized to each user and adapts dynamically to each job to be done 🔹Secure and trusted, respecting data-sharing rules and permissions configured in your Salesforce instance We know AI can generate code, text, and video. Now AI can dynamically generate enterprise UX/UI too. You'll never experience enterprise apps the same again. 🤯 In pilot starting now. Look forward to your feedback so that we can productize next year! Salesforce Research Blog: Generative Lightning on AppExchange: #GenAI #UI #UX #Interfaces #Design #PageLayouts

Clara Shih

123,815 views • 2 years ago

If we go back to 2017-2018 if you wanted to generate a zero knowledge proof you couldn't do it in a couple seconds on your mobile device as you can today thanks to the work of folks like our teammates. Rather, you were gonna be sitting at a desktop computer for upwards of 30 minutes crossing your fingers and hoping that something would generate. Now our circuits and underlying technology are much more efficient and swift. Also, the user experience, the interfaces, the buttons that we click and see are now much more closely designed like the digital experiences we're used to instead of the clumsy early interfaces of blockchain applications which remind many users of the early days of the internet. Source: Biometric Update Podcast Episode 24 with Billions CEO Evin McMullen evin Learn more:

If we go back to 2017-2018 if you wanted to generate a zero knowledge proof you couldn't do it in a couple seconds on your mobile device as you can today thanks to the work of folks like our teammates. Rather, you were gonna be sitting at a desktop computer for upwards of 30 minutes crossing your fingers and hoping that something would generate. Now our circuits and underlying technology are much more efficient and swift. Also, the user experience, the interfaces, the buttons that we click and see are now much more closely designed like the digital experiences we're used to instead of the clumsy early interfaces of blockchain applications which remind many users of the early days of the internet. Source: Biometric Update Podcast Episode 24 with Billions CEO Evin McMullen evin Learn more:

Billions

16,793 views • 10 months ago

Introducing a new Interfaces issue, Typography Manual for the Web. Typography on the web is hard. There's a lot to know and a lot to keep in mind, from choosing the right typeface and loading fonts to making sure type is legible and fits the interface.

Introducing a new Interfaces issue, Typography Manual for the Web. Typography on the web is hard. There's a lot to know and a lot to keep in mind, from choosing the right typeface and loading fonts to making sure type is legible and fits the interface.

Jakub Krehel

37,858 views • 3 months ago

Introducing Code on Canvas in AI design tool for Claude and Codex. Design ❤️ Code are officially in a relationship, opening new ways to create on canvas. Ask agent to generate custom design tools inside Pencil on the fly, create interactive components, generative art and more, but still keep the full manual design control. This is just the beginning. Let us know what you think. And let's take it to the next level together. Download the new Pencil update today.

Introducing Code on Canvas in AI design tool for Claude and Codex. Design ❤️ Code are officially in a relationship, opening new ways to create on canvas. Ask agent to generate custom design tools inside Pencil on the fly, create interactive components, generative art and more, but still keep the full manual design control. This is just the beginning. Let us know what you think. And let's take it to the next level together. Download the new Pencil update today.

Tom Krcha

80,268 views • 5 months ago

🔥 TypeScript Tip 🔥 Here, we build a function that creates zod schemas from your own interfaces, with full autocomplete. The lesson? It's often really hard to get autocomplete when your function _accepts the results of another function_.

🔥 TypeScript Tip 🔥 Here, we build a function that creates zod schemas from your own interfaces, with full autocomplete. The lesson? It's often really hard to get autocomplete when your function _accepts the results of another function_.

Matt Pocock

49,970 views • 3 years ago

Introducing Radiance, Shift, and Dune. Our early experiments in AI Interfaces, we revealed at CES this year. With recent advances in AI, we’re able to do far more in less time and are always multitasking. Yet the physical means to do so - keyboards and touchscreens - have remained largely unchanged making everyday tasks unnecessarily overwhelming. We aim to change that. Each of our experiments grew out of moments we kept running into ourselves - rushing to join calls, repetitive routines, and everyday interactions that demand more effort than they should. These are not final answers. They are deliberate explorations, shared openly to invite conversation, feedback, and reinterpret the future of Human Computer Interaction! More to build. More to question. More to come. ___ Join the waitlist for early access and our Discord community to help us shape the future of interfaces and for exclusive open-source drops.

Introducing Radiance, Shift, and Dune. Our early experiments in AI Interfaces, we revealed at CES this year. With recent advances in AI, we’re able to do far more in less time and are always multitasking. Yet the physical means to do so - keyboards and touchscreens - have remained largely unchanged making everyday tasks unnecessarily overwhelming. We aim to change that. Each of our experiments grew out of moments we kept running into ourselves - rushing to join calls, repetitive routines, and everyday interactions that demand more effort than they should. These are not final answers. They are deliberate explorations, shared openly to invite conversation, feedback, and reinterpret the future of Human Computer Interaction! More to build. More to question. More to come. ___ Join the waitlist for early access and our Discord community to help us shape the future of interfaces and for exclusive open-source drops.

Aina

230,543 views • 8 months ago

English Is The New SQL LLMs have made it easy for everyone to create on-the-fly dashboards and plots. You can connect to your database and then use a SOTA LLM like 4o, Opus, or Gemini to generate SQL and Python code to create on-the-fly dashboards and plots. ChatLLM makes it possible across all state-of-the-art LLMs -

English Is The New SQL LLMs have made it easy for everyone to create on-the-fly dashboards and plots. You can connect to your database and then use a SOTA LLM like 4o, Opus, or Gemini to generate SQL and Python code to create on-the-fly dashboards and plots. ChatLLM makes it possible across all state-of-the-art LLMs -

Bindu Reddy

50,569 views • 2 years ago

Introducing GPT-4o, our new model which can reason across text, audio, and video in real time. It's extremely versatile, fun to play with, and is a step towards a much more natural form of human-computer interaction (and even human-computer-computer interaction):

Introducing GPT-4o, our new model which can reason across text, audio, and video in real time. It's extremely versatile, fun to play with, and is a step towards a much more natural form of human-computer interaction (and even human-computer-computer interaction):

Greg Brockman

4,363,667 views • 2 years ago

Introducing "Dots" a new generative art project and ecosystem that I am thrilled to release into the world. The story starts with a new open “Inclusive Edition” launching on Prohibition.art and Rally on 1/24/24 powered by Art Blocks Engine. 👇

Introducing "Dots" a new generative art project and ecosystem that I am thrilled to release into the world. The story starts with a new open “Inclusive Edition” launching on Prohibition.art and Rally on 1/24/24 powered by Art Blocks Engine. 👇

r4v3n

14,393 views • 2 years ago

Opennote () is the interactive AI tutor that knows you. It creates personalized video lessons, practice problems, and drawings—adapting to your learning style and goals so every session feels tailored and engaging. Congrats on the launch, , Rishi, and !

Opennote () is the interactive AI tutor that knows you. It creates personalized video lessons, practice problems, and drawings—adapting to your learning style and goals so every session feels tailored and engaging. Congrats on the launch, , Rishi, and !

Y Combinator

56,317 views • 1 year ago