Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Today we're shipping spatial context. This lets you draw directly on your screen + pass it as context to the model. AI can easily analyze screenshots. But, it has no idea where exactly you want it to look. Now you can just show it. It's very intuitive. Demo:

Farza 🇵🇰🇺🇸

117,249 subscribers

226,355 views • 2 days ago •via X (Twitter)

Science & Technology Education

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

You can now draw on your screen to give spatial context to heyclicky It’s live. check it out-

You can now draw on your screen to give spatial context to heyclicky It’s live. check it out-

Vikrant Patankar

17,897 views • 21 days ago

I made the worlds best Clipboard for your AI Agents Its called Bluey and its a dumb pointer which you can use to give 10x better context to your agent And you can point at your screen, talk to it, and it will generate a really good annotated screenshot which you can now give to your AI Agent You can use it while designing your website You can use it while explaining something on your screen. And it understands you and you can be really vague about things like "move this" , modify the color "here" and it will understand what you are pointing at. Im loving using it and I built it for myself as I was tired of clicking screenshots all the time and attaching it to my codex or claude code sessions Now I can just point, speak or type and drag and drop it anywhere I am giving free access to it in the comments and I would love for you to try it out. Join the discord and I am sharing the download link there. By the way everything stays 100 percent local. No screenshots are shared anywhere!

I made the worlds best Clipboard for your AI Agents Its called Bluey and its a dumb pointer which you can use to give 10x better context to your agent And you can point at your screen, talk to it, and it will generate a really good annotated screenshot which you can now give to your AI Agent You can use it while designing your website You can use it while explaining something on your screen. And it understands you and you can be really vague about things like "move this" , modify the color "here" and it will understand what you are pointing at. Im loving using it and I built it for myself as I was tired of clicking screenshots all the time and attaching it to my codex or claude code sessions Now I can just point, speak or type and drag and drop it anywhere I am giving free access to it in the comments and I would love for you to try it out. Join the discord and I am sharing the download link there. By the way everything stays 100 percent local. No screenshots are shared anywhere!

Milind S

11,917 views • 1 month ago

I built the clipboard I always wanted for working with AI agents. It’s called Bluey and It’s 100% local-first. It lives under your mouse cursor. You can draw on your screen, speak to it, or type what you mean, and Bluey turns all of that into rich context for Claude Code or Codex. I’ve been using it to design websites and debug UI because I can finally say things like “move this here” or “make this section feel cleaner” while pointing at the actual screen. No more writing long explanations. No more manually describing screenshots. No more agents getting lost because they don’t know what “this” or "that" means. You can just point to it, speak or type and it will curate the best possible context for your agents Bluey captures the screenshot, annotation, transcript, app/window context, and the details your agent needs, then sends it directly into your coding session. I am giving it out for free for a while! Im building it with my buddy Omkar Satpute and we would love to hear what you think about it on Discord what context do you wish your agent could understand better?

I built the clipboard I always wanted for working with AI agents. It’s called Bluey and It’s 100% local-first. It lives under your mouse cursor. You can draw on your screen, speak to it, or type what you mean, and Bluey turns all of that into rich context for Claude Code or Codex. I’ve been using it to design websites and debug UI because I can finally say things like “move this here” or “make this section feel cleaner” while pointing at the actual screen. No more writing long explanations. No more manually describing screenshots. No more agents getting lost because they don’t know what “this” or "that" means. You can just point to it, speak or type and it will curate the best possible context for your agents Bluey captures the screenshot, annotation, transcript, app/window context, and the details your agent needs, then sends it directly into your coding session. I am giving it out for free for a while! Im building it with my buddy Omkar Satpute and we would love to hear what you think about it on Discord what context do you wish your agent could understand better?

Milind S

13,302 views • 1 month ago

Think of Model Context Protocol as a USB port for your AI. 🔌 You can plug in documentation, tools, and context directly into Copilot CLI. Scott Hanselman 🌮 shows how to set it all up. 👇

Think of Model Context Protocol as a USB port for your AI. 🔌 You can plug in documentation, tools, and context directly into Copilot CLI. Scott Hanselman 🌮 shows how to set it all up. 👇

GitHub

44,363 views • 5 months ago

is now the AI builder for everyone. The new v0 uses agentic AI to plan, research, build, and debug. It works in context, across multiple steps, and adapts as you go. If you have an idea, v0 can build it.

is now the AI builder for everyone. The new v0 uses agentic AI to plan, research, build, and debug. It works in context, across multiple steps, and adapts as you go. If you have an idea, v0 can build it.

v0

450,864 views • 11 months ago

Imagine an AI application that can type anywhere you can and use the full context of what's on your screen. This is the application we all deserve (at least if you have macOS.) Check out Omnipilot. It's an app that works with every other macOS application and uses Claude Sonet 3.5 in the background—it also supports Gemini and GPT-4o. Here is the idea: You can use the tool to ask questions about anything on your screen. Or you can use it to autocomplete the text you are typing. You don't need to copy and paste anymore or waste your time providing context to a model. It sees what you see. It works right where you are. That's pretty cool. Here are a couple of cool examples: • Use it to reply to an email • Use it in the terminal to autocomplete a command • Use it to finish a document • Use to send a message on Slack AI at the system level is bonkers. You can read a ton more on their Product Hunt launch page: Thanks to the Omnipilot team for collaborating with me on this post!

Imagine an AI application that can type anywhere you can and use the full context of what's on your screen. This is the application we all deserve (at least if you have macOS.) Check out Omnipilot. It's an app that works with every other macOS application and uses Claude Sonet 3.5 in the background—it also supports Gemini and GPT-4o. Here is the idea: You can use the tool to ask questions about anything on your screen. Or you can use it to autocomplete the text you are typing. You don't need to copy and paste anymore or waste your time providing context to a model. It sees what you see. It works right where you are. That's pretty cool. Here are a couple of cool examples: • Use it to reply to an email • Use it in the terminal to autocomplete a command • Use it to finish a document • Use to send a message on Slack AI at the system level is bonkers. You can read a ton more on their Product Hunt launch page: Thanks to the Omnipilot team for collaborating with me on this post!

Santiago

72,306 views • 1 year ago

You can run Google new Gemma 4 on mobile easily. I am using Gemma 4 version E2B on my Pixel 10 Pro. Here is all you need to do: - Go to the App Store and install Google AI Edge Gallery. If you already have it, just update it. - From there, you can install the model directly and start using it. Still exploring what this small but powerful model can do :)

You can run Google new Gemma 4 on mobile easily. I am using Gemma 4 version E2B on my Pixel 10 Pro. Here is all you need to do: - Go to the App Store and install Google AI Edge Gallery. If you already have it, just update it. - From there, you can install the model directly and start using it. Still exploring what this small but powerful model can do :)

AshutoshShrivastava

226,336 views • 3 months ago

🧍 Very cool idea So I added it to Photo AI as a T-Pose photo pack you can use to create a moving (or dancing) 3d model of yourself It auto-generates the correct T-Pose of your model immediately and then converts it into a 3D model you can download (as .fbx) and instantly import into @mixamo to rig it After rigging you can add any movement from Mixamo to move it however you want

🧍 Very cool idea So I added it to Photo AI as a T-Pose photo pack you can use to create a moving (or dancing) 3d model of yourself It auto-generates the correct T-Pose of your model immediately and then converts it into a 3D model you can download (as .fbx) and instantly import into @mixamo to rig it After rigging you can add any movement from Mixamo to move it however you want

@levelsio

139,521 views • 6 months ago

Elon Musk on Grok giving context to posts on 𝕏 "You can also ascribe anything you see on the platform. Just press the grok icon on any X post and analyze it for you and then research it as much as you want. So you can basically have just by tapping the grok icon, you can assess whether that post is the truth, the whole truth, and nothing but the truth or whether there's something supplemental you need to explain."

Elon Musk on Grok giving context to posts on 𝕏 "You can also ascribe anything you see on the platform. Just press the grok icon on any X post and analyze it for you and then research it as much as you want. So you can basically have just by tapping the grok icon, you can assess whether that post is the truth, the whole truth, and nothing but the truth or whether there's something supplemental you need to explain."

Tesla Owners Silicon Valley

19,199 views • 2 months ago

Today we're launching File Uploads (in beta)! You can now upload files to folders in Granola and Granola's AI will analyze the files as well as your meetings. This is super helpful for getting all the relevant context in one place. We're still figuring out the right interactions, so play with it and let us know what you think.

Today we're launching File Uploads (in beta)! You can now upload files to folders in Granola and Granola's AI will analyze the files as well as your meetings. This is super helpful for getting all the relevant context in one place. We're still figuring out the right interactions, so play with it and let us know what you think.

Granola

39,779 views • 1 year ago

I built a different kind of dictation app It lets you talk, take screenshots, copy text, and draw on the screen. It interweaves transcription and screenshots into a little story you can paste anywhere. I've been using it the last few weeks to give design feedback to Claude - like below, no less than 52 screenshots in a few minutes

I built a different kind of dictation app It lets you talk, take screenshots, copy text, and draw on the screen. It interweaves transcription and screenshots into a little story you can paste anywhere. I've been using it the last few weeks to give design feedback to Claude - like below, no less than 52 screenshots in a few minutes

Morten Just

23,497 views • 3 months ago

People are overlooking Google Gemini Realtime models for computer use It gave me sub 100ms latency with computer use. It has a much larger context window and is much cheaper as well Combine that with local OCR and local screen detection model based on Omniparser by Microsoft it works under 100ms action taking when combined with Cua I also put in a harness for Nous Research Hermes with it. You can access it all at your tip of your cursor. You can draw on your screen to give your agents a context And I am making it Open Source! Link in the Comments Sundar Pichai Min-Liang Tan Mojtaba Seyedhosseini

People are overlooking Google Gemini Realtime models for computer use It gave me sub 100ms latency with computer use. It has a much larger context window and is much cheaper as well Combine that with local OCR and local screen detection model based on Omniparser by Microsoft it works under 100ms action taking when combined with Cua I also put in a harness for Nous Research Hermes with it. You can access it all at your tip of your cursor. You can draw on your screen to give your agents a context And I am making it Open Source! Link in the Comments Sundar Pichai Min-Liang Tan Mojtaba Seyedhosseini

Milind S

38,013 views • 1 month ago

Introducing: Fibrous AI Tool Forget buttons. Just say it. Fibrous AI Tool lets you swap, switch networks, change swap modes and adjust slippage—just by typing. Everything’s already where you need it. But now, you can also just type it—your trade, your rules, your way.

Introducing: Fibrous AI Tool Forget buttons. Just say it. Fibrous AI Tool lets you swap, switch networks, change swap modes and adjust slippage—just by typing. Everything’s already where you need it. But now, you can also just type it—your trade, your rules, your way.

Fibrous

12,467 views • 1 year ago

🚨The world just started talking about AI Screen Context. We've been building something deeper — AirJelly can see your screen and remembers not just what you did, but who you are. No intent missed. No task overdue. 🪼Introducing AirJelly today, the world's first context-aware proactive agent, that lives on your desktop, grows with your context, and proactively get works done.

🚨The world just started talking about AI Screen Context. We've been building something deeper — AirJelly can see your screen and remembers not just what you did, but who you are. No intent missed. No task overdue. 🪼Introducing AirJelly today, the world's first context-aware proactive agent, that lives on your desktop, grows with your context, and proactively get works done.

AirJelly

1,224,912 views • 2 months ago

🤯 with OpenAI Whisper + TTS + GPT4V, you can just permanently share your screen with an AI and talk to it to get help on anything on screen. a generally intelligent assistant for your digital life. with a bit more engineering you could probably feed it extra docs and context based on the currently active tab/app.

🤯 with OpenAI Whisper + TTS + GPT4V, you can just permanently share your screen with an AI and talk to it to get help on anything on screen. a generally intelligent assistant for your digital life. with a bit more engineering you could probably feed it extra docs and context based on the currently active tab/app.

swyx

1,051,687 views • 2 years ago

every AI product made you go to it. open a tab. paste your screen. explain your context. wait for an answer. go back to what you were doing. we got tired of that loop. so we built Nino — a Windows AI companion that lives on your desktop. hold Ctrl + Alt. it already sees your screen. just ask. it can see your screen, point at stuff, interact with apps, and run background agents while you keep working. launching today.

every AI product made you go to it. open a tab. paste your screen. explain your context. wait for an answer. go back to what you were doing. we got tired of that loop. so we built Nino — a Windows AI companion that lives on your desktop. hold Ctrl + Alt. it already sees your screen. just ask. it can see your screen, point at stuff, interact with apps, and run background agents while you keep working. launching today.

Karan

189,320 views • 2 months ago

I built an AI friend called Locky. It has one goal, to help you actually build the thing you keep putting off. You can Locky directly on iMessage. Here's what it can do today:

I built an AI friend called Locky. It has one goal, to help you actually build the thing you keep putting off. You can Locky directly on iMessage. Here's what it can do today:

Farhaj Mayan

23,873 views • 2 months ago

Create apps shaped exactly around your specific needs and context. That's what Essential Apps are. You describe what you need. AI builds it. It appears on your phone's home screen, ready to use. One billion apps for one billion people. Beta starts today on Nothing Playground.

Create apps shaped exactly around your specific needs and context. That's what Essential Apps are. You describe what you need. AI builds it. It appears on your phone's home screen, ready to use. One billion apps for one billion people. Beta starts today on Nothing Playground.

Essential

2,377,030 views • 5 months ago

Do you want to blend your assets with your surfaces in @unrealengine? Look no further, with the Dash plugin, you can enable it with one click and then customize it easily with a few sliders. It has never been this easy to create amazing 3D worlds.

Do you want to blend your assets with your surfaces in @unrealengine? Look no further, with the Dash plugin, you can enable it with one click and then customize it easily with a few sliders. It has never been this easy to create amazing 3D worlds.

Polygonflow Dash

30,254 views • 1 year ago

Starting today, file upload is live in AkashChat. You can now add files to give specific context to your chats — see it in action below.

Starting today, file upload is live in AkashChat. You can now add files to give specific context to your chats — see it in action below.

Akash Network

17,042 views • 1 year ago