Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Today we're shipping spatial context. This lets you draw directly on your screen + pass it as context to the model. AI can easily analyze screenshots. But, it has no idea where exactly you want it to look. Now you can just show it. It's very intuitive. Demo:

Farza 🇵🇰🇺🇸

127,326 subscribers

291,802 Aufrufe • vor 1 Monat •via X (Twitter)

Wissenschaft & Technologie Bildung

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

You can now draw on your screen to give spatial context to heyclicky It’s live. check it out-

You can now draw on your screen to give spatial context to heyclicky It’s live. check it out-

Vikrant Patankar

20,276 Aufrufe • vor 2 Monaten

Today we're shipping screen-aware dictation. First, we built a speedy speech-to-text (very fast, ~450ms). But, many products do this! So we went further. Now dictate using your screen as context. In Claude Code, it writes the prompt. In G-Mail, it replies in your voice. Demo:

Today we're shipping screen-aware dictation. First, we built a speedy speech-to-text (very fast, ~450ms). But, many products do this! So we went further. Now dictate using your screen as context. In Claude Code, it writes the prompt. In G-Mail, it replies in your voice. Demo:

Farza 🇵🇰🇺🇸

2,930,931 Aufrufe • vor 1 Monat

I built the clipboard I always wanted for working with AI agents. It’s called Bluey and It’s 100% local-first. It lives under your mouse cursor. You can draw on your screen, speak to it, or type what you mean, and Bluey turns all of that into rich context for Claude Code or Codex. I’ve been using it to design websites and debug UI because I can finally say things like “move this here” or “make this section feel cleaner” while pointing at the actual screen. No more writing long explanations. No more manually describing screenshots. No more agents getting lost because they don’t know what “this” or "that" means. You can just point to it, speak or type and it will curate the best possible context for your agents Bluey captures the screenshot, annotation, transcript, app/window context, and the details your agent needs, then sends it directly into your coding session. I am giving it out for free for a while! Im building it with my buddy Omkar Satpute and we would love to hear what you think about it on Discord what context do you wish your agent could understand better?

I built the clipboard I always wanted for working with AI agents. It’s called Bluey and It’s 100% local-first. It lives under your mouse cursor. You can draw on your screen, speak to it, or type what you mean, and Bluey turns all of that into rich context for Claude Code or Codex. I’ve been using it to design websites and debug UI because I can finally say things like “move this here” or “make this section feel cleaner” while pointing at the actual screen. No more writing long explanations. No more manually describing screenshots. No more agents getting lost because they don’t know what “this” or "that" means. You can just point to it, speak or type and it will curate the best possible context for your agents Bluey captures the screenshot, annotation, transcript, app/window context, and the details your agent needs, then sends it directly into your coding session. I am giving it out for free for a while! Im building it with my buddy Omkar Satpute and we would love to hear what you think about it on Discord what context do you wish your agent could understand better?

Milind S

13,342 Aufrufe • vor 2 Monaten

I made the worlds best Clipboard for your AI Agents Its called Bluey and its a dumb pointer which you can use to give 10x better context to your agent And you can point at your screen, talk to it, and it will generate a really good annotated screenshot which you can now give to your AI Agent You can use it while designing your website You can use it while explaining something on your screen. And it understands you and you can be really vague about things like "move this" , modify the color "here" and it will understand what you are pointing at. Im loving using it and I built it for myself as I was tired of clicking screenshots all the time and attaching it to my codex or claude code sessions Now I can just point, speak or type and drag and drop it anywhere I am giving free access to it in the comments and I would love for you to try it out. Join the discord and I am sharing the download link there. By the way everything stays 100 percent local. No screenshots are shared anywhere!

I made the worlds best Clipboard for your AI Agents Its called Bluey and its a dumb pointer which you can use to give 10x better context to your agent And you can point at your screen, talk to it, and it will generate a really good annotated screenshot which you can now give to your AI Agent You can use it while designing your website You can use it while explaining something on your screen. And it understands you and you can be really vague about things like "move this" , modify the color "here" and it will understand what you are pointing at. Im loving using it and I built it for myself as I was tired of clicking screenshots all the time and attaching it to my codex or claude code sessions Now I can just point, speak or type and drag and drop it anywhere I am giving free access to it in the comments and I would love for you to try it out. Join the discord and I am sharing the download link there. By the way everything stays 100 percent local. No screenshots are shared anywhere!

Milind S

12,085 Aufrufe • vor 2 Monaten

Think of Model Context Protocol as a USB port for your AI. 🔌 You can plug in documentation, tools, and context directly into Copilot CLI. Scott Hanselman 🌮 shows how to set it all up. 👇

Think of Model Context Protocol as a USB port for your AI. 🔌 You can plug in documentation, tools, and context directly into Copilot CLI. Scott Hanselman 🌮 shows how to set it all up. 👇

GitHub

44,363 Aufrufe • vor 7 Monaten

Imagine an AI application that can type anywhere you can and use the full context of what's on your screen. This is the application we all deserve (at least if you have macOS.) Check out Omnipilot. It's an app that works with every other macOS application and uses Claude Sonet 3.5 in the background—it also supports Gemini and GPT-4o. Here is the idea: You can use the tool to ask questions about anything on your screen. Or you can use it to autocomplete the text you are typing. You don't need to copy and paste anymore or waste your time providing context to a model. It sees what you see. It works right where you are. That's pretty cool. Here are a couple of cool examples: • Use it to reply to an email • Use it in the terminal to autocomplete a command • Use it to finish a document • Use to send a message on Slack AI at the system level is bonkers. You can read a ton more on their Product Hunt launch page: Thanks to the Omnipilot team for collaborating with me on this post!

Imagine an AI application that can type anywhere you can and use the full context of what's on your screen. This is the application we all deserve (at least if you have macOS.) Check out Omnipilot. It's an app that works with every other macOS application and uses Claude Sonet 3.5 in the background—it also supports Gemini and GPT-4o. Here is the idea: You can use the tool to ask questions about anything on your screen. Or you can use it to autocomplete the text you are typing. You don't need to copy and paste anymore or waste your time providing context to a model. It sees what you see. It works right where you are. That's pretty cool. Here are a couple of cool examples: • Use it to reply to an email • Use it in the terminal to autocomplete a command • Use it to finish a document • Use to send a message on Slack AI at the system level is bonkers. You can read a ton more on their Product Hunt launch page: Thanks to the Omnipilot team for collaborating with me on this post!

Santiago

72,306 Aufrufe • vor 2 Jahren

is now the AI builder for everyone. The new v0 uses agentic AI to plan, research, build, and debug. It works in context, across multiple steps, and adapts as you go. If you have an idea, v0 can build it.

is now the AI builder for everyone. The new v0 uses agentic AI to plan, research, build, and debug. It works in context, across multiple steps, and adapts as you go. If you have an idea, v0 can build it.

v0

451,275 Aufrufe • vor 1 Jahr

Elon Musk on Grok giving context to posts on 𝕏 "You can also ascribe anything you see on the platform. Just press the grok icon on any X post and analyze it for you and then research it as much as you want. So you can basically have just by tapping the grok icon, you can assess whether that post is the truth, the whole truth, and nothing but the truth or whether there's something supplemental you need to explain."

Elon Musk on Grok giving context to posts on 𝕏 "You can also ascribe anything you see on the platform. Just press the grok icon on any X post and analyze it for you and then research it as much as you want. So you can basically have just by tapping the grok icon, you can assess whether that post is the truth, the whole truth, and nothing but the truth or whether there's something supplemental you need to explain."

Tesla Owners Silicon Valley

19,217 Aufrufe • vor 3 Monaten

You can run Google new Gemma 4 on mobile easily. I am using Gemma 4 version E2B on my Pixel 10 Pro. Here is all you need to do: - Go to the App Store and install Google AI Edge Gallery. If you already have it, just update it. - From there, you can install the model directly and start using it. Still exploring what this small but powerful model can do :)

You can run Google new Gemma 4 on mobile easily. I am using Gemma 4 version E2B on my Pixel 10 Pro. Here is all you need to do: - Go to the App Store and install Google AI Edge Gallery. If you already have it, just update it. - From there, you can install the model directly and start using it. Still exploring what this small but powerful model can do :)

AshutoshShrivastava

226,599 Aufrufe • vor 4 Monaten

I built a different kind of dictation app It lets you talk, take screenshots, copy text, and draw on the screen. It interweaves transcription and screenshots into a little story you can paste anywhere. I've been using it the last few weeks to give design feedback to Claude - like below, no less than 52 screenshots in a few minutes

I built a different kind of dictation app It lets you talk, take screenshots, copy text, and draw on the screen. It interweaves transcription and screenshots into a little story you can paste anywhere. I've been using it the last few weeks to give design feedback to Claude - like below, no less than 52 screenshots in a few minutes

Morten Just

23,641 Aufrufe • vor 4 Monaten

🧍 Very cool idea So I added it to Photo AI as a T-Pose photo pack you can use to create a moving (or dancing) 3d model of yourself It auto-generates the correct T-Pose of your model immediately and then converts it into a 3D model you can download (as .fbx) and instantly import into valentina Mendez Mendez to rig it After rigging you can add any movement from Mixamo to move it however you want

🧍 Very cool idea So I added it to Photo AI as a T-Pose photo pack you can use to create a moving (or dancing) 3d model of yourself It auto-generates the correct T-Pose of your model immediately and then converts it into a 3D model you can download (as .fbx) and instantly import into valentina Mendez Mendez to rig it After rigging you can add any movement from Mixamo to move it however you want

@levelsio

140,555 Aufrufe • vor 7 Monaten

People are overlooking Google Gemini Realtime models for computer use It gave me sub 100ms latency with computer use. It has a much larger context window and is much cheaper as well Combine that with local OCR and local screen detection model based on Omniparser by Microsoft it works under 100ms action taking when combined with Cua I also put in a harness for Nous Research Hermes with it. You can access it all at your tip of your cursor. You can draw on your screen to give your agents a context And I am making it Open Source! Link in the Comments Sundar Pichai Min-Liang Tan Mojtaba Seyedhosseini

People are overlooking Google Gemini Realtime models for computer use It gave me sub 100ms latency with computer use. It has a much larger context window and is much cheaper as well Combine that with local OCR and local screen detection model based on Omniparser by Microsoft it works under 100ms action taking when combined with Cua I also put in a harness for Nous Research Hermes with it. You can access it all at your tip of your cursor. You can draw on your screen to give your agents a context And I am making it Open Source! Link in the Comments Sundar Pichai Min-Liang Tan Mojtaba Seyedhosseini

Milind S

38,361 Aufrufe • vor 3 Monaten

🚨The world just started talking about AI Screen Context. We've been building something deeper — AirJelly can see your screen and remembers not just what you did, but who you are. No intent missed. No task overdue. 🪼Introducing AirJelly today, the world's first context-aware proactive agent, that lives on your desktop, grows with your context, and proactively get works done.

🚨The world just started talking about AI Screen Context. We've been building something deeper — AirJelly can see your screen and remembers not just what you did, but who you are. No intent missed. No task overdue. 🪼Introducing AirJelly today, the world's first context-aware proactive agent, that lives on your desktop, grows with your context, and proactively get works done.

AirJelly

1,228,416 Aufrufe • vor 4 Monaten

🤯 with OpenAI Whisper + TTS + GPT4V, you can just permanently share your screen with an AI and talk to it to get help on anything on screen. a generally intelligent assistant for your digital life. with a bit more engineering you could probably feed it extra docs and context based on the currently active tab/app.

🤯 with OpenAI Whisper + TTS + GPT4V, you can just permanently share your screen with an AI and talk to it to get help on anything on screen. a generally intelligent assistant for your digital life. with a bit more engineering you could probably feed it extra docs and context based on the currently active tab/app.

swyx

1,051,687 Aufrufe • vor 2 Jahren

every AI product made you go to it. open a tab. paste your screen. explain your context. wait for an answer. go back to what you were doing. we got tired of that loop. so we built Nino — a Windows AI companion that lives on your desktop. hold Ctrl + Alt. it already sees your screen. just ask. it can see your screen, point at stuff, interact with apps, and run background agents while you keep working. launching today.

every AI product made you go to it. open a tab. paste your screen. explain your context. wait for an answer. go back to what you were doing. we got tired of that loop. so we built Nino — a Windows AI companion that lives on your desktop. hold Ctrl + Alt. it already sees your screen. just ask. it can see your screen, point at stuff, interact with apps, and run background agents while you keep working. launching today.

Karan

189,390 Aufrufe • vor 3 Monaten

"I don't just look at it as a cryptocurrency. I look at it as a utility token... great application in a variety of different contexts that we can mobilize very rapidly." The CEO of our Nasdaq-listed parent company, on how he sees $DAG. On the record. What context do you want to see it mobilized in first?

"I don't just look at it as a cryptocurrency. I look at it as a utility token... great application in a variety of different contexts that we can mobilize very rapidly." The CEO of our Nasdaq-listed parent company, on how he sees $DAG. On the record. What context do you want to see it mobilized in first?

Constellation²

13,436 Aufrufe • vor 1 Monat

Create apps shaped exactly around your specific needs and context. That's what Essential Apps are. You describe what you need. AI builds it. It appears on your phone's home screen, ready to use. One billion apps for one billion people. Beta starts today on Nothing Playground.

Create apps shaped exactly around your specific needs and context. That's what Essential Apps are. You describe what you need. AI builds it. It appears on your phone's home screen, ready to use. One billion apps for one billion people. Beta starts today on Nothing Playground.

Essential

2,379,940 Aufrufe • vor 6 Monaten

I built an AI friend called Locky. It has one goal, to help you actually build the thing you keep putting off. You can Locky directly on iMessage. Here's what it can do today:

I built an AI friend called Locky. It has one goal, to help you actually build the thing you keep putting off. You can Locky directly on iMessage. Here's what it can do today:

Farhaj Mayan

24,030 Aufrufe • vor 4 Monaten