Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

We built an AI that can draw on your screen. It's a true personal tutor. Using Claude Opus we're able to draw polygons, point with pixel perfect accuracy, and walk users through complex steps directly on their screen. Here's me learning Pythagorean Theorem + FL Studio. Demo:

Farza 🇵🇰🇺🇸

126,662 subscribers

582,938 Aufrufe • vor 1 Monat •via X (Twitter)

Kunst Bildung Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Today we're shipping spatial context. This lets you draw directly on your screen + pass it as context to the model. AI can easily analyze screenshots. But, it has no idea where exactly you want it to look. Now you can just show it. It's very intuitive. Demo:

Today we're shipping spatial context. This lets you draw directly on your screen + pass it as context to the model. AI can easily analyze screenshots. But, it has no idea where exactly you want it to look. Now you can just show it. It's very intuitive. Demo:

Farza 🇵🇰🇺🇸

285,734 Aufrufe • vor 24 Tagen

this guy got tired of going back and forth with Claude Code describing what's wrong with the UI so he built a tool that lets you DRAW DIRECTLY on the screen claude renders something. if it's wrong you just circle the problem, add an arrow, write a note ai sees your annotations and fixes it way faster than describing it by text AND it's free + open source

this guy got tired of going back and forth with Claude Code describing what's wrong with the UI so he built a tool that lets you DRAW DIRECTLY on the screen claude renders something. if it's wrong you just circle the problem, add an arrow, write a note ai sees your annotations and fixes it way faster than describing it by text AND it's free + open source

Om Patel

108,733 Aufrufe • vor 4 Monaten

I just deployed a token on Abstract using only my voice, using AI agents. I built an open-source Discord bot that controls a wallet, can perform on-chain actions, and replies to users in the voice chat. Here's a demo:

I just deployed a token on Abstract using only my voice, using AI agents. I built an open-source Discord bot that controls a wallet, can perform on-chain actions, and replies to users in the voice chat. Here's a demo:

Jarrod Watts

131,616 Aufrufe • vor 1 Jahr

More people need to understand that Claude Code is a general intelligence that can do stuff on your computer. To help non-coders understand its power, I'm building Folio, an app where you share a folder with Claude and it can work on your files directly. Here's a quick demo:

More people need to understand that Claude Code is a general intelligence that can do stuff on your computer. To help non-coders understand its power, I'm building Folio, an app where you share a folder with Claude and it can work on your files directly. Here's a quick demo:

🎭

218,956 Aufrufe • vor 7 Monaten

every AI product made you go to it. open a tab. paste your screen. explain your context. wait for an answer. go back to what you were doing. we got tired of that loop. so we built Nino — a Windows AI companion that lives on your desktop. hold Ctrl + Alt. it already sees your screen. just ask. it can see your screen, point at stuff, interact with apps, and run background agents while you keep working. launching today.

every AI product made you go to it. open a tab. paste your screen. explain your context. wait for an answer. go back to what you were doing. we got tired of that loop. so we built Nino — a Windows AI companion that lives on your desktop. hold Ctrl + Alt. it already sees your screen. just ask. it can see your screen, point at stuff, interact with apps, and run background agents while you keep working. launching today.

Karan

189,390 Aufrufe • vor 2 Monaten

Pingo AI (@mypingoai) is a language learning app that helps users build fluency through real-life conversations with an AI tutor. Over 300,000 people already use Pingo to speak a new language. Congrats on the launch, @mrmukeee and @MorrietheMoosee!

Pingo AI (@mypingoai) is a language learning app that helps users build fluency through real-life conversations with an AI tutor. Over 300,000 people already use Pingo to speak a new language. Congrats on the launch, @mrmukeee and @MorrietheMoosee!

Y Combinator

23,636 Aufrufe • vor 1 Jahr

Google offers a AI-powered personal assistant that you can use for free. You can talk to it in real time, share your screen with it, and ask it to help you with any given task (sound on 👇). Surprisingly, not many people are using it. Here's how to use it:

Google offers a AI-powered personal assistant that you can use for free. You can talk to it in real time, share your screen with it, and ask it to help you with any given task (sound on 👇). Surprisingly, not many people are using it. Here's how to use it:

Mushtaq Bilal, PhD

44,549 Aufrufe • vor 1 Jahr

i'm building an AI Postgres database studio that connects to your database and generates (and runs) queries based on prompts. i initially built it to be a personal tool but i think others may find it useful. will be releasing v1 soon. here's a quick demo:

i'm building an AI Postgres database studio that connects to your database and generates (and runs) queries based on prompts. i initially built it to be a personal tool but i think others may find it useful. will be releasing v1 soon. here's a quick demo:

zilla builds cool stuff

14,323 Aufrufe • vor 8 Monaten

🚀 New Paper: Pixel Reasoner 🧠🖼️ How can Vision-Language Models (VLMs) perform chain-of-thought reasoning within the image itself? We introduce Pixel Reasoner, the first open-source framework that enables VLMs to “think in pixel space” through curiosity-driven reinforcement learning. Current VLMs reason only in text — even when grounded in rich images or videos, their logical steps are verbalized in natural language. This restricts their ability to interrogate visual evidence and demonstrate how conclusions are drawn. 🔍 So we ask: What if we could make VLMs "show their work" by reasoning directly in the pixel space? Inspired by GPT-o3’s "think-in-image" ability, we propose a framework where VLMs use interactive visual operations — zoom, select-frame, highlight — to reason through complex visual inputs. To do this, we design a two-stage training process: Instruction tuning with synthesized visual reasoning traces. Reinforcement learning with curiosity-driven reward to balance exploration between pixel and text reasoning ✨ With this, Pixel Reasoner achieves near-SoTA performance on many information-rich multimodal benchmarks: 📊 84% on InfographicsVQA 🧠 84% on V* benchmark 🧩 74% on TallyQA-Complex It also achieves strong accuracy of 68% on MVBench (a video benchmark). Website: Paper: Code: Demo: (coming soon)

🚀 New Paper: Pixel Reasoner 🧠🖼️ How can Vision-Language Models (VLMs) perform chain-of-thought reasoning within the image itself? We introduce Pixel Reasoner, the first open-source framework that enables VLMs to “think in pixel space” through curiosity-driven reinforcement learning. Current VLMs reason only in text — even when grounded in rich images or videos, their logical steps are verbalized in natural language. This restricts their ability to interrogate visual evidence and demonstrate how conclusions are drawn. 🔍 So we ask: What if we could make VLMs "show their work" by reasoning directly in the pixel space? Inspired by GPT-o3’s "think-in-image" ability, we propose a framework where VLMs use interactive visual operations — zoom, select-frame, highlight — to reason through complex visual inputs. To do this, we design a two-stage training process: Instruction tuning with synthesized visual reasoning traces. Reinforcement learning with curiosity-driven reward to balance exploration between pixel and text reasoning ✨ With this, Pixel Reasoner achieves near-SoTA performance on many information-rich multimodal benchmarks: 📊 84% on InfographicsVQA 🧠 84% on V* benchmark 🧩 74% on TallyQA-Complex It also achieves strong accuracy of 68% on MVBench (a video benchmark). Website: Paper: Code: Demo: (coming soon)

Wenhu Chen

82,829 Aufrufe • vor 1 Jahr

.signüll says his new company is building "Facebook News Feed 2.0": a highly personalized feed powered by 22 AI agents that lives on your home screen: "We basically ask you to install two widgets — a medium widget and a large widget that encapsulates the entire home screen. And those work together." "The medium widget...shows you precisely what you might need to know at this point in time. And the big widget, what we call a For You widget, which is just a feed." "We're building the new iteration of the Facebook News Feed that's entirely AI-generated about your life. Highly personal, and that lives directly on your home screen. You can browse it as easily [as the feed]...We have 22 agents that work to generate content continuously for that feed."

.signüll says his new company is building "Facebook News Feed 2.0": a highly personalized feed powered by 22 AI agents that lives on your home screen: "We basically ask you to install two widgets — a medium widget and a large widget that encapsulates the entire home screen. And those work together." "The medium widget...shows you precisely what you might need to know at this point in time. And the big widget, what we call a For You widget, which is just a feed." "We're building the new iteration of the Facebook News Feed that's entirely AI-generated about your life. Highly personal, and that lives directly on your home screen. You can browse it as easily [as the feed]...We have 22 agents that work to generate content continuously for that feed."

TBPN

59,290 Aufrufe • vor 3 Monaten

I built this thing called Clicky. It's an AI teacher that lives as a buddy next to your cursor. It can see your screen, talk to you, and even point at stuff, kinda like having a real teacher next to you. I've been using it the past few days to learn Davinci Resolve, 10/10.

I built this thing called Clicky. It's an AI teacher that lives as a buddy next to your cursor. It can see your screen, talk to you, and even point at stuff, kinda like having a real teacher next to you. I've been using it the past few days to learn Davinci Resolve, 10/10.

Farza 🇵🇰🇺🇸

2,981,955 Aufrufe • vor 3 Monaten

I built a different kind of dictation app It lets you talk, take screenshots, copy text, and draw on the screen. It interweaves transcription and screenshots into a little story you can paste anywhere. I've been using it the last few weeks to give design feedback to Claude - like below, no less than 52 screenshots in a few minutes

I built a different kind of dictation app It lets you talk, take screenshots, copy text, and draw on the screen. It interweaves transcription and screenshots into a little story you can paste anywhere. I've been using it the last few weeks to give design feedback to Claude - like below, no less than 52 screenshots in a few minutes

Morten Just

23,501 Aufrufe • vor 3 Monaten

i built an ai agent that does marketing for me on autopilot! 🤯 it searches reddit for relevant posts, provides a valuable response to the users & promotes my product in a subtle and natural way. i'm using claude 3.5 sonnet, it's so good i can't actually believe it haha

i built an ai agent that does marketing for me on autopilot! 🤯 it searches reddit for relevant posts, provides a valuable response to the users & promotes my product in a subtle and natural way. i'm using claude 3.5 sonnet, it's so good i can't actually believe it haha

Fekri

779,863 Aufrufe • vor 2 Jahren

🚨BREAKING: Someone just built the open source Loom killer that turns your screen recordings into AI agents. It's called Bloom and it does something Loom never could. Your recordings don't just sit as files. They become queryable, searchable, agent-ready data the moment you stop recording. Here's what actually happens: You hit record. Bloom captures your screen, mic, and system audio locally. While you're still recording, it uploads chunks to the cloud in real time. The second you stop, it auto-generates a full transcript, creates visual embeddings, and indexes every spoken word. Then the wild part kicks in. You can query your recordings through APIs. You can hook Claude Code directly into your video library and ask it questions. Your screen recording just became a knowledge base. → Local-first, your files never get locked in → Cmd+Shift+R starts and stops from anywhere on your system → One-click shareable link for any recording → Chat directly with your video content through VideoDB Chat → Works with Claude Code and other agent frameworks out of the box Recordings are no longer files. They're inputs for AI. MIT License. 100% Opensource. Link in comments.

🚨BREAKING: Someone just built the open source Loom killer that turns your screen recordings into AI agents. It's called Bloom and it does something Loom never could. Your recordings don't just sit as files. They become queryable, searchable, agent-ready data the moment you stop recording. Here's what actually happens: You hit record. Bloom captures your screen, mic, and system audio locally. While you're still recording, it uploads chunks to the cloud in real time. The second you stop, it auto-generates a full transcript, creates visual embeddings, and indexes every spoken word. Then the wild part kicks in. You can query your recordings through APIs. You can hook Claude Code directly into your video library and ask it questions. Your screen recording just became a knowledge base. → Local-first, your files never get locked in → Cmd+Shift+R starts and stops from anywhere on your system → One-click shareable link for any recording → Chat directly with your video content through VideoDB Chat → Works with Claude Code and other agent frameworks out of the box Recordings are no longer files. They're inputs for AI. MIT License. 100% Opensource. Link in comments.

Rimsha Bhardwaj

128,583 Aufrufe • vor 3 Monaten

Anthropic's Claude Opus 5 can reason through legal work where the answer depends on the substance of each document, who received it, when it was created, and how it relates to the rest of the production set. In this Box Agent demo, Opus 5 reviews 14 documents against a privilege protocol and discovery requests, catches a possible waiver, separates a privileged email from its producible attachment, identifies one sentence that should be redacted, and saves a cited review and draft privilege log back to Box for supervising counsel. Customers can use Claude Opus 5 in Box AI Studio to build custom agents for their own document-heavy legal workflows.

Anthropic's Claude Opus 5 can reason through legal work where the answer depends on the substance of each document, who received it, when it was created, and how it relates to the rest of the production set. In this Box Agent demo, Opus 5 reviews 14 documents against a privilege protocol and discovery requests, catches a possible waiver, separates a privileged email from its producible attachment, identifies one sentence that should be redacted, and saves a cited review and draft privilege log back to Box for supervising counsel. Customers can use Claude Opus 5 in Box AI Studio to build custom agents for their own document-heavy legal workflows.

Box

1,692,567 Aufrufe • vor 8 Tagen

We just open-sourced Simulang, a JavaScript library that gives you and your coding agents the ability to fully control computers. Simulang is our scripting framework for desktop automation. It allows you to write deterministic computer use code that can be replayed dozens if not hundreds of times. Much faster and cheaper, compared to LLM agents. It ships with a skill out of the box. That means you can turn natural language prompts into Simulang code directly, and your agent can now see the screen, click, type, and navigate. It gives your AI agents eyes and hands to control the computer like humans do. Try these things with Simulang: - upload your pile of invoices to the expense platform - find 50 people with specific criteria on LinkedIn - open your calculator app and do some math - find all buttons on your favorite app using accessibility tree - or draw a bunny with MS paint 🐰 In this demo, we show how Simulang took over when the coding agent couldn’t open and click on the target LinkedIn profile page. Give it a try:

Simular

14,421 Aufrufe • vor 2 Monaten

oh to be posted on an ig story by your long time friend with a caption supporting whatever the helly relationship you’ve got going on with your on screen, unfixed partner.. we need diana back on kao’s yt channel for that updated q and a me thinks

oh to be posted on an ig story by your long time friend with a caption supporting whatever the helly relationship you’ve got going on with your on screen, unfixed partner.. we need diana back on kao’s yt channel for that updated q and a me thinks

chris 🐾

21,397 Aufrufe • vor 3 Monaten

I built the clipboard I always wanted for working with AI agents. It’s called Bluey and It’s 100% local-first. It lives under your mouse cursor. You can draw on your screen, speak to it, or type what you mean, and Bluey turns all of that into rich context for Claude Code or Codex. I’ve been using it to design websites and debug UI because I can finally say things like “move this here” or “make this section feel cleaner” while pointing at the actual screen. No more writing long explanations. No more manually describing screenshots. No more agents getting lost because they don’t know what “this” or "that" means. You can just point to it, speak or type and it will curate the best possible context for your agents Bluey captures the screenshot, annotation, transcript, app/window context, and the details your agent needs, then sends it directly into your coding session. I am giving it out for free for a while! Im building it with my buddy Omkar Satpute and we would love to hear what you think about it on Discord what context do you wish your agent could understand better?

I built the clipboard I always wanted for working with AI agents. It’s called Bluey and It’s 100% local-first. It lives under your mouse cursor. You can draw on your screen, speak to it, or type what you mean, and Bluey turns all of that into rich context for Claude Code or Codex. I’ve been using it to design websites and debug UI because I can finally say things like “move this here” or “make this section feel cleaner” while pointing at the actual screen. No more writing long explanations. No more manually describing screenshots. No more agents getting lost because they don’t know what “this” or "that" means. You can just point to it, speak or type and it will curate the best possible context for your agents Bluey captures the screenshot, annotation, transcript, app/window context, and the details your agent needs, then sends it directly into your coding session. I am giving it out for free for a while! Im building it with my buddy Omkar Satpute and we would love to hear what you think about it on Discord what context do you wish your agent could understand better?

Milind S

13,342 Aufrufe • vor 1 Monat

Anthropic fucking killed it (again). biggest ai product launch of the year so far. claude can now control your entire computer autonomously. anything you can do on a computer - claude can. your very own digital employee. - any app, browser, file, spreadsheet, tool claude can intelligently access and operate. - claude controls your entire screen (like a human), no connectors. this is a huge step-up in intelligence. - best part: you can text claude to do things from your phone and it'll do work on your computer! - in the last week anthropic has shipped 9 features that have built up to this: a fully automated digital human. unreal

Anthropic fucking killed it (again). biggest ai product launch of the year so far. claude can now control your entire computer autonomously. anything you can do on a computer - claude can. your very own digital employee. - any app, browser, file, spreadsheet, tool claude can intelligently access and operate. - claude controls your entire screen (like a human), no connectors. this is a huge step-up in intelligence. - best part: you can text claude to do things from your phone and it'll do work on your computer! - in the last week anthropic has shipped 9 features that have built up to this: a fully automated digital human. unreal

Ejaaz

2,036,061 Aufrufe • vor 4 Monaten