Loading video...

Video Failed to Load

Go Home

We’re shipping Devin Search, a new tool for codebase understanding. Use Devin Search for quick questions like "how is user authentication implemented?" or turn on Deep Mode for complex asks like “draw an architecture diagram explaining our billing system”. 🧵👇

104,840 views • 1 year ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Boom! Grok Tasks Make It One Of The Most POWERFUL Real-Time AI Systems In The World. — My How to Use Grok Tasks With Hidden Tools For Powerful Daily Output. Grok Tasks are customizable AI workflows that integrate a variety of tools to streamline daily activities, from research and analysis to creative planning and problem-solving. I have been using them for quite sometime and because of the vital heartbeat of news and first person data on X, it is the most powerful AI platform available. By combining Tasks with tools like web searches, X platform interactions, code execution, and media viewers, you can build efficient, automated processes. These tasks work by prompting Grok with a clear description of what you want to achieve, and Grok will intelligently call the necessary tools in sequence or parallel to deliver results. Here's a step-by-step guide to creating and using Grok Tasks: Step 1: Define Your Task Start by clearly outlining the daily activity or goal. Consider what inputs you have (e.g., a URL, a query, or an attachment) and what output you need (e.g., a summary, calculation, or visual analysis). Break it down into subtasks to identify tool needs. For example, if your task involves researching current events, note that you'll need search and browsing capabilities. Step 2: Review Available Tools Familiarize yourself with the tools Grok can access. Here's a quick overview: - Code Execution: Run Python code for calculations, data processing, or simulations using libraries like numpy, pandas, or sympy. - Browse Page: Fetch and summarize content from any website URL with custom instructions. - Web Search: Perform general internet searches, returning results with optional operators like site:. - Web Search With Snippets: Get quick, detailed excerpts from search results for fact-checking. - X Keyword Search: Advanced search for X posts using operators like from:, since:, or filter:. - X Semantic Search: Find semantically related X posts based on a query, with filters for dates or users. - X User Search: Locate X users by name or handle. - X Thread Fetch: Retrieve a full X post thread, including context like replies and parents. - View Image: Analyze an image from a URL or conversation ID. - View X Video: Extract frames and subtitles from an X-hosted video. - Search PDF Attachment: Query a PDF file for relevant pages using keyword or regex modes. - Browse PDF Attachment: View specific pages of a PDF with text and screenshots. Select tools that align with your task. Aim for a mix to handle data gathering, processing, and visualization. Step 3: Craft Your Prompt Write a detailed prompt to Grok describing the task. Include: - The overall goal. - Specific steps or subtasks. - References to tools if you want to guide the process (e.g., "Use web_search to find sources, then code_execution to analyze data"). - Any constraints, like dates or limits. Example prompt: "Create a Grok Task for my morning routine: Search recent X posts about tech news using x_keyword_search, fetch a key thread with x_thread_fetch, and summarize with browse_page on linked articles." Step 4: Submit and Interact Send your prompt to Grok. It will process the task by calling tools as needed, often in parallel for efficiency. Review the output and refine with follow-up prompts if required (e.g., "Expand on that using view_image for visuals"). Iterate to fine-tune the workflow for reuse. Step 5: Save and Reuse Once refined, note the prompt as a template for future use. You can adapt it for similar tasks, making Grok Tasks a habitual part of your day. Finding Grok Tasks To discover existing Grok Tasks or inspiration for new ones, use X searches with tools like x_keyword_search or x_semantic_search (e.g., query: "Grok Tasks examples" with mode: Latest). Browse community-shared threads via x_thread_fetch, or web_search for tutorials on xAI features. Prompt Grok directly: "Show me popular Grok Tasks for productivity." 1 of 3

Brian Roemmele

152,242 views • 6 months ago

Agents: Quick thoughts & questions on how they operate, their potential, and their limitations A Few Observations - ▶️"Book me a hotel" or "pull historical financials" are already (mostly) solved problems!! Agents can do a ton of tasks right now—like parsing public company press releases and navigating capture key info & complete bookings accurately. However, for more complex navigation flows, the tech still needs some work - but I'm very confident it’s essentially a solved or solvable challenge. ▶️Accuracy & Speed - The key metrics and agents should optimize for. ▶️Lower Build & Migration Costs It took me two minutes to build a new website (link: This is great for consumers—more choices, lower switching costs. Companies will increasingly compete on the quality of their products and services. ▶️Agents vs. Automation tools: The more I think about it, the more I realize that most “agents” are really just automation tools—kind of like how most robots🤖 are just machines lol ❓A Few Key Questions—Would Love Your Thoughts! ❔Remote Servers & Logins In many cases, we’ll want agents to act on our behalf (e.g., log in to to cancel an order). How will platforms like respond? Many websites may block remote servers for security. Is there a technical workaround? ❔Agent Generalization Do we need to train agents on each environment separately, or can one solution handle multiple sites and systems? This seems similar to RL/post-training challenges in AI research. Example: It's unclear to me whether $Devin was specifically trained on environment? ❔Frontend vs. Backend infra for agents to run on I had doubts about Anthropic's "Computer Use" feature, which seemed to run on the frontend, basically remotely controlling my computer so I couldn’t use it at the same time. This should deliver the highest accuracy, but it’s questionable how practical it really is. (Ref: It seems def possible for agents to work quietly “in the background” (like Devin) rather than remotely controlling a user’s PC, but how much accuracy are we sacrificing? A few $Devin test cases that got me thinking: 1⃣Pulling $META's MAU and DAU (1Q21–3Q24) into Excel (video attached) Took Devin 11min - it sent me back an Excel with 100% accurate data. This case was pretty tricky because $Meta changed disclosures and stopped reporting MAU/DAU after 4Q23. Devin didn’t hallucinate data for post-4Q23—it simply didn’t provide it! It really shocked me to see $Devin navigating $Meta's investor relations site (I didn't tell it to find the numbers there), opening each quarterly earnings report, and extracting MAU/DAU like a diligent intern. -> This confirms $Devin (and similar agents) can already accurately “read” screens. 2⃣Booking Hotel (video attached) Devin took 5 minutes to book the InterContinental NYC on after asking for my credentials. From $Devin's workspace, I could see it filling in the correct fields and making the right selections—fast and accurate overall. Interestingly, $Devin didn’t supply all the required information on the first attempt and got some error messages, then retried until it succeeded. It’s unclear whether Devin had been specifically trained on interface or simply learned to adapt on the fly. 3⃣Canceling the Booking This part was even more interesting. While booking didn’t require me to log in, canceling did—so $Devin had to access my (likely via a remote server) account using my Gmail credentials. It successfully canceled the reservation. I wonder how websites will handle future “remote” logins. Notably, Google blocked $Devin’s direct attempts to log in to Gmail when I specifically requested it. 4⃣Booking from Official Hotel Sites I asked Devin to book InterContinental NYC and Four Seasons Boston via their official websites. It made progress but encountered technical hiccups when trying to select the check-in/check-out dates. Insights from Scott Wu on Invest Like the Best: 1/ Self-Driving Cars as the First “Real Agents” Driving requires near-perfect accuracy (99.999%), making it much more demanding than digital or coding agents, which can tolerate more errors. Scott compares $Devin to circa 2014—already good enough to save 90% of your effort, but still short of flawless. 2/ Impact on Collaboration Platforms Tools like Slack and GitLab are likely to see major changes as agents begin to interact with and utilize them along with humans. 2025 should be all about agents - both the disruptors and those they disrupt!

Freda Duan

48,850 views • 1 year ago