Загрузка видео...

Не удалось загрузить видео

На главную

Exciting update on PantheonOS: Introducing Pantheon-Notebook & Pantheon-CLI — the first fully open-source, Python-based agentic tools that go beyond Claude Code in the field of data analysis. Pantheon-CLI runs entirely on your computer or server, supports 60+ tools and 50+ databases, and can call any Python, R, or Julia...

Xiaojie_Qiu's profile picture

evo-devo

5,269 subscribers

45,652 просмотров • 1 год назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Today, we’re pushing a major update to Edison Analysis, our data analysis agent, which is tuned for scientific research and SOTA across data analysis benchmarks. In contrast to Kosmos, which runs for 6-12 hours and produces tens of thousands of lines of code, Edison Analysis runs for seconds to minutes and is best for specific, well-defined computational tasks. It is available both on our platform under the Analysis tab, and via API, and costs only one credit per run, so it is available to users on both free and paid tiers. Edison Analysis is a modified version of the data analysis agent Kosmos uses in its trajectories. Try it out! One of the most important improvements over our previous data analysis agents has been the addition of a specialized data retrieval tool. Edison Analysis can either use this tool to access data, or can pull data down directly via API. To evaluate this tool, we ranked the most commonly used public data repositories across recent papers from BioRxiv, and created a new benchmark that measures the ability of a language agent system to retrieve raw data from those sources. Edison Analysis gets 71% on this benchmark, and we’ll be working to increase this over time. You can read more about our benchmarks in the our blog post, link below. Some features worth highlighting: 1. Edison Analysis produces a report on the analysis it runs, along with a Jupyter notebook that you can download to reproduce the analysis yourself. Every figure it produces is linked back to the specific lines of code used to produce the figure, to make it easy to reproduce. 2. It works well with both Python and R. 3. One of the best uses for Edison Analysis is to use it to retrieve datasets that you can then analyze with Kosmos. We have a bunch of major improvements to Edison Analysis coming in the next few months that we’re excited to share. In the meantime, congratulations to the team, especially Ludovico Mitchener, Jon Laurent, Conor Igoe , Alex Andonian, and many more.
1:12

Today, we’re pushing a major update to Edison Analysis, our data analysis agent, which is tuned for scientific research and SOTA across data analysis benchmarks. In contrast to Kosmos, which runs for 6-12 hours and produces tens of thousands of lines of code, Edison Analysis runs for seconds to minutes and is best for specific, well-defined computational tasks. It is available both on our platform under the Analysis tab, and via API, and costs only one credit per run, so it is available to users on both free and paid tiers. Edison Analysis is a modified version of the data analysis agent Kosmos uses in its trajectories. Try it out! One of the most important improvements over our previous data analysis agents has been the addition of a specialized data retrieval tool. Edison Analysis can either use this tool to access data, or can pull data down directly via API. To evaluate this tool, we ranked the most commonly used public data repositories across recent papers from BioRxiv, and created a new benchmark that measures the ability of a language agent system to retrieve raw data from those sources. Edison Analysis gets 71% on this benchmark, and we’ll be working to increase this over time. You can read more about our benchmarks in the our blog post, link below. Some features worth highlighting: 1. Edison Analysis produces a report on the analysis it runs, along with a Jupyter notebook that you can download to reproduce the analysis yourself. Every figure it produces is linked back to the specific lines of code used to produce the figure, to make it easy to reproduce. 2. It works well with both Python and R. 3. One of the best uses for Edison Analysis is to use it to retrieve datasets that you can then analyze with Kosmos. We have a bunch of major improvements to Edison Analysis coming in the next few months that we’re excited to share. In the meantime, congratulations to the team, especially Ludovico Mitchener, Jon Laurent, Conor Igoe , Alex Andonian, and many more.

Sam Rodriques

62,003 просмотров • 9 месяцев назад

Give Claude Code a semantic filesystem 🗃️🛠️ Giving Claude Code access to the right CLI tools over your filesystem turns it into a general agent capable of automating far more knowledge work beyond code - it can do dynamic financial/legal/medical/technical/backoffice analysis over any subset of documents. With our latest release of semtools 💫, you can now manually or *agentically* create a persistent workspace over any subset of files. This gives Claude Code the ability to get blazing-fast, local semantic search over any data, while still allowing it to chain with commands like grep/cat/etc. so that it can load in dynamic context instead of naive top-k vector search. The coding agent can dynamically index data and use those indexes, instead of having to rebuild it every time. So you get the benefits of fast search along with agentic reasoning over CLI tools mentioned above. Come check it out!
0:38

Give Claude Code a semantic filesystem 🗃️🛠️ Giving Claude Code access to the right CLI tools over your filesystem turns it into a general agent capable of automating far more knowledge work beyond code - it can do dynamic financial/legal/medical/technical/backoffice analysis over any subset of documents. With our latest release of semtools 💫, you can now manually or *agentically* create a persistent workspace over any subset of files. This gives Claude Code the ability to get blazing-fast, local semantic search over any data, while still allowing it to chain with commands like grep/cat/etc. so that it can load in dynamic context instead of naive top-k vector search. The coding agent can dynamically index data and use those indexes, instead of having to rebuild it every time. So you get the benefits of fast search along with agentic reasoning over CLI tools mentioned above. Come check it out!

Jerry Liu

77,373 просмотров • 11 месяцев назад

Take any Python code and build a dynamic GUI on top of it by dragging and dropping components. Python is already the most popular language in the world. This makes it even better! The attached video is only 45 seconds. It will show you how it works. Here is the important part: You can now build an interface for your Python code without learning HTML, JavaScript, or CSS. Go to this link to try this: Remember to work smarter, not harder! Thanks to the team behind Taipy for partnering with me on this post.
0:45

Take any Python code and build a dynamic GUI on top of it by dragging and dropping components. Python is already the most popular language in the world. This makes it even better! The attached video is only 45 seconds. It will show you how it works. Here is the important part: You can now build an interface for your Python code without learning HTML, JavaScript, or CSS. Go to this link to try this: Remember to work smarter, not harder! Thanks to the team behind Taipy for partnering with me on this post.

Santiago

155,254 просмотров • 2 лет назад

By 2030, the data science field is projected to grow by 30% -- this is the tool I’d add to my learning path if I were re-skilling into data science: 𝐩𝐢𝐩 𝐢𝐧𝐬𝐭𝐚𝐥𝐥 𝐦𝐢𝐭𝐨-𝐚𝐢 It’s an open-source toolkit that adds AI to your Jupyter Notebooks, and it’s surprisingly helpful for learning by doing. Try now It lets you: • Use natural language to generate full data workflows • Upload an Excel file and watch it convert to clean Python code • Work with top models (ChatGPT, Claude, Gemini) right inside your notebook with no setup One thing I really like about Mito AI: it shows you exactly what it’s doing. (Which is super helpful for both beginners and debugging.) -The agent explains its assumptions - Every result links back to editable, transparent code That makes it a great companion if you're: • Transitioning from Excel • Exploring data automation or dashboards • Or just brushing up on how real data science pipelines work
0:35

By 2030, the data science field is projected to grow by 30% -- this is the tool I’d add to my learning path if I were re-skilling into data science: 𝐩𝐢𝐩 𝐢𝐧𝐬𝐭𝐚𝐥𝐥 𝐦𝐢𝐭𝐨-𝐚𝐢 It’s an open-source toolkit that adds AI to your Jupyter Notebooks, and it’s surprisingly helpful for learning by doing. Try now It lets you: • Use natural language to generate full data workflows • Upload an Excel file and watch it convert to clean Python code • Work with top models (ChatGPT, Claude, Gemini) right inside your notebook with no setup One thing I really like about Mito AI: it shows you exactly what it’s doing. (Which is super helpful for both beginners and debugging.) -The agent explains its assumptions - Every result links back to editable, transparent code That makes it a great companion if you're: • Transitioning from Excel • Exploring data automation or dashboards • Or just brushing up on how real data science pipelines work

Python Coding

107,495 просмотров • 11 месяцев назад

PantheonOS allows any biologist to perform complex data analyses of emerging single cell, multi-omics and spatial transcriptomics datasets end to end through AI agent and human collaboration. We are releasing six replays of use cases trajectories. Each "trajectory" is a complete end-to-end run, from prompt to analysis, to figures, and finally to report, and in fully inspectable and reproducible manner. See the six user cases in our PantheonOS Gallery: 1. 3D mouse embryo analysis: Tangram deconvolution and PyVista-based 3D visualization of E6 mouse embryo spatial transcriptomics data 2. 3D human fetal heart analysis: Spatial mapping of heart disease gene patterns using MERFISH data 3. Multi-omics spatial integration: Single cell multi-omics-to-spatial mapping with MOSCOT optimal transport 4. Gene panel design: 1000-plex immune-oncology MERFISH gene panel optimization 5. Cell segmentation benchmarking: Comparative evaluation of Cellpose-SAM, InstanSeg, StarDist, and other tools 6. Spatial disease biology: Ligand–receptor analysis of disease-associated tissue microenvironments We would love to hear how you can use PantheonOS for your research! Got an interesting agent run of your own and want to share? In the Pantheon UI, click Export Bundle (top-right of any chat) to package the full trajectory — chat history, code, figures, report — then submit it here:
0:58

PantheonOS allows any biologist to perform complex data analyses of emerging single cell, multi-omics and spatial transcriptomics datasets end to end through AI agent and human collaboration. We are releasing six replays of use cases trajectories. Each "trajectory" is a complete end-to-end run, from prompt to analysis, to figures, and finally to report, and in fully inspectable and reproducible manner. See the six user cases in our PantheonOS Gallery: 1. 3D mouse embryo analysis: Tangram deconvolution and PyVista-based 3D visualization of E6 mouse embryo spatial transcriptomics data 2. 3D human fetal heart analysis: Spatial mapping of heart disease gene patterns using MERFISH data 3. Multi-omics spatial integration: Single cell multi-omics-to-spatial mapping with MOSCOT optimal transport 4. Gene panel design: 1000-plex immune-oncology MERFISH gene panel optimization 5. Cell segmentation benchmarking: Comparative evaluation of Cellpose-SAM, InstanSeg, StarDist, and other tools 6. Spatial disease biology: Ligand–receptor analysis of disease-associated tissue microenvironments We would love to hear how you can use PantheonOS for your research! Got an interesting agent run of your own and want to share? In the Pantheon UI, click Export Bundle (top-right of any chat) to package the full trajectory — chat history, code, figures, report — then submit it here:

evo-devo

13,429 просмотров • 4 месяцев назад

New week new demo! Today I want to showcase the CLI to control the Superlogical multiplexer. The CLI is an extremely powerful tool for automation and hooking into other tools like editors, agentic coding tools, and more. And, it's super fun! Everything you can do in the GUI, you can do via the CLI. Actually, you can do more in the CLI. You can create sessions, run commands, make splits, move things around, change focus, simulate any input device (key/mouse/etc.), wait on scripts, and more. There are a couple unique parts of Rex I'm showing off here too: our streaming event system that any client can hook into (or script). And the terminal-specific API to retrieve information like a JSON object of the running process. I hope this demo lets your imagination run free of where you might slot something like this into your existing tools.
7:31

New week new demo! Today I want to showcase the CLI to control the Superlogical multiplexer. The CLI is an extremely powerful tool for automation and hooking into other tools like editors, agentic coding tools, and more. And, it's super fun! Everything you can do in the GUI, you can do via the CLI. Actually, you can do more in the CLI. You can create sessions, run commands, make splits, move things around, change focus, simulate any input device (key/mouse/etc.), wait on scripts, and more. There are a couple unique parts of Rex I'm showing off here too: our streaming event system that any client can hook into (or script). And the terminal-specific API to retrieve information like a JSON object of the running process. I hope this demo lets your imagination run free of where you might slot something like this into your existing tools.

Mitchell Hashimoto

188,696 просмотров • 1 день назад

"Claude Code is the first AI tool that can actually recreate how a data scientist thinks." Here's my new episode with Sumeet Marwaha (Head of Data at Brex) on exactly how to build an AI analyst with Claude Code. We covered: ✅ 3 queries to build a data analyst MCP ✅ How to give the analyst both data + context ✅ Exclusive Brex data on which AI tools are crushing it in startups and enterprise Some quotes from Sumeet: "I've set up dashboards many times in my career. They end up getting ignored. Claude will always read it. Claude will always ask the right questions." "You have to set up Claude Code to not just look at the data. It should be able to search Slack, find the incident, and understand why your metrics look wrong." "This tool is absolutely crushing it based on our data. It's both the startup AND enterprise coding tool of choice." 📌 Watch now:
0:46

"Claude Code is the first AI tool that can actually recreate how a data scientist thinks." Here's my new episode with Sumeet Marwaha (Head of Data at Brex) on exactly how to build an AI analyst with Claude Code. We covered: ✅ 3 queries to build a data analyst MCP ✅ How to give the analyst both data + context ✅ Exclusive Brex data on which AI tools are crushing it in startups and enterprise Some quotes from Sumeet: "I've set up dashboards many times in my career. They end up getting ignored. Claude will always read it. Claude will always ask the right questions." "You have to set up Claude Code to not just look at the data. It should be able to search Slack, find the incident, and understand why your metrics look wrong." "This tool is absolutely crushing it based on our data. It's both the startup AND enterprise coding tool of choice." 📌 Watch now:

Peter Yang

39,600 просмотров • 8 месяцев назад

Massive breakthrough here! Someone fixed every major flaw in Jupyter Notebooks. The .ipynb format is stuck in 2014. It was built for a different era - no cloud collaboration, no AI agents, no team workflows. Change one cell, and you get 50+ lines of JSON metadata in your git diff. Code reviews become a nightmare. Want to share a database connection across notebooks? Configure it separately in each one. Need comments or permissions? Too bad. Jupyter works for solo analysis but breaks for teams building production AI systems. Deepnote just open-sourced the solution (Apache 2.0 license) They've built a new notebook standard that actually fits modern workflows: ↳ Human-readable YAML - Git diffs show actual code changes, not JSON noise. Code reviews finally work. ↳ Project-based structure - Multiple notebooks share integrations, secrets, and environment settings. Configure once, use everywhere. ↳ 23 new block - SQL, interactive inputs, charts, and KPIs as first-class citizens. Build data apps, not just analytics notebooks. ↳ Multi-language support - Python and SQL in one notebook. Modern data work isn't single-language anymore. ↳ Full backward and forward compatibility: convert any Jupyter notebook to Deepnote and vice versa with one command. npx @ deepnote/convert notebook.ipynb Then open it in VS Code, Cursor, WindSurf, or Antigravity. Your existing notebooks migrate instantly. Their cloud version adds real-time collaboration with comments, permissions, and live editing. I've shared the GitHub repo link in the replies! It's 100% open-source.
0:34

Massive breakthrough here! Someone fixed every major flaw in Jupyter Notebooks. The .ipynb format is stuck in 2014. It was built for a different era - no cloud collaboration, no AI agents, no team workflows. Change one cell, and you get 50+ lines of JSON metadata in your git diff. Code reviews become a nightmare. Want to share a database connection across notebooks? Configure it separately in each one. Need comments or permissions? Too bad. Jupyter works for solo analysis but breaks for teams building production AI systems. Deepnote just open-sourced the solution (Apache 2.0 license) They've built a new notebook standard that actually fits modern workflows: ↳ Human-readable YAML - Git diffs show actual code changes, not JSON noise. Code reviews finally work. ↳ Project-based structure - Multiple notebooks share integrations, secrets, and environment settings. Configure once, use everywhere. ↳ 23 new block - SQL, interactive inputs, charts, and KPIs as first-class citizens. Build data apps, not just analytics notebooks. ↳ Multi-language support - Python and SQL in one notebook. Modern data work isn't single-language anymore. ↳ Full backward and forward compatibility: convert any Jupyter notebook to Deepnote and vice versa with one command. npx @ deepnote/convert notebook.ipynb Then open it in VS Code, Cursor, WindSurf, or Antigravity. Your existing notebooks migrate instantly. Their cloud version adds real-time collaboration with comments, permissions, and live editing. I've shared the GitHub repo link in the replies! It's 100% open-source.

Akshay 🚀

33,358 просмотров • 9 месяцев назад

New course: Gemini CLI: Code & Create with an Open-Source Agent, built with Google Cloud Tech/Gemini CLI and taught by Jack Wotherspoon. Agentic coding assistants like Gemini CLI are transforming how developers work. This short course teaches you to use Google's open-source agent to coordinate local tools and cloud services for coding and non-coding workflows. Gemini CLI works from your terminal, so it works with your local files and development tools. You can also connect it to services through MCP. Then provide high-level instructions, and it autonomously plans and executes complex workflows. Skills you'll gain: - Build website features and automate code reviews with GitHub ActionsCreate data dashboards that combine local files with cloud data sources - Use MCP servers and extensions to orchestrate workflows across GitHub, Canva, and Google Workspace - Generate social media content from multimedia files like conference recordings I particularly appreciate that Gemini CLI is open-source. You can see exactly how it works, read the prompts it uses, and understand its architecture. The community has contributed thousands of pull requests. Since Gemini 3’s release I've found Gemini CLI highly capable - this is a tool worth having in your toolbox! Whether you're prototyping applications, automating workflows, or working with multimedia content, join to learn to delegate complex tasks and build faster:
2:50

New course: Gemini CLI: Code & Create with an Open-Source Agent, built with Google Cloud Tech/Gemini CLI and taught by Jack Wotherspoon. Agentic coding assistants like Gemini CLI are transforming how developers work. This short course teaches you to use Google's open-source agent to coordinate local tools and cloud services for coding and non-coding workflows. Gemini CLI works from your terminal, so it works with your local files and development tools. You can also connect it to services through MCP. Then provide high-level instructions, and it autonomously plans and executes complex workflows. Skills you'll gain: - Build website features and automate code reviews with GitHub ActionsCreate data dashboards that combine local files with cloud data sources - Use MCP servers and extensions to orchestrate workflows across GitHub, Canva, and Google Workspace - Generate social media content from multimedia files like conference recordings I particularly appreciate that Gemini CLI is open-source. You can see exactly how it works, read the prompts it uses, and understand its architecture. The community has contributed thousands of pull requests. Since Gemini 3’s release I've found Gemini CLI highly capable - this is a tool worth having in your toolbox! Whether you're prototyping applications, automating workflows, or working with multimedia content, join to learn to delegate complex tasks and build faster:

Andrew Ng

125,385 просмотров • 7 месяцев назад

Introducing Gooseworks — AI coworkers that can do real GTM work. Over the last few months, we've been obsessed with turning AI into actual coworkers for our team. And it's working. Goose is now our most valuable teammate – it finds high-intent leads, runs outbound campaigns, coordinates with influencers, tracks SEO / AEO and a ton more. Today we're launching this publicly so everyone can create their own AI coworkers. Each coworker (or Goose) has its own computer, filesystem, mailbox, memory, and tools. Goose can work autonomously for hours, communicates over Slack, iMessage, WhatsApp or email, and gets smarter as you give it more context. It's not just a personal assistant — your whole team can talk to Goose from anywhere, and schedule it to run on autopilot. And here's the best part – we've already given Goose 100+ skills and data APIs for GTM work: – map your TAM – search people databases with natural language – find leads from X and LinkedIn posts – monitor intent signals from your ICPs – update your CRM and generate reports – find influencers and run outreach campaigns – track visibility in search and answer engines – connect to all the SaaS tools your business runs on +++ lots more. We also open-sourced every skill as a toolkit you can install directly in Claude Code. Comment "Goose" and follow and I'll send you the install link.
1:10

Introducing Gooseworks — AI coworkers that can do real GTM work. Over the last few months, we've been obsessed with turning AI into actual coworkers for our team. And it's working. Goose is now our most valuable teammate – it finds high-intent leads, runs outbound campaigns, coordinates with influencers, tracks SEO / AEO and a ton more. Today we're launching this publicly so everyone can create their own AI coworkers. Each coworker (or Goose) has its own computer, filesystem, mailbox, memory, and tools. Goose can work autonomously for hours, communicates over Slack, iMessage, WhatsApp or email, and gets smarter as you give it more context. It's not just a personal assistant — your whole team can talk to Goose from anywhere, and schedule it to run on autopilot. And here's the best part – we've already given Goose 100+ skills and data APIs for GTM work: – map your TAM – search people databases with natural language – find leads from X and LinkedIn posts – monitor intent signals from your ICPs – update your CRM and generate reports – find influencers and run outreach campaigns – track visibility in search and answer engines – connect to all the SaaS tools your business runs on +++ lots more. We also open-sourced every skill as a toolkit you can install directly in Claude Code. Comment "Goose" and follow and I'll send you the install link.

Shiv

174,493 просмотров • 5 месяцев назад

The future of writing database queries is not writing them at all! MongoDB just released their own MCP Server, and it quietly shifts how we interact with databases. It connects to AI tools like Claude, Cursor, or GitHub Copilot, and you can just talk to your database using natural language: → "What's the schema for the orders collection?" → "Find the top 10 users by purchase volume." → "Create a read-only DB user." No need to context switch. No need to memorize query syntax. No need to even leave your IDE. It works across MongoDB Atlas, Community, and Enterprise, and supports admin ops, schema exploration, indexing, and code generation, all via natural language. This way, you can focus on what actually matters: data modeling, app logic, and product experience. Link to the announcement in the next tweet. Thanks to #MongoDB team for partnering with me today!
0:44

The future of writing database queries is not writing them at all! MongoDB just released their own MCP Server, and it quietly shifts how we interact with databases. It connects to AI tools like Claude, Cursor, or GitHub Copilot, and you can just talk to your database using natural language: → "What's the schema for the orders collection?" → "Find the top 10 users by purchase volume." → "Create a read-only DB user." No need to context switch. No need to memorize query syntax. No need to even leave your IDE. It works across MongoDB Atlas, Community, and Enterprise, and supports admin ops, schema exploration, indexing, and code generation, all via natural language. This way, you can focus on what actually matters: data modeling, app logic, and product experience. Link to the announcement in the next tweet. Thanks to #MongoDB team for partnering with me today!

Akshay 🚀

32,084 просмотров • 1 год назад

How I have Claude automate anything I do on my computer just by showing it: I use the free Clips app and hit record to start recording. Then I just do the action - like navigating to Rippling and approving any unapproved time off - and I’ll often just talk out loud as I do it explaining any add’l details like I would when showing a human. The Clips app captures everything on your screen and everything you say, and transforms it into a format Claude can “see and hear”. You'll then get a link that you can easily share with Claude (or humans too). I’ll paste it to Claude and say something like, "automate this for me every day at 8:00 AM." The link has special metadata that agents like Claude can discover. It exposes APIs to see the full transcript with timestamps and grab screenshots of what was on your screen at any of those timestamps. Once it's created the routine, you can go to the Routines tab in Claude Code desktop app. This also works with the CLI, Claude Cowork, Codex etc. You’ll see your new routine there, and you can just hit Run Now to have it start running it. Video attached shows this step by step. The Clips apps is free and open source - I’ll link to it and the source code in the thread.
1:54

How I have Claude automate anything I do on my computer just by showing it: I use the free Clips app and hit record to start recording. Then I just do the action - like navigating to Rippling and approving any unapproved time off - and I’ll often just talk out loud as I do it explaining any add’l details like I would when showing a human. The Clips app captures everything on your screen and everything you say, and transforms it into a format Claude can “see and hear”. You'll then get a link that you can easily share with Claude (or humans too). I’ll paste it to Claude and say something like, "automate this for me every day at 8:00 AM." The link has special metadata that agents like Claude can discover. It exposes APIs to see the full transcript with timestamps and grab screenshots of what was on your screen at any of those timestamps. Once it's created the routine, you can go to the Routines tab in Claude Code desktop app. This also works with the CLI, Claude Cowork, Codex etc. You’ll see your new routine there, and you can just hit Run Now to have it start running it. Video attached shows this step by step. The Clips apps is free and open source - I’ll link to it and the source code in the thread.

Steve (Builder.io)

25,473 просмотров • 2 месяцев назад

is our AI project to make computing feel more human L A N D E R Here are the 4 best demo videos of the magic of DATA in action. DATA is a personalized assistant who knows and remembers every conversation you have with it accross your iPhone, Mac, iPad, Watch, Texts, Emails, and HomePods. You can talk to DATA right in your AirPods or text it just like a person. DATA can read, write, understand, speak any language, and translate between them. It can help with real work and home life tasks like research, writing, scheduling, reminders, and triage. And it's easily customizable so you can have DATA automatically do whatever you want whenever you want with just a few taps and natural language instructions - no code required. DATA can do just about anything you can do on your phone on your behalf automatically including very advanced things Siri can't, like summarizing, analyzing, and drafting replies or writing documents. It can read web pages, texts or emails you show it, or PDFs of any kind. It can do other real world tasks that require complex analysis and common sense too, like: - figure out where the nearest beach is (even when you're in Colorado) and instantly fetch the current surf report up to the current minute. - summarize and drafting replies to entire email chains - plan out entire work projects or multi-day vacations on your calendar - sketch out ideas for you in picture form or drafting Notion pages with charts and graphs. DATA can also use its own judgement to determine when to run an action or not, even if you've scheduled it, allowing you to make VERY complex automations that require many different inputs to make a decision, like for example: - only opening the blinds on your lunch break if it's sunny out and you're working from home. DATA works natively and easily with Apple HomeKit & other shortcuts. DATA can also take initiative and check in with you throughout the day by voice or text and proactively send messages to you and others on your behalf based on your personal and professional goals, current tasks, and calendar. DATA can integrate with many apps on your phone, and is compatible with multiple large AI language models. I've gotten to make a few demo videos that I think really capture how powerful DATA can be for every day life. Here they are all in one tweet. Make sure your sound is on as you watch them. 1. This is the first demo video I ever made from April 19th, 2023. It walks through all the ways you can interact with and use the DATA shortcuts. Everything from saying "Hey Siri" to tapping on custom apps on your home-screen. 2. The second demo video was made May 5 and is an example use case I made of how commands work - commands allow DATA to actually run actions on your phone like taking pictures and sending messages. This demo shows me taking a picture of an email template, and data drafting an email based on that template. It's gotten much better at realizing when it has just run a command and incorporating that information naturally into the conversation now, especially on GPT-4. 3. This third Commands video, May 12 is a walkthrough of ALL the phone functions that commands allow DATA to do: sending texts and emails, making pictures, seeing pictures, reading things, and scheduling events. Since this video we've added auto-replies to texts and emails, summarizing documents, writing documents, health app data retrieval, web surfing, scheduling alarms, making playlists, and more. 4. This last demo I made today, June 15, shows everything DATA does working in concert to generate a crazy detailed morning briefing with background music - including making a unique playlist and giving a detailed analysis of current events complete with Ski & Surf conditions near me other live information from the internet. So now that you've seen everything DATA can do, what's the coolest feature? What features should we add? What would you use DATA for first?
12:54

is our AI project to make computing feel more human L A N D E R Here are the 4 best demo videos of the magic of DATA in action. DATA is a personalized assistant who knows and remembers every conversation you have with it accross your iPhone, Mac, iPad, Watch, Texts, Emails, and HomePods. You can talk to DATA right in your AirPods or text it just like a person. DATA can read, write, understand, speak any language, and translate between them. It can help with real work and home life tasks like research, writing, scheduling, reminders, and triage. And it's easily customizable so you can have DATA automatically do whatever you want whenever you want with just a few taps and natural language instructions - no code required. DATA can do just about anything you can do on your phone on your behalf automatically including very advanced things Siri can't, like summarizing, analyzing, and drafting replies or writing documents. It can read web pages, texts or emails you show it, or PDFs of any kind. It can do other real world tasks that require complex analysis and common sense too, like: - figure out where the nearest beach is (even when you're in Colorado) and instantly fetch the current surf report up to the current minute. - summarize and drafting replies to entire email chains - plan out entire work projects or multi-day vacations on your calendar - sketch out ideas for you in picture form or drafting Notion pages with charts and graphs. DATA can also use its own judgement to determine when to run an action or not, even if you've scheduled it, allowing you to make VERY complex automations that require many different inputs to make a decision, like for example: - only opening the blinds on your lunch break if it's sunny out and you're working from home. DATA works natively and easily with Apple HomeKit & other shortcuts. DATA can also take initiative and check in with you throughout the day by voice or text and proactively send messages to you and others on your behalf based on your personal and professional goals, current tasks, and calendar. DATA can integrate with many apps on your phone, and is compatible with multiple large AI language models. I've gotten to make a few demo videos that I think really capture how powerful DATA can be for every day life. Here they are all in one tweet. Make sure your sound is on as you watch them. 1. This is the first demo video I ever made from April 19th, 2023. It walks through all the ways you can interact with and use the DATA shortcuts. Everything from saying "Hey Siri" to tapping on custom apps on your home-screen. 2. The second demo video was made May 5 and is an example use case I made of how commands work - commands allow DATA to actually run actions on your phone like taking pictures and sending messages. This demo shows me taking a picture of an email template, and data drafting an email based on that template. It's gotten much better at realizing when it has just run a command and incorporating that information naturally into the conversation now, especially on GPT-4. 3. This third Commands video, May 12 is a walkthrough of ALL the phone functions that commands allow DATA to do: sending texts and emails, making pictures, seeing pictures, reading things, and scheduling events. Since this video we've added auto-replies to texts and emails, summarizing documents, writing documents, health app data retrieval, web surfing, scheduling alarms, making playlists, and more. 4. This last demo I made today, June 15, shows everything DATA does working in concert to generate a crazy detailed morning briefing with background music - including making a unique playlist and giving a detailed analysis of current events complete with Ski & Surf conditions near me other live information from the internet. So now that you've seen everything DATA can do, what's the coolest feature? What features should we add? What would you use DATA for first?

steve

640,176 просмотров • 3 лет назад

NEW TOOL: It's a fully in-browser binary/file analysis tool with a hex editor. Features: - Hex editor and you can save the edited file - Mach-O symbols - ELF and PE basic metadata - Zip file contents - Fully client-side in-browser, so it is private and the files are never sent anywhere This is meant as a basic and quick tool to check simple metadata and do hex edits. If you need something more robust for malware analysis consider other tools like Malcore™ aka Malcore.io™ or just use a cli/native tool. Shoutout to Battle Programmer Yuu for inspiring me to use Unifont that I stole from tmp.0ut (it looks so good!) The code is all generated by Claude in Cursor and hosted on Github Pages. I don't really do any binary analysis, so if you have suggestions for improvements, let me know. (this is technically 'early access' and i haven't tested it too much)
0:29

NEW TOOL: It's a fully in-browser binary/file analysis tool with a hex editor. Features: - Hex editor and you can save the edited file - Mach-O symbols - ELF and PE basic metadata - Zip file contents - Fully client-side in-browser, so it is private and the files are never sent anywhere This is meant as a basic and quick tool to check simple metadata and do hex edits. If you need something more robust for malware analysis consider other tools like Malcore™ aka Malcore.io™ or just use a cli/native tool. Shoutout to Battle Programmer Yuu for inspiring me to use Unifont that I stole from tmp.0ut (it looks so good!) The code is all generated by Claude in Cursor and hosted on Github Pages. I don't really do any binary analysis, so if you have suggestions for improvements, let me know. (this is technically 'early access' and i haven't tested it too much)

solst/ICE of Astarte

143,621 просмотров • 1 год назад

Right now the main paradigm that we think of agents in is chatting back and forth, but the biggest use of tokens will come from agents that are just always on running in the background doing work for us, or ones triggered from a workflow. Agents will be working 24/7 in our workflows processing data, reviewing and generating documents, moving data between systems, writing code, accelerating decision making steps, and more. In Claude's new Managed Agents feature, in a couple minutes you can wire up an agent that can read contracts when they come into Box to review them, and then assign a task in Linear with the critical information from the contract. But this could have been any workflow, like reviewing documents for client onboarding, invoice processing, M&A due-diligence, data extraction pipelines, and millions of other use-cases. And integrating data across any system. This is only possible when you can have long-running agents that can complete real work in the background, accurately. Agents have the ability to execute code safely, leverage tools, access a compute sandbox, and connect across systems is clearly the architecture of the future. The industry is now making it easier and easier for enterprises to build and deploy these agents.
0:43

Right now the main paradigm that we think of agents in is chatting back and forth, but the biggest use of tokens will come from agents that are just always on running in the background doing work for us, or ones triggered from a workflow. Agents will be working 24/7 in our workflows processing data, reviewing and generating documents, moving data between systems, writing code, accelerating decision making steps, and more. In Claude's new Managed Agents feature, in a couple minutes you can wire up an agent that can read contracts when they come into Box to review them, and then assign a task in Linear with the critical information from the contract. But this could have been any workflow, like reviewing documents for client onboarding, invoice processing, M&A due-diligence, data extraction pipelines, and millions of other use-cases. And integrating data across any system. This is only possible when you can have long-running agents that can complete real work in the background, accurately. Agents have the ability to execute code safely, leverage tools, access a compute sandbox, and connect across systems is clearly the architecture of the future. The industry is now making it easier and easier for enterprises to build and deploy these agents.

Aaron Levie

17,543 просмотров • 5 месяцев назад

New short course: Collaborative Writing and Coding with OpenAI Canvas! Explore new ways to write and code with OpenAI Canvas, a user-friendly interface that allows you to brainstorm, draft, and refine text and code in collaboration with ChatGPT. In the short course, created with OpenAI, and taught by , a research lead at OpenAI, you’ll learn to use Canvas to enhance your workflows. Canvas lets you go beyond simple chat interactions. It provides a side-by-side workspace where you and ChatGPT can edit and refine text or code collaboratively. This makes brainstorming, drafting, and iterating as you write feel more natural and effective. As the first major update to ChatGPT’s visual interface since its launch in 2022, Canvas gives a new, innovative approach to collaboration with AI. For instance, after writing the first version of your code, Canvas can review it and give suggestions for improvement. It can also help with debugging by adding logging, identifying problems to fix, and writing comments. In addition, you'll also learn what it takes to train the model for an interface like Canvas. In this video-only short course, you’ll: - Learn how to ask for in-line feedback and control the iteration of your work by directly editing selected areas of your text or code from the model’s output. - Learn how to access quick automation tools in a shortcut menu that allows you to modify your writing tone and length, enhance your code, and restore previous versions of your work. - Learn how to use Canvas as a research assistant tool with an example of asking the model to reason through the screenshot of a plot to write a research report, in which you can ask questions within the created report. - Ask the model to write Python code to replicate the graph seen on a screenshot image. - Go behind the scenes of how you can create a video game, such as Space Battleship, from scratch, edit it, and display it in one self-contained HTML file. - Get a real-world application example of creating a SQL database from the image of its architecture. - Understand the model training and design processes that power Canvas! Please sign up here:
1:49

New short course: Collaborative Writing and Coding with OpenAI Canvas! Explore new ways to write and code with OpenAI Canvas, a user-friendly interface that allows you to brainstorm, draft, and refine text and code in collaboration with ChatGPT. In the short course, created with OpenAI, and taught by , a research lead at OpenAI, you’ll learn to use Canvas to enhance your workflows. Canvas lets you go beyond simple chat interactions. It provides a side-by-side workspace where you and ChatGPT can edit and refine text or code collaboratively. This makes brainstorming, drafting, and iterating as you write feel more natural and effective. As the first major update to ChatGPT’s visual interface since its launch in 2022, Canvas gives a new, innovative approach to collaboration with AI. For instance, after writing the first version of your code, Canvas can review it and give suggestions for improvement. It can also help with debugging by adding logging, identifying problems to fix, and writing comments. In addition, you'll also learn what it takes to train the model for an interface like Canvas. In this video-only short course, you’ll: - Learn how to ask for in-line feedback and control the iteration of your work by directly editing selected areas of your text or code from the model’s output. - Learn how to access quick automation tools in a shortcut menu that allows you to modify your writing tone and length, enhance your code, and restore previous versions of your work. - Learn how to use Canvas as a research assistant tool with an example of asking the model to reason through the screenshot of a plot to write a research report, in which you can ask questions within the created report. - Ask the model to write Python code to replicate the graph seen on a screenshot image. - Go behind the scenes of how you can create a video game, such as Space Battleship, from scratch, edit it, and display it in one self-contained HTML file. - Get a real-world application example of creating a SQL database from the image of its architecture. - Understand the model training and design processes that power Canvas! Please sign up here:

Andrew Ng

128,180 просмотров • 1 год назад