Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

This is next-level smart: An open-source platform that evaluates your prompts and automatically refines them based on the results. Of course, it feels obvious after you see it: • You write a prompt • The system evaluates it across different scenarios • Based on the results, it... refines it to improve results I recorded a quick video to show you how it works. It's pretty cool stuff! Here are some of the problems and best practices for teams building AI applications: 1. Testing your prompts manually doesn't scale 2. Prompts should not be spread throughout the codebase 3. Non-technical people need easy access to your prompts 4. Prompts can always use a version history to track changes 5. Monitoring the performance of prompts overtime is critical Evaluating the prompts is what keeps me up at night from this list. Of all the conversations I've had with companies and people building AI applications, this is the area that's causing the most pain. Testing a prompt is difficult. Think about how you'd test the response of a model subjectively. What do you account for, "tone," "objectivity," "completeness," "creativity," "readability," etc.? Last week, I met the developers behind Latitude, an open-source prompt engineering platform trying to solve all of these issues. You can try the platform in two ways: • You can self-host the platform. Free and open-source. • If you want to try their online product, their free tier is huge. Here is the link: Thanks to the Latitude team for collaborating with me on this post, and congratulations on going live with their product!show more

Santiago

455,709 subscribers

64,178 Aufrufe • vor 2 Jahren •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

12 Kommentare

Profilbild von jnaapti

jnaaptivor 2 Jahren

@joecole Check out DSPy too: It has a very novel idea for prompt optimization.

Profilbild von Michel David

Michel Davidvor 2 Jahren

Worth checking out!

Profilbild von Mark R Pommrehn

Mark R Pommrehnvor 2 Jahren

Wow! Thanks! Going to try this!

Profilbild von implode99

implode99vor 2 Jahren

good post. I have always been stumped how to get to the creators web site from Product Hunt..

Profilbild von Waqas Ahmed

Waqas Ahmedvor 2 Jahren

I remember it as BI as Code platform; seems like they pivoted.

Profilbild von Jeffrey 🐬 confident-ai.com

Jeffrey 🐬 confident-ai.comvor 2 Jahren

Checkout deepeval for a more fine grained approach:

Profilbild von Gautam Rajhans

Gautam Rajhansvor 2 Jahren

Now prompt engineers lost their jobs too

Profilbild von Sebastian G

Sebastian Gvor 2 Jahren

@memdotai #prompt evaluation and storage platform

Profilbild von Michael Neuer

Michael Neuervor 2 Jahren

Nice short summary "Latitude is the open-source prompt engineering platform to ship LLM features with confidence." - I will look into it.

Profilbild von James

Jamesvor 2 Jahren

I get really annoyed everytime I see a post from this guy. EVERYONE I HAVE TO BOOKMARK. I don't have enough time to review and learn his great content. Very annoying..

Profilbild von Cleis

Cleisvor 2 Jahren

Any data on their ability to maintain the output quality of a specific prompt? Isn’t the core issue that the exact same prompt can yield different outputs over time?

Profilbild von Spicey

Spiceyvor 2 Jahren

Lol

Ähnliche Videos

Tune Studio is an end-to-end platform for developing applications using Large Language Models. So far, I haven't seen any other platform like this one. You can do everything here: 1. You can curate your data. 2. Use the playground to play with different models and try your ideas. 3. Fine-tune an open-source model on your data. 4. Deploy the model when you are done. This is awesome for anyone building generative AI applications. You can use Tune Studio to work with any of the open-source models out there. They were one of the few companies to host Llama 2 and Llama 3 before anyone else. Here is a link to check it out: One of their main selling points is that Tune Studio scales! You don't have to worry about serving your model to lots of users. They also have built-in user management, authentication, on-prem support, user context management, and pretty much everything you need to build generative AI applications. Thanks to the Tune team for collaborating with me on this post. We are living through the best years of development tools for AI developers. The field is unstoppable.

Tune Studio is an end-to-end platform for developing applications using Large Language Models. So far, I haven't seen any other platform like this one. You can do everything here: 1. You can curate your data. 2. Use the playground to play with different models and try your ideas. 3. Fine-tune an open-source model on your data. 4. Deploy the model when you are done. This is awesome for anyone building generative AI applications. You can use Tune Studio to work with any of the open-source models out there. They were one of the few companies to host Llama 2 and Llama 3 before anyone else. Here is a link to check it out: One of their main selling points is that Tune Studio scales! You don't have to worry about serving your model to lots of users. They also have built-in user management, authentication, on-prem support, user context management, and pretty much everything you need to build generative AI applications. Thanks to the Tune team for collaborating with me on this post. We are living through the best years of development tools for AI developers. The field is unstoppable.

Santiago

39,101 Aufrufe • vor 2 Jahren

Shipped the next version of ✨ 1. You can finally sign up and create projects. 2. Projects are to group prompts you want to monitor for your brand or product visibility across LLMs. 3. You can upgrade to get access to more prompts and models. I know it is not perfect. I know there will be a lot of issues. And it lacks a lot of features. Working on it! LLMConsole will become the best marketing platform for LLMs 😘

Dmytro Krasun

14,405 Aufrufe • vor 1 Jahr

Season 1 of Prompt 2 Earn is NOW LIVE! 🤖 You can now start using the Dongo AI platform to earn $DONGO rewards at the end of the season. Here’s how it works: 🔹 Do daily research 🔹 Use unique prompts 🔹 Get rewarded with $DONGO tokens at the end of the season Remember, only unique prompts will be recognized by our thorough AI point system. This system is designed to detect and reward creativity, ensuring fairness and encouraging innovative use of our platform. Why participate? It's simple: we want you to explore the platform, demonstrate the power of research + AI, and help us gather valuable data to improve our models. Get started now and make the most of your creativity. The more unique and creative your prompts, the more you earn! 🚀 🔗

Season 1 of Prompt 2 Earn is NOW LIVE! 🤖 You can now start using the Dongo AI platform to earn $DONGO rewards at the end of the season. Here’s how it works: 🔹 Do daily research 🔹 Use unique prompts 🔹 Get rewarded with $DONGO tokens at the end of the season Remember, only unique prompts will be recognized by our thorough AI point system. This system is designed to detect and reward creativity, ensuring fairness and encouraging innovative use of our platform. Why participate? It's simple: we want you to explore the platform, demonstrate the power of research + AI, and help us gather valuable data to improve our models. Get started now and make the most of your creativity. The more unique and creative your prompts, the more you earn! 🚀 🔗

Dongo AI

17,392 Aufrufe • vor 2 Jahren

SO MANY people asked me for PROMPTs to use with the motion graphics SKILL that they bought I will share those prompts and ALL the ways you can create the BEST videos you can, just like this one Let me know if you want it for FREE Reply with "prompt" and I will DM you the link

SO MANY people asked me for PROMPTs to use with the motion graphics SKILL that they bought I will share those prompts and ALL the ways you can create the BEST videos you can, just like this one Let me know if you want it for FREE Reply with "prompt" and I will DM you the link

Chain

45,593 Aufrufe • vor 23 Tagen

Building with AI gets easier every day. Here is an open-source library that makes integrating AI into an application extremely easy: Star the repository! This library alone can make React the best front-end framework out there! There are a bunch of cool things I like about CopilotKit. Here are 3 of them: 1. It allows you to take any -powered agent and bring it into your application. (This is a brand-new feature!) 2. You can build an AI-powered chatbot in your application. The chatbot will have access to your context and can act on the application. 3. You can build a RAG workflow to process and answer questions from a real-time knowledge base. I recorded a video to show you how simple it is to make some of this happen. A few lines of code, and you are in business. Here is a link to the sample application: CopilotKit is open-source. You can self-host it. You can use it with any LLM. Thanks to the team for showing me their tool and collaborating with me on this post!

Santiago

108,884 Aufrufe • vor 2 Jahren

New short course: DSPy: Build and Optimize Agentic Apps DSPy is a powerful open-source framework for automatically tuning prompts for GenAI applications. In this course, you'll learn to use DSPy, together with MLflow. This is built in partnership with Databricks and taught by Chen Qian, co-lead of the DSPy framework. Many AI builders spend hours hand-tuning prompts. When given a set of evals, DSPy automates this process. It’s especially useful for optimizing prompts, including few-shot prompts, in complex agentic AI workflows. Further, if you switch an application to a newer LLM, performance can degrade if your prompts were optimized to the previous model. DSPy automatically optimizes the entire system for the new LLM as well, using just a few evaluation examples. This course teaches DSPy works, and best practices for using it. You’ll write programs using DSPy’s signature-based programming model, debug them with MLflow tracing -- to gain visibility into how different parts of a pipeline, as well as how the overall system, are performing -- and automatically improve their accuracy with DSPy Optimizer. Please sign up here:

New short course: DSPy: Build and Optimize Agentic Apps DSPy is a powerful open-source framework for automatically tuning prompts for GenAI applications. In this course, you'll learn to use DSPy, together with MLflow. This is built in partnership with Databricks and taught by Chen Qian, co-lead of the DSPy framework. Many AI builders spend hours hand-tuning prompts. When given a set of evals, DSPy automates this process. It’s especially useful for optimizing prompts, including few-shot prompts, in complex agentic AI workflows. Further, if you switch an application to a newer LLM, performance can degrade if your prompts were optimized to the previous model. DSPy automatically optimizes the entire system for the new LLM as well, using just a few evaluation examples. This course teaches DSPy works, and best practices for using it. You’ll write programs using DSPy’s signature-based programming model, debug them with MLflow tracing -- to gain visibility into how different parts of a pipeline, as well as how the overall system, are performing -- and automatically improve their accuracy with DSPy Optimizer. Please sign up here:

Andrew Ng

182,119 Aufrufe • vor 1 Jahr

This is how you can get programmatic access to any website. You need two things: 1. The URL of the website 2. A prompt specifying what you want to do on the site Mino is a neat platform that uses browser automation and AI-powered navigation to understand your prompt, open the website, and extract the information you want. This opens the doors to unlimited potential automations you could build using data from everyday websites that don't give you an API. Mino uses AI to go way further than you could get by using a regular web scraping tool: • It can handle dynamic JavaScript content • It can handle login walls • It can navigate through interactive booking flows • It adapts to different interfaces and layout changes • It can fill out forms automatically • It supports stealth browser mode In my experience, running Mino on relatively straightforward sites takes about 30-60 seconds to complete. The more times you run it, the faster it gets. I recorded a quick video to show you the platform. You can check their site here: Thanks to the team for the support, onboarding me on their platform, and the collaboration on this post.

This is how you can get programmatic access to any website. You need two things: 1. The URL of the website 2. A prompt specifying what you want to do on the site Mino is a neat platform that uses browser automation and AI-powered navigation to understand your prompt, open the website, and extract the information you want. This opens the doors to unlimited potential automations you could build using data from everyday websites that don't give you an API. Mino uses AI to go way further than you could get by using a regular web scraping tool: • It can handle dynamic JavaScript content • It can handle login walls • It can navigate through interactive booking flows • It adapts to different interfaces and layout changes • It can fill out forms automatically • It supports stealth browser mode In my experience, running Mino on relatively straightforward sites takes about 30-60 seconds to complete. The more times you run it, the faster it gets. I recorded a quick video to show you the platform. You can check their site here: Thanks to the team for the support, onboarding me on their platform, and the collaboration on this post.

Santiago

31,789 Aufrufe • vor 10 Monaten

Web scraping is a critical skill, and yet nobody talks about it. How do you think companies are training their Large Language Models? Where do you think the data comes from? But web scraping goes beyond all of that. Imagine giving an AI agent access to any public online data in real time! I like to call this "web-scrapping on demand", and I'm pretty sure it's going to unlock unlimited power for AI applications. I recorded a quick video to show you how you can do this using Apify. I've talked about them before, and they are collaborating with me on this post. They have one of the best open-source web scraping and browser automation libraries out there: But it gets much better than this! You can use MCP to connect your AI Agents and applications to the Apify platform and use any specialized actor on demand to scrape and process online data. In the video, I used Cursor to scrape LinkedIn posts with the words "Machine Learning" in real time. Worked like a charm with no code needed! Here is a link to the platform: Think about this: You can now feed your AI applications with any public data on demand! We aren't ready for what's coming.

Web scraping is a critical skill, and yet nobody talks about it. How do you think companies are training their Large Language Models? Where do you think the data comes from? But web scraping goes beyond all of that. Imagine giving an AI agent access to any public online data in real time! I like to call this "web-scrapping on demand", and I'm pretty sure it's going to unlock unlimited power for AI applications. I recorded a quick video to show you how you can do this using Apify. I've talked about them before, and they are collaborating with me on this post. They have one of the best open-source web scraping and browser automation libraries out there: But it gets much better than this! You can use MCP to connect your AI Agents and applications to the Apify platform and use any specialized actor on demand to scrape and process online data. In the video, I used Cursor to scrape LinkedIn posts with the words "Machine Learning" in real time. Worked like a charm with no code needed! Here is a link to the platform: Think about this: You can now feed your AI applications with any public data on demand! We aren't ready for what's coming.

Santiago

101,473 Aufrufe • vor 1 Jahr

GitHub hosts your code. Nowhere hosts your prompts. I built post what you vibecoded, with the exact prompts that made it. 1. Post your build 2. Paste the prompts you actually used 3. It's live Everyone says "I built this in one prompt". Here, you show the prompt. Rebuilt an app people pay for? Your build sits on that app's page forever. Go post yours.

GitHub hosts your code. Nowhere hosts your prompts. I built post what you vibecoded, with the exact prompts that made it. 1. Post your build 2. Paste the prompts you actually used 3. It's live Everyone says "I built this in one prompt". Here, you show the prompt. Rebuilt an app people pay for? Your build sits on that app's page forever. Go post yours.

Rob Hallam

19,349 Aufrufe • vor 2 Monaten

Great AI starts with great prompts, and Salesforce Einstein 1 Platform makes it easy to create prompts grounded in your customer data. The Einstein Trust Layer ensures your data is never stored outside of Salesforce, so these prompts are trusted. What kind of prompts will you build?

Great AI starts with great prompts, and Salesforce Einstein 1 Platform makes it easy to create prompts grounded in your customer data. The Einstein Trust Layer ensures your data is never stored outside of Salesforce, so these prompts are trusted. What kind of prompts will you build?

Marc Benioff

193,198 Aufrufe • vor 3 Jahren

Introducing Candy Machine 🍭🤖 An AI-powered vault that doesn't open with keys, it opens with prompts. To open it? You’ve got to prompt your way in. Craft the right prompt, convince the AI, and the reward is yours. Built on Aptos by Cluster Protocol Think you can outsmart AI ->

Introducing Candy Machine 🍭🤖 An AI-powered vault that doesn't open with keys, it opens with prompts. To open it? You’ve got to prompt your way in. Craft the right prompt, convince the AI, and the reward is yours. Built on Aptos by Cluster Protocol Think you can outsmart AI ->

Cluster Protocol

100,611 Aufrufe • vor 1 Jahr

For those of you tired of yet another AI-based IDE: Check out Traycer. It's a Visual Studio Code extension (free forever for anyone working on open-source repositories), and it does something different from everyone else. You write a high-level prompt outlining the changes you want to make to your codebase, and the extension generates a plan for you before you touch the code. (It reminds me of GitHub Copilot Workspaces.) You can review the plan, understand exactly the changes the extension will make to your code, and make any modifications. When you are ready, you execute the plan, and Traycer stages all of the changes so you have a new opportunity to review everything. Only then does Traycer apply the changes. This is ideal for large codebases where you'd rather study the changes the AI plans to make before they make it into your code. Look at the video I recorded to see how it works. Thanks to the Traycer team for collaborating with me on this post!

For those of you tired of yet another AI-based IDE: Check out Traycer. It's a Visual Studio Code extension (free forever for anyone working on open-source repositories), and it does something different from everyone else. You write a high-level prompt outlining the changes you want to make to your codebase, and the extension generates a plan for you before you touch the code. (It reminds me of GitHub Copilot Workspaces.) You can review the plan, understand exactly the changes the extension will make to your code, and make any modifications. When you are ready, you execute the plan, and Traycer stages all of the changes so you have a new opportunity to review everything. Only then does Traycer apply the changes. This is ideal for large codebases where you'd rather study the changes the AI plans to make before they make it into your code. Look at the video I recorded to see how it works. Thanks to the Traycer team for collaborating with me on this post!

Santiago

84,565 Aufrufe • vor 1 Jahr

Imagine an AI application that can type anywhere you can and use the full context of what's on your screen. This is the application we all deserve (at least if you have macOS.) Check out Omnipilot. It's an app that works with every other macOS application and uses Claude Sonet 3.5 in the background—it also supports Gemini and GPT-4o. Here is the idea: You can use the tool to ask questions about anything on your screen. Or you can use it to autocomplete the text you are typing. You don't need to copy and paste anymore or waste your time providing context to a model. It sees what you see. It works right where you are. That's pretty cool. Here are a couple of cool examples: • Use it to reply to an email • Use it in the terminal to autocomplete a command • Use it to finish a document • Use to send a message on Slack AI at the system level is bonkers. You can read a ton more on their Product Hunt launch page: Thanks to the Omnipilot team for collaborating with me on this post!

Imagine an AI application that can type anywhere you can and use the full context of what's on your screen. This is the application we all deserve (at least if you have macOS.) Check out Omnipilot. It's an app that works with every other macOS application and uses Claude Sonet 3.5 in the background—it also supports Gemini and GPT-4o. Here is the idea: You can use the tool to ask questions about anything on your screen. Or you can use it to autocomplete the text you are typing. You don't need to copy and paste anymore or waste your time providing context to a model. It sees what you see. It works right where you are. That's pretty cool. Here are a couple of cool examples: • Use it to reply to an email • Use it in the terminal to autocomplete a command • Use it to finish a document • Use to send a message on Slack AI at the system level is bonkers. You can read a ton more on their Product Hunt launch page: Thanks to the Omnipilot team for collaborating with me on this post!

Santiago

72,306 Aufrufe • vor 2 Jahren

What does it mean when an AI model is “open weights” and how is it different than “open source”? Welcome to the next episode of the Open Model Series with merve, Hugging Face AI/ML engineer & open-sourceress! Every week we will discuss open-source & open-weight AI: what it is, how it works, and how you can run them on your own compute. Episode 3 out next week; episode 1 linked below. Please leave all your questions about open-source & open-weight AI in the comments. This is a super important topic that is novel to most people, and it can be challenging to grasp - so your questions are shared with many others.

What does it mean when an AI model is “open weights” and how is it different than “open source”? Welcome to the next episode of the Open Model Series with merve, Hugging Face AI/ML engineer & open-sourceress! Every week we will discuss open-source & open-weight AI: what it is, how it works, and how you can run them on your own compute. Episode 3 out next week; episode 1 linked below. Please leave all your questions about open-source & open-weight AI in the comments. This is a super important topic that is novel to most people, and it can be challenging to grasp - so your questions are shared with many others.

Harper Carroll

32,624 Aufrufe • vor 2 Monaten

V1 of my prompt cheatsheet is live! Download the json file and import it into Chatbot UI to add 20+ prompts to your code workflow. I’ll be back soon with: - More complex, powerful prompts. - A system for choosing which prompts you want to use. GitHub:

V1 of my prompt cheatsheet is live! Download the json file and import it into Chatbot UI to add 20+ prompts to your code workflow. I’ll be back soon with: - More complex, powerful prompts. - A system for choosing which prompts you want to use. GitHub:

Mckay Wrigley

189,592 Aufrufe • vor 3 Jahren

The open-source & open-weight frontier is 7 months behind the closed-model frontier. Let’s talk about it. Check out last week’s episode for the reasons why you might want to consider open-source & open-weight models. Welcome to the fourth episode of the Open Model Series with merve, Hugging Face AI/ML engineer & open-sourceress! We have been discussing open-source & open-weight AI: what it is, how it works, and how you can run them on your own compute. Please leave all your questions about open-source & open-weight AI in the comments! This is a super important topic that is novel to most people, and it can be challenging to grasp - so rest assured your questions are shared with many others!

The open-source & open-weight frontier is 7 months behind the closed-model frontier. Let’s talk about it. Check out last week’s episode for the reasons why you might want to consider open-source & open-weight models. Welcome to the fourth episode of the Open Model Series with merve, Hugging Face AI/ML engineer & open-sourceress! We have been discussing open-source & open-weight AI: what it is, how it works, and how you can run them on your own compute. Please leave all your questions about open-source & open-weight AI in the comments! This is a super important topic that is novel to most people, and it can be challenging to grasp - so rest assured your questions are shared with many others!

Harper Carroll

17,279 Aufrufe • vor 2 Monaten

I've made $4.7M with AI. Today, I recorded myself building an entire OpenClaw🦞 business in an hour. You'll learn how to: • Find a winning niche using AI • Build an offer people actually want to pay for • To get your first clients • To use AI to productize and fulfill the entire service • The exact prompts I use to orchestrate all of it After building the #1 Lovable agency. This is the entire playbook behind AI native businesses. The full video is live on YouTube. Comment "Playbook" and I'll DM you the link.

I've made $4.7M with AI. Today, I recorded myself building an entire OpenClaw🦞 business in an hour. You'll learn how to: • Find a winning niche using AI • Build an offer people actually want to pay for • To get your first clients • To use AI to productize and fulfill the entire service • The exact prompts I use to orchestrate all of it After building the #1 Lovable agency. This is the entire playbook behind AI native businesses. The full video is live on YouTube. Comment "Playbook" and I'll DM you the link.

Jacob Klug

124,814 Aufrufe • vor 7 Monaten