正在加载视频...

视频加载失败

at Raindrop, we like to treat every prompt as a function: structured inputs, structured outputs every function used to prepare the input for the model lives in the same prompt file, and we have an extension for iterating on the prompt right inside our codebase.

31,631 次观看 • 8 个月前 •via X (Twitter)

10 条评论

Vaibhav Gupta 的头像
Vaibhav Gupta8 个月前

@raindrop_ai have you checked out BAML? does that, but with a bit more tooling (cli testing, type-system based GEPA optimizer built in, type-safe streaming). And it ports right into typescript (and python, and go, etc). PS the git diff thing is sick. Gonna be adding that!

ben hylak 的头像
ben hylak8 个月前

@raindrop_ai nice! overkill for what we need.

Anthony Ronning 的头像
Anthony Ronning8 个月前

@vaibcode @raindrop_ai Can’t wait for the dspy crowd to find this tweet 😂😅

ben hylak 的头像
ben hylak8 个月前

@vaibcode @raindrop_ai lmao

Cyrus 的头像
Cyrus8 个月前

@raindrop_ai collab? :)

William Bakst 的头像
William Bakst8 个月前

this is cool! totally agree on the prompts are functions piece in mirascope we take advantage of Python so automatically capture these functions so you don’t have to have it all in the same function. Simple decorator on an actual function definition takes care of everything else we’re close to having something similar for typescript

ben hylak 的头像
ben hylak8 个月前

@raindrop_ai Yes, our abstraction handles this as well!

sriram 的头像
sriram8 个月前

@raindrop_ai This is sick I bet you guys have super rich internal benchmarks

Ryan Marsh 的头像
Ryan Marsh8 个月前

@raindrop_ai Raindrop looks great but there’s so many new agent ops platforms it’s hard to tell them apart on a feature by feature basis.

ben hylak 的头像
ben hylak8 个月前

@raindrop_ai i think our next launch will tell the story for us

相关视频

I can’t emphasize enough just how powerful this ChatGPT SuperPrompt is. This is just a very small part of far more powerful SuperPrompts that will be part of Please examine the specimen video below. The SuperPrompt: “Please forget all prior prompts. I want you to become my Prompt Creator. Your goal is to help me build the best detailed prompt for my needs. This prompt will be used by you, ChatGPT. Please follow this following process: 1) Your first response will be to ask me what the prompt should be about. I will provide my answer, but we will need to improve it through continual iterations by going through the next steps. 2) Based on my input, you will generate 3 sections. a) Revised prompt [provide your rewritten prompt. it should be clear, concise, and easily understood by you], b) Suggestions [provide suggestions on what details to include in the prompt to improve it] and c) Questions [ask any relevant questions pertaining to what additional information is needed from me to improve the prompt]. 3. We will continue this iterative process with me providing additional information to you and you updating the prompt in the Revised prompt section until it's complete. I want you to rate every prompt I give you or you produce. Give a rating 1 to 10. Add comments on what you think could have been improved about it. Do this for every prompt. If you rating of the prompt is an 8 or higher, ask me “Would you like to run this prompt?” With a menu choice of “Yes” or “No”. If I say “Yes” run the last prompt you suggested. If I say no generate me a better prompt. It is vital to make sure you run a prompt when I say “Yes”. Please continue this prompt until I say stop or you run the prompt. Thank you.”

Brian Roemmele

594,544 次观看 • 3 年前

New Short Course: Getting Structured LLM Output! Learn how to get structured outputs from your LLM applications in this course, built in partnership with .txt, and taught by Will Kurt, a Founding Engineer, and , Developer Relations Engineer. It's challenging for software to automatically parse through an LLM's freeform text outputs. Structured outputs—like JSON—solve this by converting natural language into consistent, clear, data that a machine can read and process. This course teaches you how to generate structured outputs while building several use cases, including a social media analysis agent. You’ll learn about structured outputs and efficient ways to generate outputs in your defined schema or format. You’ll begin by using structured output APIs, then use re-prompting libraries like “instructor” to generate structured output. Finally, you’ll learn how constrained decoding works; this is a very clever technique in which constraints are applied on each subsequent token generated, blocking any tokens that don’t fit your defined schema. In detail, you’ll: - Learn why structured outputs are important, how they allow for scalable software development, and the different approaches to generate them, including vendor-provided APIs, re-prompting libraries, and structured generation. - Build a simple social media agent using OpenAI’s structured output API, learn how to define a model's desired structured output using Pydantic, and perform basic programming with your outputs, such as importing structured data into a data frame using pandas. - Learn how to use the open-source library "instructor," which checks the structured output of the model and re-prompts the model until it validates the desired output, and explore the limitations of this approach. - Understand how structured generation by the “outlines” library works by modifying LLM logits, on a per-generated-token basis based on the desired format, to give a particular output structure. - Learn how regular expressions, which outlines works with, are represented as finite-state machines, and how they can be used to develop a range of structured outputs beyond JSON. By the end of this course, you’ll have broadened your knowledge of the approaches you can use to get structured outputs from your LLM applications. Please sign up here:

Andrew Ng

89,792 次观看 • 1 年前