Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Anyone need some good news? Pydantic validating streamed structured responses on the fly from OpenAI. (using pre-release Pydantic v2.10). There's something cooking in the Pydantic kitchen...

Samuel Colvin

20,702 subscribers

52,971 views • 1 year ago •via X (Twitter)

Science & Technology Education

Anya Rossi• Live Now

Private livecam show

10 Comments

Samuel Colvin1 year ago

This is made possible by the new "allow partial" functionality added in @pydantic v2.10.

Jonas Vetterle1 year ago

@pydantic @OpenAI llms and pydantic are like that chaotic friend and their super organised roommate 😂 a match made in heaven

TadasG | topyappers.com1 year ago

@pydantic @OpenAI please please add other LLMs as well. From my personal experience @LeadsOnTrees Gemini is a lot better for parsing unstructured text into Pydantic models <3

Samuel Colvin1 year ago

@pydantic @OpenAI @LeadsOnTrees Gemini is already supported, although their JSON Schema support is much less sophisticated than @OpenAI.

William Bakst1 year ago

@pydantic @OpenAI @jxnlco i feel like instructor and mirascope have had this functionality for quite a while now @samuel_colvin I’m curious to see what’s different here any timeline? guessing this will be the `pydantic-ai` package?

Daniel Micallef1 year ago

@pydantic @OpenAI Is the example open-sourced?

Samuel Colvin1 year ago

@pydantic @OpenAI Not yet, will be soon.

Teknium (e/λ)1 year ago

@pydantic @OpenAI Why’s it so slow

Snehasish Barman1 year ago

@pydantic @OpenAI Awesome work. Now I can remove some external dependencies.

Omar MHAIMDAT1 year ago

@pydantic @OpenAI What are you guys cooking 🧑‍🍳?

Related Videos

Transforming Invoice Data into JSON: Local LLM with LlamaIndex & Pydantic 🚀 Complete video: Code: I explain how to get structured JSON output with LlamaIndex and dynamic Pydantic class. This helps to implement the use case of data extraction from invoice documents. The solution runs on the local machine, thanks to Ollama. I'm using a MacBook Air M1 with 8GB RAM. LlamaIndex 🦙 Pydantic ollama #Python #LLM #RAG

Transforming Invoice Data into JSON: Local LLM with LlamaIndex & Pydantic 🚀 Complete video: Code: I explain how to get structured JSON output with LlamaIndex and dynamic Pydantic class. This helps to implement the use case of data extraction from invoice documents. The solution runs on the local machine, thanks to Ollama. I'm using a MacBook Air M1 with 8GB RAM. LlamaIndex 🦙 Pydantic ollama #Python #LLM #RAG

Andrej Baranovskij

147,988 views • 2 years ago

BREAKING NEWS CCTV footage allegedly shows a housemaid in Umoja ur!nating into a cooking pot, adding water, and then using the mixture to prepare food in the kitchen. The boss has since reported this to the police and the girl from western Kenya is in custody

BREAKING NEWS CCTV footage allegedly shows a housemaid in Umoja ur!nating into a cooking pot, adding water, and then using the mixture to prepare food in the kitchen. The boss has since reported this to the police and the girl from western Kenya is in custody

Evan wa Memba

96,534 views • 1 month ago

Hey guys I somehow got the sprite done by christmas, so yeah good news ya'll gonna get christmas weekly bf in the first release, merry christmas or something (oh yeah there's also sick poses)

Hey guys I somehow got the sprite done by christmas, so yeah good news ya'll gonna get christmas weekly bf in the first release, merry christmas or something (oh yeah there's also sick poses)

Derp Drawz

12,638 views • 8 months ago

New Short Course: Getting Structured LLM Output! Learn how to get structured outputs from your LLM applications in this course, built in partnership with .txt, and taught by Will Kurt, a Founding Engineer, and , Developer Relations Engineer. It's challenging for software to automatically parse through an LLM's freeform text outputs. Structured outputs—like JSON—solve this by converting natural language into consistent, clear, data that a machine can read and process. This course teaches you how to generate structured outputs while building several use cases, including a social media analysis agent. You’ll learn about structured outputs and efficient ways to generate outputs in your defined schema or format. You’ll begin by using structured output APIs, then use re-prompting libraries like “instructor” to generate structured output. Finally, you’ll learn how constrained decoding works; this is a very clever technique in which constraints are applied on each subsequent token generated, blocking any tokens that don’t fit your defined schema. In detail, you’ll: - Learn why structured outputs are important, how they allow for scalable software development, and the different approaches to generate them, including vendor-provided APIs, re-prompting libraries, and structured generation. - Build a simple social media agent using OpenAI’s structured output API, learn how to define a model's desired structured output using Pydantic, and perform basic programming with your outputs, such as importing structured data into a data frame using pandas. - Learn how to use the open-source library "instructor," which checks the structured output of the model and re-prompts the model until it validates the desired output, and explore the limitations of this approach. - Understand how structured generation by the “outlines” library works by modifying LLM logits, on a per-generated-token basis based on the desired format, to give a particular output structure. - Learn how regular expressions, which outlines works with, are represented as finite-state machines, and how they can be used to develop a range of structured outputs beyond JSON. By the end of this course, you’ll have broadened your knowledge of the approaches you can use to get structured outputs from your LLM applications. Please sign up here:

New Short Course: Getting Structured LLM Output! Learn how to get structured outputs from your LLM applications in this course, built in partnership with .txt, and taught by Will Kurt, a Founding Engineer, and , Developer Relations Engineer. It's challenging for software to automatically parse through an LLM's freeform text outputs. Structured outputs—like JSON—solve this by converting natural language into consistent, clear, data that a machine can read and process. This course teaches you how to generate structured outputs while building several use cases, including a social media analysis agent. You’ll learn about structured outputs and efficient ways to generate outputs in your defined schema or format. You’ll begin by using structured output APIs, then use re-prompting libraries like “instructor” to generate structured output. Finally, you’ll learn how constrained decoding works; this is a very clever technique in which constraints are applied on each subsequent token generated, blocking any tokens that don’t fit your defined schema. In detail, you’ll: - Learn why structured outputs are important, how they allow for scalable software development, and the different approaches to generate them, including vendor-provided APIs, re-prompting libraries, and structured generation. - Build a simple social media agent using OpenAI’s structured output API, learn how to define a model's desired structured output using Pydantic, and perform basic programming with your outputs, such as importing structured data into a data frame using pandas. - Learn how to use the open-source library "instructor," which checks the structured output of the model and re-prompts the model until it validates the desired output, and explore the limitations of this approach. - Understand how structured generation by the “outlines” library works by modifying LLM logits, on a per-generated-token basis based on the desired format, to give a particular output structure. - Learn how regular expressions, which outlines works with, are represented as finite-state machines, and how they can be used to develop a range of structured outputs beyond JSON. By the end of this course, you’ll have broadened your knowledge of the approaches you can use to get structured outputs from your LLM applications. Please sign up here:

Andrew Ng

89,792 views • 1 year ago

NEWS! The 'Lateral' book is released on November 14th (Nov 19th in US). Contains 120 questions, mostly new plus some of the best from the show. Pre-order now: [UK edition interior shown.]

NEWS! The 'Lateral' book is released on November 14th (Nov 19th in US). Contains 120 questions, mostly new plus some of the best from the show. Pre-order now: [UK edition interior shown.]

Lateral with Tom Scott

18,125 views • 2 years ago

It’s nearly time for the release of Teeny Mouse and his adventures in ‘All You Need’ 🐭 So to celebrate the launch this FRIDAY I went and unleashed Teeny on some adventures in St Stevens Primary School 👧 Pre order:

It’s nearly time for the release of Teeny Mouse and his adventures in ‘All You Need’ 🐭 So to celebrate the launch this FRIDAY I went and unleashed Teeny on some adventures in St Stevens Primary School 👧 Pre order:

Katie Piper OBE

14,080 views • 3 years ago

“We are truly witnessing something unprecedented,” CBS News contributor Matt Shumer says about the rapid development of artificial intelligence. From the recent OpenAI hack to the tech solving long-unsolved math equations and creating its own video games, Shumer shares about some of the latest news in AI — and why he believes we’re currently in a period of “early singularity.”

“We are truly witnessing something unprecedented,” CBS News contributor Matt Shumer says about the rapid development of artificial intelligence. From the recent OpenAI hack to the tech solving long-unsolved math equations and creating its own video games, Shumer shares about some of the latest news in AI — and why he believes we’re currently in a period of “early singularity.”

CBS Mornings

14,820 views • 1 month ago

Joe Rogan addresses the new release of the UFO files. "What doesn't totally make sense is why now, disclosure, other than, I mean this is being cynical. The Iran war is not going very well. The American public is very upset. A lot of people don't think we should have ever been involved in that in the first place. And we need some good news." "We need something to distract us."

Joe Rogan addresses the new release of the UFO files. "What doesn't totally make sense is why now, disclosure, other than, I mean this is being cynical. The Iran war is not going very well. The American public is very upset. A lot of people don't think we should have ever been involved in that in the first place. And we need some good news." "We need something to distract us."

Resist the Mainstream

84,425 views • 4 months ago

"The New York Jets haven't made the playoff in 15 years.. Think of all the things that have happened in 15 years.. There's a bunch of good players on this Jets team and I think they could be a year away from being something of some consequence" ~ Mike Greenberg #PMSLive

"The New York Jets haven't made the playoff in 15 years.. Think of all the things that have happened in 15 years.. There's a bunch of good players on this Jets team and I think they could be a year away from being something of some consequence" ~ Mike Greenberg #PMSLive

Pat McAfee

189,849 views • 19 days ago

Families from the Lewiston, Maine community were honored ahead of the Wasabi Fenway Bowl and helped participate in some important pre-game ceremonies. Catch the full interview and recap using the link below or on NESN's YouTube page! Tom Caron |

Families from the Lewiston, Maine community were honored ahead of the Wasabi Fenway Bowl and helped participate in some important pre-game ceremonies. Catch the full interview and recap using the link below or on NESN's YouTube page! Tom Caron |

NESN

20,313 views • 2 years ago

In this video I discuss how to catch big moves with tight stops (using order flow and tick charts). I used a couple examples from trades that I took yesterday and today. There's some DOM analysis in here for anyone who loves the DOM.

In this video I discuss how to catch big moves with tight stops (using order flow and tick charts). I used a couple examples from trades that I took yesterday and today. There's some DOM analysis in here for anyone who loves the DOM.

Jester

16,234 views • 1 year ago

HUBERMAN: “Is there any evidence that the vaccine caused long term issues for people?” BHATTACHARYA: “I think it likely that there's some people who have particular immunological responses…there's also evidence that the production process for some of the vaccines involved using DNA plasmids which may persist in producing some of the products of the vaccine.” Jay Bhattacharya, MD, PhD we’ve interviewed hundreds of people who have long-term side effects from the COVID-19 shots. The answer to Andrew D. Huberman, Ph.D.’s question is, “YES.” And it’s not rare.

HUBERMAN: “Is there any evidence that the vaccine caused long term issues for people?” BHATTACHARYA: “I think it likely that there's some people who have particular immunological responses…there's also evidence that the production process for some of the vaccines involved using DNA plasmids which may persist in producing some of the products of the vaccine.” Jay Bhattacharya, MD, PhD we’ve interviewed hundreds of people who have long-term side effects from the COVID-19 shots. The answer to Andrew D. Huberman, Ph.D.’s question is, “YES.” And it’s not rare.

Children’s Health Defense

105,925 views • 1 year ago

🇺🇸JD VANCE: WE'VE ACCOMPLISHED MORE IN 8 DAYS THAN BIDEN IN 4 YEARS "There's something incredibly energetic about [Trump], but you sort of need that, actually. The the federal government has become so sprawling, the bureaucracy is so unresponsive to what the president actually wants to do that you kinda need somebody in there who's constantly on. It's all gas, no brakes." Source: Fox News, TV News Now

🇺🇸JD VANCE: WE'VE ACCOMPLISHED MORE IN 8 DAYS THAN BIDEN IN 4 YEARS "There's something incredibly energetic about [Trump], but you sort of need that, actually. The the federal government has become so sprawling, the bureaucracy is so unresponsive to what the president actually wants to do that you kinda need somebody in there who's constantly on. It's all gas, no brakes." Source: Fox News, TV News Now

Mario Nawfal

2,628,486 views • 1 year ago