Loading video...

Video Failed to Load

Go Home

How to enable full observability and automatic analytics for your LLM-based application. It takes one library + one line of code, and you get a ton of information for free. This is a no-brainer.

svpino's profile picture

Santiago

452,842 subscribers

17,506 views • 2 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

This is literally the simplest way you can improve your LLM-based application. It takes 2 lines of code to integrate Lilypad, and you'll get full observability into everything your app is doing: • Automatic traces • Costs • Tokens consumed • Metadata On top of that, you can annotate your traces to evaluate different versions of your prompts. Here is Lilypad's GitHub Repository: This is a no-brainer. Check out the video and you'll see how cool this is.
5:14

This is literally the simplest way you can improve your LLM-based application. It takes 2 lines of code to integrate Lilypad, and you'll get full observability into everything your app is doing: • Automatic traces • Costs • Tokens consumed • Metadata On top of that, you can annotate your traces to evaluate different versions of your prompts. Here is Lilypad's GitHub Repository: This is a no-brainer. Check out the video and you'll see how cool this is.

Santiago

42,170 views • 1 year ago

When you prompt an LLM for code, you get one deterministic program. However, the LLM actually defines a distribution over many programs, and existing methods discard it‼️ PPoT uses this distribution to extract free performance and efficiency gains. 🧵👇
0:37

When you prompt an LLM for code, you get one deterministic program. However, the LLM actually defines a distribution over many programs, and existing methods discard it‼️ PPoT uses this distribution to extract free performance and efficiency gains. 🧵👇

Daniel Israel

11,655 views • 2 months ago

Most underrated skill today: Observability. I feel you can build a career just on this and have 2 decades of guaranteed money if you learn the skill well, and I'll tell you how below. Reality: Most teams I help look at me with dead eyes when I ask them about observability. That's sad, but it's the current state of the industry: • No tracing • No structured data • No way to understand what's happening when things break Outside of the most sophisticated companies, that's still where most teams are. AI is now writing a ton of code, and people are shipping this code to production. However important observability was before, it is 10x more important today. Believe me, you don't want to be the one pushing slop into production and then guessing how it works, with no way to understand what happens. Here is your first step: Honeycomb is running a FREE, 3-day virtual event focused entirely on observability. The event is running May 12-14. Did I mention it's completely free? Everything will revolve around observability for the agent era. Register here: Thanks to the Honeycomb.io System Status Updates team for partnering with me on this post.
1:33

Most underrated skill today: Observability. I feel you can build a career just on this and have 2 decades of guaranteed money if you learn the skill well, and I'll tell you how below. Reality: Most teams I help look at me with dead eyes when I ask them about observability. That's sad, but it's the current state of the industry: • No tracing • No structured data • No way to understand what's happening when things break Outside of the most sophisticated companies, that's still where most teams are. AI is now writing a ton of code, and people are shipping this code to production. However important observability was before, it is 10x more important today. Believe me, you don't want to be the one pushing slop into production and then guessing how it works, with no way to understand what happens. Here is your first step: Honeycomb is running a FREE, 3-day virtual event focused entirely on observability. The event is running May 12-14. Did I mention it's completely free? Everything will revolve around observability for the agent era. Register here: Thanks to the Honeycomb.io System Status Updates team for partnering with me on this post.

Santiago

19,983 views • 2 months ago

💥 OSS product analytics for LLM apps. Launching PostHog x langfuse.com integration 🤝 🫳 Day 1 drop of Langfuse Launch Week: We’re marrying product analytics and LLM observability. This integration pipes Langfuse events/metrics/evals into your PostHog project. This allows you to access all of your LLM metrics straight from your Posthog dashboards. I've used it to reality-check our evaluations by correlating them with user retention and ingestion metrics that we already measure in PostHog. This integration is now in public-beta and you can enable it within your Langfuse project settings. Thank you james hawkins, timgl and Lior Neu-ner for working on this over the past couple of weeks and to everyone who joined the private beta. More details: Quick tour of the integration 👇
2:19

💥 OSS product analytics for LLM apps. Launching PostHog x langfuse.com integration 🤝 🫳 Day 1 drop of Langfuse Launch Week: We’re marrying product analytics and LLM observability. This integration pipes Langfuse events/metrics/evals into your PostHog project. This allows you to access all of your LLM metrics straight from your Posthog dashboards. I've used it to reality-check our evaluations by correlating them with user retention and ingestion metrics that we already measure in PostHog. This integration is now in public-beta and you can enable it within your Langfuse project settings. Thank you james hawkins, timgl and Lior Neu-ner for working on this over the past couple of weeks and to everyone who joined the private beta. More details: Quick tour of the integration 👇

Marc Klingen

15,658 views • 2 years ago

Building with AI gets easier every day. Here is an open-source library that makes integrating AI into an application extremely easy: Star the repository! This library alone can make React the best front-end framework out there! There are a bunch of cool things I like about CopilotKit. Here are 3 of them: 1. It allows you to take any -powered agent and bring it into your application. (This is a brand-new feature!) 2. You can build an AI-powered chatbot in your application. The chatbot will have access to your context and can act on the application. 3. You can build a RAG workflow to process and answer questions from a real-time knowledge base. I recorded a video to show you how simple it is to make some of this happen. A few lines of code, and you are in business. Here is a link to the sample application: CopilotKit is open-source. You can self-host it. You can use it with any LLM. Thanks to the team for showing me their tool and collaborating with me on this post!
5:59

Building with AI gets easier every day. Here is an open-source library that makes integrating AI into an application extremely easy: Star the repository! This library alone can make React the best front-end framework out there! There are a bunch of cool things I like about CopilotKit. Here are 3 of them: 1. It allows you to take any -powered agent and bring it into your application. (This is a brand-new feature!) 2. You can build an AI-powered chatbot in your application. The chatbot will have access to your context and can act on the application. 3. You can build a RAG workflow to process and answer questions from a real-time knowledge base. I recorded a video to show you how simple it is to make some of this happen. A few lines of code, and you are in business. Here is a link to the sample application: CopilotKit is open-source. You can self-host it. You can use it with any LLM. Thanks to the team for showing me their tool and collaborating with me on this post!

Santiago

108,824 views • 2 years ago

Reading papers and taking notes for literature review takes a lot of time. You can install ChatGPT in your Zotero to supercharge your literature review. It will answer your questions based on papers in your library, so no fake citations or references. Here's how to do it:
0:22

Reading papers and taking notes for literature review takes a lot of time. You can install ChatGPT in your Zotero to supercharge your literature review. It will answer your questions based on papers in your library, so no fake citations or references. Here's how to do it:

Mushtaq Bilal, PhD

352,597 views • 2 years ago

BUY ONE GET ONE FREE 🤩 click the link BUY ANY CBD OIL from @supremecbd tonight and get a FREE oil the same strength absolutely free, you still get 40% of with code Fowler40 this a limited time only as no profit in it for me 😅 #supremecbd #mybrand
0:37

BUY ONE GET ONE FREE 🤩 click the link BUY ANY CBD OIL from @supremecbd tonight and get a FREE oil the same strength absolutely free, you still get 40% of with code Fowler40 this a limited time only as no profit in it for me 😅 #supremecbd #mybrand

Anthony Fowler

120,630 views • 2 years ago

Claude Code with Sonnet 4.5 is actually incredible I gave it a prompt for a super complex app, and it one shot the entire thing In this video I walk you through how to use Claude Code to build a prompt library app you can start using immediately (no coding experience required):
19:42

Claude Code with Sonnet 4.5 is actually incredible I gave it a prompt for a super complex app, and it one shot the entire thing In this video I walk you through how to use Claude Code to build a prompt library app you can start using immediately (no coding experience required):

Alex Finn

40,955 views • 9 months ago

This is going to change Data Analytics! A Dashboard UI inside the Jupyter Notebook which makes Visualizing Easy! Using just one line of code and is easy to deploy as well!
0:22

This is going to change Data Analytics! A Dashboard UI inside the Jupyter Notebook which makes Visualizing Easy! Using just one line of code and is easy to deploy as well!

Sasi 📊📈

92,187 views • 2 years ago

This Composio connect-apps plugin for Claude Code is 🔥 It's the easiest way to instantly connect Claude Code to 500+ apps like Gmail, Slack, GitHub, and Linear. You really don't need to be setting up MCP servers one by one. I use it a lot, and it has saved me a ton of time.
1:02

This Composio connect-apps plugin for Claude Code is 🔥 It's the easiest way to instantly connect Claude Code to 500+ apps like Gmail, Slack, GitHub, and Linear. You really don't need to be setting up MCP servers one by one. I use it a lot, and it has saved me a ton of time.

elvis

33,729 views • 5 months ago

🥳 One line of text is all it takes.🥳 Watch how our team is pushing code AND generating changelogs automatically with a custom Agent + GitHub Notion MCP server!
0:45

🥳 One line of text is all it takes.🥳 Watch how our team is pushing code AND generating changelogs automatically with a custom Agent + GitHub Notion MCP server!

Trae

11,665 views • 1 year ago

This library will blow up for a simple reason: It's the best for building a chatbot that doesn't hallucinate and knows how to answer questions. It's open-source, and it literally takes a few lines of code to run. Check the attached video.
6:58

This library will blow up for a simple reason: It's the best for building a chatbot that doesn't hallucinate and knows how to answer questions. It's open-source, and it literally takes a few lines of code to run. Check the attached video.

Santiago

107,840 views • 11 months ago

This is huge for production applications! Literally every developer has to deal with server errors they can't reproduce, and it doesn't matter how many logs they have. You don't have to be "every developer" anymore. Look into Hud's Runtime Code Sensor. Hud is one of my collaborators, and their code sensor is a game-changer for production applications. Watch the video I'm attaching here. For those of you who'd prefer a TL;DR; Hud captures how code behaves in production and puts those insights in context right in your IDE. This is really cool! You can see on top of every function data about how it works in production: • How long does it take to run? • How many times has the function failed? • Are the number of failures going up or down? All of this information is accessible to Cursor, Copilot, or WindSurf via an MCP server. That means that you can use the IDE to act on these issues! The way Hud works: • They provide a lightweight SDK • It takes one line to configure • All insights are right in your code • No dashboard necessary The best part: Their free plan includes ALL features they offer, so you can actually try it out properly and see how it fits your workflow. No paywall, no trial. Here is the link: Logging everything is great, but getting production insights right next to the code is definitely next-level!
4:28

This is huge for production applications! Literally every developer has to deal with server errors they can't reproduce, and it doesn't matter how many logs they have. You don't have to be "every developer" anymore. Look into Hud's Runtime Code Sensor. Hud is one of my collaborators, and their code sensor is a game-changer for production applications. Watch the video I'm attaching here. For those of you who'd prefer a TL;DR; Hud captures how code behaves in production and puts those insights in context right in your IDE. This is really cool! You can see on top of every function data about how it works in production: • How long does it take to run? • How many times has the function failed? • Are the number of failures going up or down? All of this information is accessible to Cursor, Copilot, or WindSurf via an MCP server. That means that you can use the IDE to act on these issues! The way Hud works: • They provide a lightweight SDK • It takes one line to configure • All insights are right in your code • No dashboard necessary The best part: Their free plan includes ALL features they offer, so you can actually try it out properly and see how it fits your workflow. No paywall, no trial. Here is the link: Logging everything is great, but getting production insights right next to the code is definitely next-level!

Santiago

28,515 views • 1 year ago

Want one? I have a discount code available. Say "CODE" and I'll send it to you. Get your strike in shape - even at home - ready for the start of the season
0:24

Want one? I have a discount code available. Say "CODE" and I'll send it to you. Get your strike in shape - even at home - ready for the start of the season

Adam Young Golf

10,076 views • 1 year ago

One of the best ways to win your time back with GitHub Copilot is to have it generate Git commit messages for you. Everyone has their own style - share yours with Copilot using Custom Instructions and save yourself a ton of time.
0:58

One of the best ways to win your time back with GitHub Copilot is to have it generate Git commit messages for you. Everyone has their own style - share yours with Copilot using Custom Instructions and save yourself a ton of time.

Visual Studio Code

66,210 views • 1 year ago