Mike Taylor's banner
Mike Taylor's profile picture

Mike Taylor

@hammer_mt • 10,268 subscribers

🧪 Head of Evals @Every 📕 O'Reilly author: Prompt Engineering & DSPy 🎓 400k students on AI Udemy course 🤖 AI engineer since 2020 📈 Built a 50 person agency

Videos

LIVE
1.2k

Anya Rossi

sweetdream.ai

SweetDream.aiSponsored•Livecam
Streaming Now

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

HD live stream
Exclusive private shows
1.2k viewers online

Free preview available • Premium content

Made myself a no code interface for optimizing prompts with DSPy. Thought I'd open source it.
3:20
hammer_mt's profile picture

Made myself a no code interface for optimizing prompts with DSPy. Thought I'd open source it.

Mike Taylor

73,112 views • 1 year ago

DSPy is great at classification tasks, but it's hard to make a formal eval metric for 'fuzzy' creative tasks like writing a blog post or telling a joke. Solution: train a judge with DSPy to agree with you 90%+, then use that judge as the eval metric for the creative task.
27:20
hammer_mt's profile picture

DSPy is great at classification tasks, but it's hard to make a formal eval metric for 'fuzzy' creative tasks like writing a blog post or telling a joke. Solution: train a judge with DSPy to agree with you 90%+, then use that judge as the eval metric for the creative task.

Mike Taylor

18,654 views • 11 months ago

No more content to load