
Mike Taylor
@hammer_mt • 10,268 subscribers
🧪 Head of Evals @Every 📕 O'Reilly author: Prompt Engineering & DSPy 🎓 400k students on AI Udemy course 🤖 AI engineer since 2020 📈 Built a 50 person agency
Videos

DSPy is great at classification tasks, but it's hard to make a formal eval metric for 'fuzzy' creative tasks like writing a blog post or telling a joke. Solution: train a judge with DSPy to agree with you 90%+, then use that judge as the eval metric for the creative task.
Mike Taylor18,654 次观看 • 11 个月前
没有更多内容可加载