Loading video...

Video Failed to Load

Go Home

Claude 3.7 reasoning and coding capabilities are no joke! Watch how I use it to one-shot a quick simulator of how attention mechanisms work. I think it could be awesome for each of us to have access to a personal Andrej Karpathy-like tutor to explain complex stuff to us. 😀

31,669 views • 1 year ago •via X (Twitter)

8 Comments

elvis's profile picture
elvis1 year ago

This is not perfect by any means and I didn't check for mistakes but just wanted to quickly share this to inspire more of these use cases.

elvis's profile picture
elvis1 year ago

I also like this one (Precision & Recall). Claude 3.7 Sonnet (with extended thinking) also did this oneshot. The quality of the code and dashboards is on another level.

elvis's profile picture
elvis1 year ago

Prompts for first example: "Can you help me explain attention mechanisms in Transformers to college students? Think deeply about clever ways to explain the concepts without focusing too much on maths." "Now create a simulator that could students understand it better."

Jay Rodge's profile picture
Jay Rodge1 year ago

@karpathy This is a cool use case! Can you share the prompt in this thread?

elvis's profile picture
elvis1 year ago

@karpathy Sure, let me do that.

Tariq Gadgetman's profile picture
Tariq Gadgetman1 year ago

@karpathy Claude 3.7's capabilities are indeed impressive! A tutor like Karpathy would make complex concepts much easier to grasp.

Jilong | We provide AI marketer - 24/7 marketing's profile picture
Jilong | We provide AI marketer - 24/7 marketing1 year ago

@karpathy personal tutors could boost learning, for sure.

Yang's profile picture
Yang1 year ago

Want to learn how practical AI skills and automations for your business and work? Check out our step-by-step video tutorials 100% FREE 🥳

Related Videos

OpenAI just announced API access to o1 (advanced reasoning model) yesterday. I'm delighted to announce today a new short course, Reasoning with o1, built with OpenAI, and taught by Colin Jarvis, Head of AI Solutions at OpenAI, to show you how to use this effectively! Unlike previous language models which generate output directly, o1 “thinks before it responds,” and generates many reasoning tokens before returning a more thoughtful and accurate response. It is great at complex reasoning -- including planning for agentic workflows, coding, and domain-specific reasoning in STEM fields like law. But how you should use it is quite different from other LLMs. I think o1 will be a game changer for many AI applications; and in this course, you'll learn how to use it effectively. In detail, you’ll: - Learn to recognize what tasks o1 is suited for, and when to use a smaller model, or combine o1 with a smaller model - Understand the new principles of prompting reasoning models: Be simple and direct; no explicit chain-of-thought required; use structure; show rather than tell - Implement multi-step orchestration in which o1 plans, and hands tasks over to gpt-4o-mini to execute specific steps; this illustrates a design pattern to optimize intelligence (accuracy) and cost - Use o1 for a coding task to build a new application, edit existing code, and test performance by running a coding competition between o1-mini and GPT 4o - Use o1 for image understanding and learn how it performs better with a "hierarchy of reasoning," in which it incurs the latency and cost upfront, preprocessing the image and indexing it with rich details so it can be used for Q&A later - Learn a technique called meta-prompting, in which you use o1 to improve your prompts. Using a customer support evaluation set, you'll iteratively use o1 to modify a prompt to improve performance You'll also learn about how OpenAI used reinforcement learning to produce a model that uses "test-time compute" to improve performance. I think you'll find this course enjoyable and valuable. Please sign up for it here:

Andrew Ng

357,661 views • 1 year ago