Loading video...

Video Failed to Load

Go Home

A masterclass from Jeremy Howard on why AI coding tools can be a trap -- and what 45 years of programming taught him that most vibe coders will never learn. - AI coding tools exploit gambling psychology - The difference between typing code and software engineering - Enterprise coding...

170,338 views • 6 months ago •via X (Twitter)

40 Comments

Michael Mullen's profile picture
Michael Mullen6 months ago

@jeremyphoward The telling thing in these comments is how MAD people get that Jeremy is saying what he is saying. Portraying him as being anti-LLM, which he is not. Like gamblers, so many people emotionally attached to their AI right now

Jack W Taylor's profile picture
Jack W Taylor6 months ago

@jeremyphoward Every generation says the new abstraction will destroy understanding, what’s different here?

Machine Learning Street Talk's profile picture
Machine Learning Street Talk6 months ago

Given Grady didn't take the bait - I will answer! LLMs *break* this pattern (on average). You're not moving to a higher level of understanding imo -- you're (potentially) moving to NO understanding of the implementation. This doesn't always happen, but it seems to happen more to people who go in without domain understanding/expertise. As Jeremy eludes to in the interview, there is a strategy to mitigate this and stay mentally "tuned-in". Roughly speaking, it is about adopting a development (and usage) workflow where you have iterative, interactive, stateful feedback exposing and reinforcing the abstractions/interfaces of the application. Just so it doesn't sound like I'm chatting random bullshit, here's an actual example that I used to create the very video you watched above. It's an agentic application, so I built this timeline by just chatting with my agent. But every single iteration - I had rich visual stateful feedback using the interface of the application and its abstractions. I could iterate many times, and it was all reproducible / immutable history. So rather than doing a bunch of half-baked stuff with LLMs and having no idea what the current state is, I'm always completely tuned in and everything is validated etc. This is an AI literacy thing as we discussed in the interview, it's possible to use AI in this way and build understanding (as I do).

Jack W Taylor's profile picture
Jack W Taylor6 months ago

I think both things can be true. People who use these tools badly or lazily will end up with shallow understanding, but it still feels similar to previous abstractions. Plenty of developers wrote C software without understanding assembly, and Python without understanding C. Yet engineering still moves forward. Another relevant to you Tim is YouTube. Legacy media grumbled its low quality, production standards would collapse etc. The average quality dropped, but the creative surface exploded and those that do good work outperform the old gatekeepers. I’m a non-engineer (with domain expertise) and over Dec/Jan built an app and already have a contract with an enterprise CTO ( 🤯) Something that would’ve been unthinkable for me just six months ago. Through the development I’ve learnt so much across the stack I’d never have imagined, hence my understanding has increased significantly. These magical tools should be embraced and encouraged.

Machine Learning Street Talk's profile picture
Machine Learning Street Talk6 months ago

I'm as excited about this tech as you are, and I am glad you are building great things! "Plenty of developers wrote C software without understanding assembly" It didn't matter, they just understood a new representation instead at a higher level of abstraction, which could still do everything we needed to do. The whole point of abstraction is to screen off unnecessary detail, and intelligence enacted in engineering (done right) creates these new, more powerful abstractions. But we still need to be in possession of good abstractions! A good abstraction should be maximally unified and factored, without screening off too much detail. This is what David Krakauer refers to as doing "more with less" (see our interview). Quite often, when we use language models, we do "more with more". Which means we're just creating loads of fractured, discardable code that doesn't cohere well together, and complexity explodes. I'm sure the stuff you're building is great, but deep domain knowledge might prompt you to design in better abstractions early on, ask the language model important questions -- for example, reviewing the security architecture and making sure you have a really good set of interfaces (so you can independently scale different parts of the application). Right now, the knowledge is probably all in your head, and you might struggle to scale through other people without your intentions and design decisions being eroded. Not trying be negative here but you will probably hit on some of the stuff. The good thing, though, is once you develop better abstractions in your head, you can just throw the code away and start again!

Jack W Taylor's profile picture
Jack W Taylor6 months ago

@jeremyphoward Your podcast and guests give me a similar feeling. I don’t understand all of it, but I try, and I feel thrilled/excited, and in the case of David Krakauer, erect.

Technosophie - auto/acc's profile picture
Technosophie - auto/acc6 months ago

@jeremyphoward I have coded for 20yr. I have been CTO. I disagree. Agentic coding is a new era. There is still "desirable difficulty". There is much more. Agentic coding has make coding fun again.

Machine Learning Street Talk's profile picture
Machine Learning Street Talk6 months ago

@jeremyphoward I agree that there can be desirable difficulty (so does Jeremy) - it's mostly fighting against laziness and using AI in the right way. These tools are magical for experienced software engineers so you're probably already doing it the "right way" 😁

Nathaniel's profile picture
Nathaniel6 months ago

Incredibly strange take. He has a point, in that human context is far greater than we give it credit for, but for specific tasks, namely writing code, language models are a powerful accelerant. A carefully designed spec with appropriate guardrails can cut development time down to a fraction of what it once was.

Somi's profile picture
Somi6 months ago

@jeremyphoward ngl the gambling psychology point is so real. you get one perfect output and suddenly you're just hitting accept on everything hoping for another hit. the devs who treat AI as a collaborator instead of a slot machine are the ones actually shipping

Simon Prammer's profile picture
Simon Prammer6 months ago

@jeremyphoward Yes yes we get it. You dont like LLMs. Still persisting with the narrative makes the whole channel seem like Doomer content.

Machine Learning Street Talk's profile picture
Machine Learning Street Talk6 months ago

@jeremyphoward I love LLMs, and I'm maxing out my Claude Max sub. For some reason, my Claude Code stats reset in January, but it's been like this continuously 😀

Michael Timbs's profile picture
Michael Timbs6 months ago

@jeremyphoward This was very good. Jeremy one of the few sane voices on this unfortunately.

Tudor Barbu's profile picture
Tudor Barbu6 months ago

the desirable difficulty thing is so real: seen tons of devs completely freeze when copilot can't figure something out because they never actually learned how things work under the hood.... and yeah the gambling psychology hits hard, you just keep hitting regenerate thinking "this next one will be it" :))

Machine Learning Street Talk's profile picture
Machine Learning Street Talk6 months ago

GTC is coming, the premier AI conference, great opportunity to learn about AI. NVIDIA and partners will showcase breakthroughs in physical AI, AI factories, agentic AI, and inference, exploring the next wave of AI innovation for developers and researchers. Register for virtual GTC for free, using my link and win NVIDIA DGX Spark (

menfem's profile picture
menfem6 months ago

@jeremyphoward Jeremy is a legend, but he is at heart an academic and teacher, not great at business. so when he draws the parallel to pulling the gambling lever with these tools and betting the product on these tools... well that's exactly what business is. Risk, and if it's not gtfo

a.lihachöv's profile picture
a.lihachöv6 months ago

@jeremyphoward Howard's right that understanding matters more than speed. But I've used Claude Code daily for a year and I still read every line it writes. That review is where I learn the most. "Desirable difficulty" and better tools aren't mutually exclusive.

Kamil Staszewski's profile picture
Kamil Staszewski6 months ago

@jeremyphoward People are mad in the comments because a person with over 20 years of experience in programming and machine learning said what they think about LLMs. Those “people” are probably bots, and if they’re human, they weren’t even born when Jeremy first started coding, respectfully.

JJ's profile picture
JJ6 months ago

@jeremyphoward

Coenraad Loubser 🇿🇦's profile picture
Coenraad Loubser 🇿🇦6 months ago

@jeremyphoward Cope harder

Rife's profile picture
Rife6 months ago

@jeremyphoward weird take from someone who cofounded which abstracted away the difficulty and requirement for low-level understanding from working with NNs. This is just another layer up. AIs coding won't kill true curiosity, nor will forced coding drudgery elicit it

Sharon | AI wonders's profile picture
Sharon | AI wonders6 months ago

@jeremyphoward 20 years to be good at coding? Really?

Tony's profile picture
Tony6 months ago

@jeremyphoward 45 years of programming = knowing where the bodies are buried. the trap isn't AI. it's skipping the part where you understand why the code works.

phebbar's profile picture
phebbar6 months ago

@jeremyphoward Totally agree with this. But I cannot resist the temptation of vibe coding in hours what I took days. Well I know I know that itself is akin to gambling :(

Alden Morris's profile picture
Alden Morris6 months ago

That bit about typing code vs software engineering is spot on. I spent 8 months building Drop with Claude and yeah, the prompting part was easy. The hard part was understanding why the geofencing broke at scale, how to architect real-time data pipelines, debugging production issues at 2am. AI was the tool but I had to learn what good architecture actually looks like. Drop's a free iOS app now:

Norbert Włodarczyk's profile picture
Norbert Włodarczyk5 months ago

Love Jeremy persona, realy sparks a good discussion. From the positive notes on the matter - I feel a bit more unstucked with AI sometimes, and def can iterate faster on solutions (not incrementing). What scares me is the fact that we are producing so much code that it doesn't leave neural marks in our heads thus we don't even remember commiting certains lines of code. Engineers were most often domain experts and now if they don't ask AI with the right context incjected they don't even know what's in the codebase, and can hardly answer domain specific questions. Also learning process for junior devs suffers - meaning you can prompt your AI or spend 2 months perfecting a craft - choice is simple from our dopamine seeking brains.

wispem-wantex's profile picture
wispem-wantex6 months ago

@jeremyphoward Is the full interview available somewhere?

Tyler Nash's profile picture
Tyler Nash6 months ago

@jeremyphoward @MLStreetTalk The gambling psychology angle is spot on. AI coding gives that first-run dopamine hit, then the debugging spiral hits hard.

Kyle Tran's profile picture
Kyle Tran6 months ago

@jeremyphoward That line about typing code versus software engineering is where ROI shows up, not in prompt hype

Divyansh's profile picture
Divyansh6 months ago

@jeremyphoward vibe coding works until u hit a bug u have no framework to debug. then u realize u skipped all the parts that actually matter.

Ruchir Tewari's profile picture
Ruchir Tewari6 months ago

@jeremyphoward Need this counterpoint to define the drawbacks one feels after some time. It’s not about deep models imo but alignment between programmer intent and where tool takes you instead and difficulty bridging the two vectors.

Vish's profile picture
Vish6 months ago

@jeremyphoward @IncrementsPod @VadenMasrani @BennyChugg did you guys listen to this? Jeremy's got some interesting takes on AI, creativity, problem solving etc, right up your alleys!

John E-gen 🔮's profile picture
John E-gen 🔮6 months ago

the craft is collaboration after working in the ‘field’ for several years can attest that it is challenging AI is of course based on probabilities resemblance to an advanced game of chance is apropos suggesting that AI is an obstacle to developing a deep mental model is part of the friction that makes the collaboration challenging it motivates you to indulge in shortcuts discipline and structure is part of that collaboration

Dustin Goerndt's profile picture
Dustin Goerndt6 months ago

@jeremyphoward This gentleman is not realizing he’s exploiting a mirrored psychological pattern and is also gambling.. 1: He doesn’t understand his own tacit knowledge. 2: He doesn’t understand how LLMs work. 3: He doesn’t understand the gap is the difference.

/fabio/ S. 🎲's profile picture
/fabio/ S. 🎲6 months ago

@jeremyphoward This one was epic. Really liked it.

sme's profile picture
sme6 months ago

@jeremyphoward In large language model defense, most people in the corporate world pretend to understand the subject. Few actually have a clue about the topics they claim expertise in. Most projects are run by hustlers. Very little of what gets shipped reflects any deep thinking whatsoever.

Hank Yeomans's profile picture
Hank Yeomans4 months ago

I would say there is a range of nuance that causes people to agree or disagree based on their own experiences. Some use it like a slot machine yes, the pure “I don’t look at anything because why should I, I don’t know any of it any way” people. The “Now I don’t have to learn anything at all” narrative is so off putting. Because to them everything including even watching it is “a chore.” But this would be like doctors offloading 100% to AI because “it’s all a chore.” But the other side of this, that I like to talk about is all the potential learning. I have and continue to learn a lot because I choose to use the coding agents to discover and be curious. For example I’ve learned a ton about swift in one of my projects. I learned how to use some tools even better. I learned how to be more clear in my asks. I’ve learned to rethink/refine how I approach things. I think there’s a win on that side people don’t talk about. Because the loudest voices are the slot players and the “finally those SWE thought they were so special now they’re min wagers” people.

Denis Andrejew's profile picture
Denis Andrejew6 months ago

@jeremyphoward clueless

Favio Vázquez's profile picture
Favio Vázquez6 months ago

@jeremyphoward I actually built something on this line of thought

infinite monkey's profile picture
infinite monkey6 months ago

@jeremyphoward If you have a greenfield project with unlimited budget, no time constraints, and zero turnover, then hand crafting it is clearly the way to go. If your competitor is using AI and you're not it's survival of the shippest.

Related Videos