Loading video...

Video Failed to Load

Go Home

New Engineering blog: We tasked Opus 4.6 using agent teams to build a C compiler. Then we (mostly) walked away. Two weeks later, it worked on the Linux kernel. Here's what it taught us about the future of autonomous software development. Read more:

8,537,909 views • 9 months ago •via X (Twitter)

35 Comments

Jaydeep's profile picture
Jaydeep9 months ago

I have an idea

Yet Another Tech Poster's profile picture
Yet Another Tech Poster9 months ago

Before freaking out read this

Chauncey Hutter III's profile picture
Chauncey Hutter III9 months ago

But the C compiler has been written before. The LLMs were trained on the C compiler.

Machine Learning Street Talk's profile picture
Machine Learning Street Talk9 months ago

> Write extremely high-quality tests > Claude will work autonomously to solve whatever > problem I give it. So it’s important that the task verifier > is nearly perfect, otherwise Claude will solve the > wrong problem. This basically sums up genai coding in a single sentence. It's amazing but ultimately it builds exactly what you tell it to, and what you can competently describe. Much easier to recreate things that are already understood than new things which are not yet understood.

Zhiwei's profile picture
Zhiwei9 months ago

I can "build" a C compiler in one command: git clone

Jason's profile picture
Jason9 months ago

You have agents building C compilers but your support team can't respond to chats or account suspension appeals in over a month?

Yet Another Tech Poster's profile picture
Yet Another Tech Poster9 months ago

It also *incorrectly* complies this program without errors! int add(int a, int b) { return a + b; } int main(void) { return add(40); } GCC catches the error - this compiler does not verify argument lengths of functions!

Jeet's profile picture
Jeet9 months ago

its great stuff for sure , but just under 20k usd , crazy and i dont think any individual claude code user will be ever able to have 2000 parallel claude code sessions even if u lower ur prices , and its most definitely not possible in next 2-3 years imo , hoping i am wrong ofc

FaceTheFact!'s profile picture
FaceTheFact!9 months ago

Wait… don’t we already have that? So it’s getting really good at rebuilding things humans already built?

midorioshii's profile picture
midorioshii9 months ago

Vibe coding a C compiler

sycoms's profile picture
sycoms9 months ago

"We (mostly) walked away" is doing heavy lifting. The researcher constantly redesigned tests, built CI pipelines when agents broke each other's work. Orchestration > raw intelligence.

surreal intelligence's profile picture
surreal intelligence9 months ago

Congrats on inventing the first compiler powered by neglect. Next milestone: it files its own bug report, then sues the bug for defamation.

supercarl's profile picture
supercarl9 months ago

How much token does it cost?

Mykyta Pavlenko's profile picture
Mykyta Pavlenko9 months ago

We are watching the shift from writing code to managing context. When the cost of engineering complex systems approaches zero, the only real differentiator left is distribution and the judgment to tell a viable product from more noise.

geoff's profile picture
geoff9 months ago

so; but not cursed

Levi Segal's profile picture
Levi Segal9 months ago

"mostly walked away" doing a lot of heavy lifting in that sentence. curious what the intervention rate actually looked like week 1 vs week 2

Anveio's profile picture
Anveio9 months ago

If it wasn't obvious yet that software engineering as we know it is over: who's going to pay you $300k/year to write 50-150 lines of code a day when AI can do this?

QuantumBiologics's profile picture
QuantumBiologics9 months ago

Sorry this not that impressive or useful, of course it can recreate what it was trained on, I'm sure Opus 4.6 saw all the source code for these compilers during it's training. See if it can create a compiler for a new CPU or a new language, that would be really interesting.

lukasz's profile picture
lukasz9 months ago

This is terrifying actually. It used to take people months (and their mental sanity) to build something relatively as complex, just 1 year ago. Now we get this with little to no human effort

Bill's profile picture
Bill9 months ago

More large-scale cloning of existing software, cool

Mohammad's profile picture
Mohammad9 months ago

never expected my words will come true like this :

Jeff Garzik's profile picture
Jeff Garzik9 months ago

Actually Claude helped write this one, and it's better than yours :)

Mohxnova_.'s profile picture
Mohxnova_.9 months ago

$20,000 & 2 billion token inputs is the real stress testing I believe.

Rich Henry's profile picture
Rich Henry9 months ago

They are literally just using up power at this point. What a pointless demo.

Sergey Nikiforov's profile picture
Sergey Nikiforov9 months ago

20k to produce a working c compiler that builds the linux kernel feels wild. even a small team of compiler engineers would cost that per day in salary and it would take months not weeks

21e8's profile picture
21e89 months ago

If you included the Linux Kernel and GNU C Compiler sources in your training set then you are in breach of the license and your model is out of compliance.

Nebojsa Djordjevic's profile picture
Nebojsa Djordjevic9 months ago

After you stole<ahem>learn-from existing FLOSS compilers you mean?

The Underfitted's profile picture
The Underfitted9 months ago

tell your opus 4.6 to finish my medical agentic system that opus 4.5 orchestrated

Common Man's profile picture
Common Man9 months ago

Since Language models know what a C compiler is they could code it easily. I am just curious can they build something that was never explored or written somewhere in the internet ?

Majestic's profile picture
Majestic9 months ago

This is wild but I keep coming back to that $20k price tag. You’re right that it’s cheaper than a team, but at what point does the debugging overhead of autonomous agents eclipse just… writing it yourself? The 16-bit x86 workaround feels telling - when the model hits its limits, you still need human intervention to either fix it or architect around it. Still, compiling Linux is no joke.

Jon Clegg's profile picture
Jon Clegg9 months ago

“It does not have its own assembler and linker; these are the very last bits that Claude started automating and are still somewhat buggy. The demo video was produced with a GCC assembler and linker.” Also, 100k lines of code for C seems like a lot. I guess it’s all the standard libraries as well. None of that seems hard, C is a very simple language. The trickiest part is building the syntax tree.

Alex Utopia's profile picture
Alex Utopia9 months ago

do you guys still have jobs?

Rui Diao's profile picture
Rui Diao9 months ago

A 100,000-line compiler that builds Linux, written by agents with minimal oversight. The developer role is shifting from code writer to system orchestrator. The question isn't whether agents can code, but whether we can build verification fast enough to keep up.

Algomizer | LLM Optimization's profile picture
Algomizer | LLM Optimization9 months ago

one researcher and 16 AI agents built a compiler that passes 99% of GCC's torture test suite and runs Doom. GCC took thousands of engineers 37 years. the "(mostly) walked away" does heavy lifting. no human wrote code but the researcher constantly redesigned tests, built CI when agents broke each other's work, and created workarounds when all 16 agents hit the same bug. the work became engineering the environment where AI can write code. you need perfect tests because Claude builds exactly what you specify. As of that... the human role shifted to orchestration and defining what "correct" actually means.

mikku's profile picture
mikku9 months ago

So it didn’t actually build a compiler, it cost 20k and still didn’t actually complete its task It almost sounds like a real programmer

Related Videos

🚀New Amazon Q Developer agent for software development is available to customers: This agent is based on a new agent architecture that has exciting results coming from the SWE-bench scores (on the full and verified benchmarks) representing AI models’ ability to resolve real-world coding problems. Interesting aspect of Q Agent is that with these newest updates, Q drove nearly 50% more successful coding tasks completed. What makes Q Dev Agent remarkable? The agent architecture is not just about using the best LLMs (which we do), but also giving the agent the ability to constantly explore multiple paths to find the best way to resolve a particular problem (and back tracking when it has reached dead end like a developer would do). Needless to say, we are just getting started on the developer agent and we are constantly pushing to advance our AI capabilities while maintaining quality, security, privacy, and reliability to keep Amazon Q Developer an innovative and trusted option available to our customers using agents for software development. We highlighted the results of our first SWE-bench submission of Amazon Q Developer back in June blog post; with these updates, our new agent resolves 51% more coding tasks than its previous iteration on the SWE-bench verified dataset, and 43% more on the full dataset. That’s the difference a few months make, and I can’t wait to share what our teams will deliver at re:Invent this December. Here's a quick demo showcasing our new Agent in action:

Swami Sivasubramanian

29,013 views • 2 years ago

Linux is the most widespread operating system, globally – but how is it built? Few people are better to answer this than Greg Kroah-Hartman (Greg K-H): Greg has been a Linux kernel maintainer for 25 years, and one of the 3 Linux Kernel Foundation Fellows (the other two are Linus Torvalds and Shuah Khan). Greg manages the Linux kernel’s stable releases, and is a maintainer of multiple kernel subsystems. We cover the inner workings of Linux kernel development, exploring everything from how changes get implemented to why its community-driven approach produces such reliable software. Greg shares insights about the kernel's unique trust model and makes a case for why engineers should contribute to open-source projects. Watch or listen: • YouTube: • Spotify: • Apple: Brought to you buy: • WorkOS — The modern identity platform for B2B SaaS. • Vanta — Automate compliance and simplify security with Vanta. Check out all of our current sponsor and their offerings: ---- One of the most surprising things I learned about Linux: although 4,000 developers contribute to the project from 500 companies per year, and has around 800 kernel maintainers, the project is run with email, git... and that's about it! No dedicated project managers, no regular meetings across the group. It's a truly fascinating and unique model (and only applies to the Linux kernel project: not to Linux distributions.) We go into more detail about this topic with Greg in the podcast as well.

Gergely Orosz

51,383 views • 1 year ago