Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

New Engineering blog: We tasked Opus 4.6 using agent teams to build a C compiler. Then we (mostly) walked away. Two weeks later, it worked on the Linux kernel. Here's what it taught us about the future of autonomous software development. Read more:

8,533,221 Aufrufe • vor 7 Monaten •via X (Twitter)

35 Kommentare

Profilbild von Jaydeep
Jaydeepvor 7 Monaten

I have an idea

Profilbild von Yet Another Tech Poster
Yet Another Tech Postervor 7 Monaten

Before freaking out read this

Profilbild von Chauncey Hutter III
Chauncey Hutter IIIvor 7 Monaten

But the C compiler has been written before. The LLMs were trained on the C compiler.

Profilbild von Machine Learning Street Talk
Machine Learning Street Talkvor 7 Monaten

> Write extremely high-quality tests > Claude will work autonomously to solve whatever > problem I give it. So it’s important that the task verifier > is nearly perfect, otherwise Claude will solve the > wrong problem. This basically sums up genai coding in a single sentence. It's amazing but ultimately it builds exactly what you tell it to, and what you can competently describe. Much easier to recreate things that are already understood than new things which are not yet understood.

Profilbild von Zhiwei
Zhiweivor 7 Monaten

I can "build" a C compiler in one command: git clone

Profilbild von Jason
Jasonvor 7 Monaten

You have agents building C compilers but your support team can't respond to chats or account suspension appeals in over a month?

Profilbild von Yet Another Tech Poster
Yet Another Tech Postervor 7 Monaten

It also *incorrectly* complies this program without errors! int add(int a, int b) { return a + b; } int main(void) { return add(40); } GCC catches the error - this compiler does not verify argument lengths of functions!

Profilbild von Jeet
Jeetvor 7 Monaten

its great stuff for sure , but just under 20k usd , crazy and i dont think any individual claude code user will be ever able to have 2000 parallel claude code sessions even if u lower ur prices , and its most definitely not possible in next 2-3 years imo , hoping i am wrong ofc

Profilbild von FaceTheFact!
FaceTheFact!vor 7 Monaten

Wait… don’t we already have that? So it’s getting really good at rebuilding things humans already built?

Profilbild von midorioshii
midorioshiivor 7 Monaten

Vibe coding a C compiler

Profilbild von sycoms
sycomsvor 7 Monaten

"We (mostly) walked away" is doing heavy lifting. The researcher constantly redesigned tests, built CI pipelines when agents broke each other's work. Orchestration > raw intelligence.

Profilbild von surreal intelligence
surreal intelligencevor 7 Monaten

Congrats on inventing the first compiler powered by neglect. Next milestone: it files its own bug report, then sues the bug for defamation.

Profilbild von supercarl
supercarlvor 7 Monaten

How much token does it cost?

Profilbild von Mykyta Pavlenko
Mykyta Pavlenkovor 7 Monaten

We are watching the shift from writing code to managing context. When the cost of engineering complex systems approaches zero, the only real differentiator left is distribution and the judgment to tell a viable product from more noise.

Profilbild von geoff
geoffvor 7 Monaten

so; but not cursed

Profilbild von Levi Segal
Levi Segalvor 7 Monaten

"mostly walked away" doing a lot of heavy lifting in that sentence. curious what the intervention rate actually looked like week 1 vs week 2

Profilbild von Anveio
Anveiovor 7 Monaten

If it wasn't obvious yet that software engineering as we know it is over: who's going to pay you $300k/year to write 50-150 lines of code a day when AI can do this?

Profilbild von QuantumBiologics
QuantumBiologicsvor 7 Monaten

Sorry this not that impressive or useful, of course it can recreate what it was trained on, I'm sure Opus 4.6 saw all the source code for these compilers during it's training. See if it can create a compiler for a new CPU or a new language, that would be really interesting.

Profilbild von lukasz
lukaszvor 7 Monaten

This is terrifying actually. It used to take people months (and their mental sanity) to build something relatively as complex, just 1 year ago. Now we get this with little to no human effort

Profilbild von Bill
Billvor 7 Monaten

More large-scale cloning of existing software, cool

Profilbild von Mohammad
Mohammadvor 7 Monaten

never expected my words will come true like this :

Profilbild von Jeff Garzik
Jeff Garzikvor 7 Monaten

Actually Claude helped write this one, and it's better than yours :)

Profilbild von Mohxnova_.
Mohxnova_.vor 7 Monaten

$20,000 & 2 billion token inputs is the real stress testing I believe.

Profilbild von Rich Henry
Rich Henryvor 7 Monaten

They are literally just using up power at this point. What a pointless demo.

Profilbild von Sergey Nikiforov
Sergey Nikiforovvor 7 Monaten

20k to produce a working c compiler that builds the linux kernel feels wild. even a small team of compiler engineers would cost that per day in salary and it would take months not weeks

Profilbild von 21e8
21e8vor 7 Monaten

If you included the Linux Kernel and GNU C Compiler sources in your training set then you are in breach of the license and your model is out of compliance.

Profilbild von Nebojsa Djordjevic
Nebojsa Djordjevicvor 7 Monaten

After you stole<ahem>learn-from existing FLOSS compilers you mean?

Profilbild von The Underfitted
The Underfittedvor 7 Monaten

tell your opus 4.6 to finish my medical agentic system that opus 4.5 orchestrated

Profilbild von Common Man
Common Manvor 7 Monaten

Since Language models know what a C compiler is they could code it easily. I am just curious can they build something that was never explored or written somewhere in the internet ?

Profilbild von Majestic
Majesticvor 7 Monaten

This is wild but I keep coming back to that $20k price tag. You’re right that it’s cheaper than a team, but at what point does the debugging overhead of autonomous agents eclipse just… writing it yourself? The 16-bit x86 workaround feels telling - when the model hits its limits, you still need human intervention to either fix it or architect around it. Still, compiling Linux is no joke.

Profilbild von Jon Clegg
Jon Cleggvor 7 Monaten

“It does not have its own assembler and linker; these are the very last bits that Claude started automating and are still somewhat buggy. The demo video was produced with a GCC assembler and linker.” Also, 100k lines of code for C seems like a lot. I guess it’s all the standard libraries as well. None of that seems hard, C is a very simple language. The trickiest part is building the syntax tree.

Profilbild von Alex Utopia
Alex Utopiavor 7 Monaten

do you guys still have jobs?

Profilbild von Rui Diao
Rui Diaovor 7 Monaten

A 100,000-line compiler that builds Linux, written by agents with minimal oversight. The developer role is shifting from code writer to system orchestrator. The question isn't whether agents can code, but whether we can build verification fast enough to keep up.

Profilbild von Algomizer | LLM Optimization
Algomizer | LLM Optimizationvor 7 Monaten

one researcher and 16 AI agents built a compiler that passes 99% of GCC's torture test suite and runs Doom. GCC took thousands of engineers 37 years. the "(mostly) walked away" does heavy lifting. no human wrote code but the researcher constantly redesigned tests, built CI when agents broke each other's work, and created workarounds when all 16 agents hit the same bug. the work became engineering the environment where AI can write code. you need perfect tests because Claude builds exactly what you specify. As of that... the human role shifted to orchestration and defining what "correct" actually means.

Profilbild von mikku
mikkuvor 7 Monaten

So it didn’t actually build a compiler, it cost 20k and still didn’t actually complete its task It almost sounds like a real programmer

Ähnliche Videos

🚀New Amazon Q Developer agent for software development is available to customers: This agent is based on a new agent architecture that has exciting results coming from the SWE-bench scores (on the full and verified benchmarks) representing AI models’ ability to resolve real-world coding problems. Interesting aspect of Q Agent is that with these newest updates, Q drove nearly 50% more successful coding tasks completed. What makes Q Dev Agent remarkable? The agent architecture is not just about using the best LLMs (which we do), but also giving the agent the ability to constantly explore multiple paths to find the best way to resolve a particular problem (and back tracking when it has reached dead end like a developer would do). Needless to say, we are just getting started on the developer agent and we are constantly pushing to advance our AI capabilities while maintaining quality, security, privacy, and reliability to keep Amazon Q Developer an innovative and trusted option available to our customers using agents for software development. We highlighted the results of our first SWE-bench submission of Amazon Q Developer back in June blog post; with these updates, our new agent resolves 51% more coding tasks than its previous iteration on the SWE-bench verified dataset, and 43% more on the full dataset. That’s the difference a few months make, and I can’t wait to share what our teams will deliver at re:Invent this December. Here's a quick demo showcasing our new Agent in action:

Swami Sivasubramanian

29,013 Aufrufe • vor 2 Jahren

Linux is the most widespread operating system, globally – but how is it built? Few people are better to answer this than Greg Kroah-Hartman (Greg K-H): Greg has been a Linux kernel maintainer for 25 years, and one of the 3 Linux Kernel Foundation Fellows (the other two are Linus Torvalds and Shuah Khan). Greg manages the Linux kernel’s stable releases, and is a maintainer of multiple kernel subsystems. We cover the inner workings of Linux kernel development, exploring everything from how changes get implemented to why its community-driven approach produces such reliable software. Greg shares insights about the kernel's unique trust model and makes a case for why engineers should contribute to open-source projects. Watch or listen: • YouTube: • Spotify: • Apple: Brought to you buy: • WorkOS — The modern identity platform for B2B SaaS. • Vanta — Automate compliance and simplify security with Vanta. Check out all of our current sponsor and their offerings: ---- One of the most surprising things I learned about Linux: although 4,000 developers contribute to the project from 500 companies per year, and has around 800 kernel maintainers, the project is run with email, git... and that's about it! No dedicated project managers, no regular meetings across the group. It's a truly fascinating and unique model (and only applies to the Linux kernel project: not to Linux distributions.) We go into more detail about this topic with Greg in the podcast as well.

Gergely Orosz

51,383 Aufrufe • vor 1 Jahr