Loading video...

Video Failed to Load

Go Home

OpenAI’s new GPT-5 Codex is impressive at coding tasks. But, in a huge codebase, intelligence isn’t the main bottleneck—context is.

1,235,567 views • 1 year ago •via X (Twitter)

14 Comments

peasantUpon's profile picture
peasantUpon1 year ago

Been saying this. We don't need AGI, we need ACI. Artificial Contextual Intelligence. To be AGI it requires ACI, imo.

Jing's profile picture
Jing1 year ago

I work with customers who have codebases that are millions and tens of millions of lines. They need an OSS AI memory and context layer like @MemMachine_ai

Sir Bubba The Great's profile picture
Sir Bubba The Great1 year ago

100%! Once you move from POC and simple code, you’re forced to break your code base up into modules that fit the context window. You can also use AI to generate a framework for assembling the modularity. It works!

Tensors's profile picture
Tensors10 months ago

Context management + semantic/symbolic retrieval is key for high quality agents

Isa Bel - 𝕀⟡₆₃₉'s profile picture
Isa Bel - 𝕀⟡₆₃₉1 year ago

does it modulate itself ?

jac's profile picture
jac1 year ago

we've been saying this for years but everyone kept throwing bigger models at the problem. turns out rag and context windows matter more than another trillion parameters who knew

Fails.us's profile picture
Fails.us1 year ago

I created a `fid` command that uses a little-known ability of `find` to create a digest of source files, ignoring binary files to speed up grep. It searches the whole codebase as if it was a single mmap'd document.

Wes H☀️ling's profile picture
Wes H☀️ling1 year ago

it's not impressive at coding tasks. engineers spend 20% more time on code generated openai. give this shit a rest

Rachel Myers's profile picture
Rachel Myers11 months ago

So true

Wanda Pitts's profile picture
Wanda Pitts1 year ago

ELON MUSK, THIS IS WANDA PITTS GARY. I HAVE YOUR # 618. AND I PURCHASED A TESLA MEET AND GREET. NEED ADVICE DO YOU DEAL WITH WHATSAPP. I HAVE MORE INFO

J.C.'s profile picture
J.C.1 year ago

Interesting. But how are you handling codebase/data security?

AB's profile picture
AB1 year ago

I've built a system context file into my code base - I generally ask the AI to run a new thread and run as long as I can before it maxes the context window and update the context. What's the benefit of using your app ? Also 600 msgs seems low?

James Lucas's profile picture
James Lucas1 year ago

Code is always about context.

m Casual's profile picture
m Casual1 year ago

maybe the Evolutive aspect of the Context is Needed to perform Solving

Related Videos

OpenAI’s hottest app isn’t ChatGPT—it’s Codex. In the last few weeks alone, the Codex team shipped a desktop app, GPT-5.3 Codex (a new flagship model), and Spark, the fastest coding model I’ve ever used. Usage has grown fivefold since January and over a million people now use Codex weekly. Codex was also the app that OpenAI chose to run an ad for in the Super Bowl. I talked to Thibault (Tibo), head of Codex, and Andrew (Andrew Ambrosino), a member of technical staff who built the Codex app, for Every 📧’s AI & I about what OpenAI is building and how they’re using it internally. We get into: - Why they built a GUI instead of a terminal. Terminals work for quick tasks, they say, but feel limiting when you’re running multiple agents in parallel. The IDE, meanwhile, overwhelms users—and the Codex team wants the AI to dynamically decide which tools to show you for a given task. - How they’re teaching the model to read between the lines. Codex is great at following instructions, but optimize too hard in that direction, and it starts taking you literally—like copying a typo directly into the code. The team obsesses over this tradeoff, and is also introducing “personalities,” modes users can toggle between that control how blunt or supportive the model feels. - How OpenAI uses its own coding agent. Codex lets you schedule prompts to run on a recurring basis, and the team has dozens of automations running at all times. For example, one scans for merge conflicts every couple of hours so code is always ready to ship, and another picks a random file from the codebase multiple times a day and hunts for bugs no one would've gone looking for. - Why speed is a dimension of intelligence. OpenAI’s newest model (Spark) is so fast that they actually slow it down so you can read the output. They see the speed enabling three things: staying super in the flow, replacing brittle developer tools with intelligent ones that can adapt on the fly, and redirecting the model mid-task— especially with voice—so coding starts to feel more and more like a conversation. - Code review is the next bottleneck. Models can generate code faster than ever, but someone still has to verify that it works. The team is exploring a future where the model proves its own fix works—retracing the click path a user would take, screenshotting the results, and attaching the evidence to a pull request. This is a must-watch for anyone who uses AI coding agents—and is curious about the future of programming. Watch below! Timestamps: Introduction: 00:01:27 OpenAI’s evolving bet on its coding agent: 00:05:27 The choice to invest in a GUI (over a terminal): 00:09:42 The AI workflows that the Codex team relies on to ship: 00:20:38 Teaching Codex how to read between the lines: 00:26:45 Building affordances for a lightening fast model: 00:28:45 Why speed is a dimension of intelligence: 00:33:15 Code review is the next bottleneck for coding agents: 00:36:30 How the Codex team positions against the competition: 00:41:24

Dan Shipper 📧

15,588 views • 8 months ago