Loading video...
Video Failed to Load
OpenAI Chief Research Officer, Mark Chen "We've found a new paradigm through Reasoning, which we're also scaling" - GPT-5 could be a significant advancement because we're scaling models not just through unsupervised learning (like with GPT-4.5), but also through a new "reasoning paradigm" - GPT-5 maybe a combination of... show more
153,382 views • 1 year ago •via X (Twitter)
12 Comments

so why even release 4.5, just give us 5

Can Machine Learning handle volatile markets? Find out in my latest free Substack post! Explore how a Hidden Markov Model (HMM) can navigate market fluctuations and protect your investments. Full code and practical insights are shared.

OAI felt the pressure to drop this teaser after the chaotic GPT-4.5 release - just to signal ‘we’re still in the game.’ Cool, we’ll see about that. Wishing them luck.

After GPT 4.5 I have no hope left in OpenAI. I wouldn’t have been impressed with GPT 4.5 in 2023 even

be patient 👀

A hybrid of unsupervised learning and reasoning seems crucial for more nuanced models like GPT-5.

Pretty sure pure RL and unsupervised learning are the future. As Google said: SFT memorises RL generalises. Less about making humans happy more about actually learning, like AlphaGo and move 37

Hmm. I don't think they will further scale o3 and release that as part of GPT-5. But I could be wrong. GPT-5 will probably mostly be GPT4o. Maybe even 4o-Mini. Most questions are easy so they will use the easier models on them. For the hard questions, they'll use Reasoners (usually Mini versions). If they architect really well, they will have GPT45 give initial data & info, paired with search, before kicking to another model. What I'm concerned about is they may practically never use o3+Gpt4.5 fully together. Instead, o3 will just use GPT4o. I think it will just be too expensive for the rest of the year. Tbd.

when you scale a model by 10x compute like 4?5 for it to barely be better than 4 and even sometimes worse its not scaling anymore, its time to aknowledge that pretraining hit a wall and its time to find a newer architecture or you're just scamming investors at this point

They’ve lost all their credibility after 4.5. We should just ignore them from now on.

Full interview here for those interested!

great interview, alex... i watched every tech-based interview from your channel


![.The Information Reporter Stephanie Palazzolo on OpenAI's GPT-5—a major step up for coding and what it means for competitors. "GPT-5 is a step up on a lot of different domains...one area that really stood out to [sources] was with coding." "Not only is GPT-5 better on more academic...tasks, but it's also better on the more practical programming tasks...working with very large and complex code bases." "If GPT-5 is going to be significantly better at these more practical everyday programming tasks, that could prove to be bad news for Anthropic." Watch the full episode on](https://image.24vids.com/tw-1949939680352280764/media/Gw-Tya4WIAErK5E.jpg)