Loading video...

Video Failed to Load

Go Home

OpenAI Chief Research Officer, Mark Chen "We've found a new paradigm through Reasoning, which we're also scaling" - GPT-5 could be a significant advancement because we're scaling models not just through unsupervised learning (like with GPT-4.5), but also through a new "reasoning paradigm" - GPT-5 maybe a combination of...

153,382 views • 1 year ago •via X (Twitter)

12 Comments

Rand's profile picture
Rand1 year ago

so why even release 4.5, just give us 5

Rainmaker's profile picture
Rainmaker2 years ago

Can Machine Learning handle volatile markets? Find out in my latest free Substack post! Explore how a Hidden Markov Model (HMM) can navigate market fluctuations and protect your investments. Full code and practical insights are shared.

Yossi Dahan's profile picture
Yossi Dahan1 year ago

OAI felt the pressure to drop this teaser after the chaotic GPT-4.5 release - just to signal ‘we’re still in the game.’ Cool, we’ll see about that. Wishing them luck.

Julian Shalaby's profile picture
Julian Shalaby1 year ago

After GPT 4.5 I have no hope left in OpenAI. I wouldn’t have been impressed with GPT 4.5 in 2023 even

Haider.'s profile picture
Haider.1 year ago

be patient 👀

Tom Boyle's profile picture
Tom Boyle1 year ago

A hybrid of unsupervised learning and reasoning seems crucial for more nuanced models like GPT-5.

Charli's profile picture
Charli1 year ago

Pretty sure pure RL and unsupervised learning are the future. As Google said: SFT memorises RL generalises. Less about making humans happy more about actually learning, like AlphaGo and move 37

Justin's profile picture
Justin1 year ago

Hmm. I don't think they will further scale o3 and release that as part of GPT-5. But I could be wrong. GPT-5 will probably mostly be GPT4o. Maybe even 4o-Mini. Most questions are easy so they will use the easier models on them. For the hard questions, they'll use Reasoners (usually Mini versions). If they architect really well, they will have GPT45 give initial data & info, paired with search, before kicking to another model. What I'm concerned about is they may practically never use o3+Gpt4.5 fully together. Instead, o3 will just use GPT4o. I think it will just be too expensive for the rest of the year. Tbd.

Jo's profile picture
Jo1 year ago

when you scale a model by 10x compute like 4?5 for it to barely be better than 4 and even sometimes worse its not scaling anymore, its time to aknowledge that pretraining hit a wall and its time to find a newer architecture or you're just scamming investors at this point

Jay Ballentine's profile picture
Jay Ballentine1 year ago

They’ve lost all their credibility after 4.5. We should just ignore them from now on.

Alex Kantrowitz's profile picture
Alex Kantrowitz1 year ago

Full interview here for those interested!

Haider.'s profile picture
Haider.1 year ago

great interview, alex... i watched every tech-based interview from your channel

Related Videos

The DEPRESSING reality of AI adoption curves Advanced AI just broke into it's third major paradigm since launching. Paradigm One was the simple autocomplete engine. GPT-2 and original GPT-3 were glorified autocomplete tools, just "next token predictors." Paradigm 1.5 was when we added "instruct-aligned" GPT-3, which set the stage for Paradigm Two. Paradigm Two was the chatbot era, with ChatGPT being the front-runner. Paradigm 2.5 was when we started adding reasoning, tool use, and RAG, which set the stage for agentic abilities (Paradigm 3). OpenClaw just blew the lid off Paradigm 3, and we're just at the beginning of this new ramp-up in capabilities. The thing is... each of these paradigm shifts creates fundamentally different UX and technical affordances. While most Fortune 500 companies are still struggling to figure out the cyber security, legal, and financial risks of chatbots, the industry is going whole hog into autonomous agents. And many people will try to graft their understanding of chatbots onto agents. But that's like trying to compare the electric lightbulb to the electric motor.... ...yes they both ran on electricity, but their uses, affordances, limitations, and risks were fundamentally different. Yes, autocomplete, chatbots, and agents all run on "next token prediction" but that's like saying "it all runs on electrons." My goal today is to help give you a better intuition as to why adoption is so slow and to give you a new reference frame to understand that agents are a phase change from chatbots. But also... the state and big companies are going to move depressingly slow on all of this...

David Shapiro (L/0)

17,266 views • 5 months ago

GPT-5.6 vs GPT-5.5 on my custom spaceship prompt. I gave both models the exact same custom prompt. This is also the same prompt I previously gave to Fable 5. For context, GPT-5.6 Pro worked for 87 minutes, while GPT-5.5 Extra High worked for 34 minutes and 42 seconds. As I’ve said before, based on great authority GPT-5.6 will be an incremental/soldi improvement over GPT-5.5, not a “Fable killer.” My rough expectation has been that it would trade blows with Fable 5 on some benchmarks, maybe win around half depending on the category, but not clearly surpass it overall. And again fable five will have bigger model smell, but this was expected. After testing this coding output, that view feels pretty accurate. GPT-5.6 is clearly better than GPT-5.5 in several visual areas. The lighting, shading, chairs, object details, and exterior of the spaceship looked noticeably stronger. The scene was also easier to test. I do want to give GPT-5.5 credit though. It built out the rooms much much better and the planets looked better than GPT-5.6’s. It was also interesting that both GPT-5.5 and GPT-5.6 produced better-looking planets than Fable 5 in this specific test. The downside with GPT-5.5 was stability. The game was much glitchier and harder to test compared to GPT-5.6. But when it comes to the core of the demo, which is the spaceship itself, Fable 5 still beat both models pretty comfortably. GPT-5.6 is impressive, but from this test, it looks exactly like what I expected which was a meaningful incremental improvement over GPT-5.5, at least for indie game demos, but not something that replaces Fable 5. In collaboration with Chetaslua

Chris

249,713 views • 1 month ago