正在加载视频...

视频加载失败

OpenAI Chief Research Officer, Mark Chen "We've found a new paradigm through Reasoning, which we're also scaling" - GPT-5 could be a significant advancement because we're scaling models not just through unsupervised learning (like with GPT-4.5), but also through a new "reasoning paradigm" - GPT-5 maybe a combination of...

153,382 次观看 • 1 年前 •via X (Twitter)

12 条评论

Rand 的头像
Rand1 年前

so why even release 4.5, just give us 5

Rainmaker 的头像
Rainmaker2 年前

Can Machine Learning handle volatile markets? Find out in my latest free Substack post! Explore how a Hidden Markov Model (HMM) can navigate market fluctuations and protect your investments. Full code and practical insights are shared.

Yossi Dahan 的头像
Yossi Dahan1 年前

OAI felt the pressure to drop this teaser after the chaotic GPT-4.5 release - just to signal ‘we’re still in the game.’ Cool, we’ll see about that. Wishing them luck.

Julian Shalaby 的头像
Julian Shalaby1 年前

After GPT 4.5 I have no hope left in OpenAI. I wouldn’t have been impressed with GPT 4.5 in 2023 even

Haider. 的头像
Haider.1 年前

be patient 👀

Tom Boyle 的头像
Tom Boyle1 年前

A hybrid of unsupervised learning and reasoning seems crucial for more nuanced models like GPT-5.

Charli 的头像
Charli1 年前

Pretty sure pure RL and unsupervised learning are the future. As Google said: SFT memorises RL generalises. Less about making humans happy more about actually learning, like AlphaGo and move 37

Justin 的头像
Justin1 年前

Hmm. I don't think they will further scale o3 and release that as part of GPT-5. But I could be wrong. GPT-5 will probably mostly be GPT4o. Maybe even 4o-Mini. Most questions are easy so they will use the easier models on them. For the hard questions, they'll use Reasoners (usually Mini versions). If they architect really well, they will have GPT45 give initial data & info, paired with search, before kicking to another model. What I'm concerned about is they may practically never use o3+Gpt4.5 fully together. Instead, o3 will just use GPT4o. I think it will just be too expensive for the rest of the year. Tbd.

Jo 的头像
Jo1 年前

when you scale a model by 10x compute like 4?5 for it to barely be better than 4 and even sometimes worse its not scaling anymore, its time to aknowledge that pretraining hit a wall and its time to find a newer architecture or you're just scamming investors at this point

Jay Ballentine 的头像
Jay Ballentine1 年前

They’ve lost all their credibility after 4.5. We should just ignore them from now on.

Alex Kantrowitz 的头像
Alex Kantrowitz1 年前

Full interview here for those interested!

Haider. 的头像
Haider.1 年前

great interview, alex... i watched every tech-based interview from your channel

相关视频

The DEPRESSING reality of AI adoption curves Advanced AI just broke into it's third major paradigm since launching. Paradigm One was the simple autocomplete engine. GPT-2 and original GPT-3 were glorified autocomplete tools, just "next token predictors." Paradigm 1.5 was when we added "instruct-aligned" GPT-3, which set the stage for Paradigm Two. Paradigm Two was the chatbot era, with ChatGPT being the front-runner. Paradigm 2.5 was when we started adding reasoning, tool use, and RAG, which set the stage for agentic abilities (Paradigm 3). OpenClaw just blew the lid off Paradigm 3, and we're just at the beginning of this new ramp-up in capabilities. The thing is... each of these paradigm shifts creates fundamentally different UX and technical affordances. While most Fortune 500 companies are still struggling to figure out the cyber security, legal, and financial risks of chatbots, the industry is going whole hog into autonomous agents. And many people will try to graft their understanding of chatbots onto agents. But that's like trying to compare the electric lightbulb to the electric motor.... ...yes they both ran on electricity, but their uses, affordances, limitations, and risks were fundamentally different. Yes, autocomplete, chatbots, and agents all run on "next token prediction" but that's like saying "it all runs on electrons." My goal today is to help give you a better intuition as to why adoption is so slow and to give you a new reference frame to understand that agents are a phase change from chatbots. But also... the state and big companies are going to move depressingly slow on all of this...

David Shapiro (L/0)

17,266 次观看 • 5 个月前

GPT-5.6 vs GPT-5.5 on my custom spaceship prompt. I gave both models the exact same custom prompt. This is also the same prompt I previously gave to Fable 5. For context, GPT-5.6 Pro worked for 87 minutes, while GPT-5.5 Extra High worked for 34 minutes and 42 seconds. As I’ve said before, based on great authority GPT-5.6 will be an incremental/soldi improvement over GPT-5.5, not a “Fable killer.” My rough expectation has been that it would trade blows with Fable 5 on some benchmarks, maybe win around half depending on the category, but not clearly surpass it overall. And again fable five will have bigger model smell, but this was expected. After testing this coding output, that view feels pretty accurate. GPT-5.6 is clearly better than GPT-5.5 in several visual areas. The lighting, shading, chairs, object details, and exterior of the spaceship looked noticeably stronger. The scene was also easier to test. I do want to give GPT-5.5 credit though. It built out the rooms much much better and the planets looked better than GPT-5.6’s. It was also interesting that both GPT-5.5 and GPT-5.6 produced better-looking planets than Fable 5 in this specific test. The downside with GPT-5.5 was stability. The game was much glitchier and harder to test compared to GPT-5.6. But when it comes to the core of the demo, which is the spaceship itself, Fable 5 still beat both models pretty comfortably. GPT-5.6 is impressive, but from this test, it looks exactly like what I expected which was a meaningful incremental improvement over GPT-5.5, at least for indie game demos, but not something that replaces Fable 5. In collaboration with Chetaslua

Chris

250,150 次观看 • 1 个月前