Загрузка видео...

Не удалось загрузить видео

На главную

How much better are models at coding now vs 2 years ago? Side by side coding performance from GPT-4 (June '23) to GPT-5 (Aug '25) with an identical prompt: "Create a single page HTML of a fruit machine simulation" Please watch the video until the end and tell me...

petergostev's profile picture

Peter Gostev (SF: 29 Mar - 3 Apr)

9,669 subscribers

123,593 просмотров • 9 месяцев назад •via X (Twitter)

Наука и технологииОбразование
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Sam Altman says the next big thrust is making models handle much longer tasks We have already moved from models handling 5-second coding tasks with GPT-3.5 to 5-hour tasks with GPT-5 The goal now is to integrate enterprise context so AI can handle tasks that require months or years
1:33

Sam Altman says the next big thrust is making models handle much longer tasks We have already moved from models handling 5-second coding tasks with GPT-3.5 to 5-hour tasks with GPT-5 The goal now is to integrate enterprise context so AI can handle tasks that require months or years

Haider.

122,717 просмотров • 6 месяцев назад

Kind of shocking how much better GPT-5-Codex is vs the regular 'Thinking' models in ChatGPT. My subjective rankings for the fruit machine test: 1. GPT-5-Codex-Medium 2. GPT-5-Thinking-Heavy 3. GPT-5-Pro 4. GPT-5-Codex-High 5. GPT-5-Codex-Low 6. GPT-5-Thinking-Standard 7. GPT-5-Thinking-Extended 8. GPT-5-Thinking-Light OpenAI Codex team have suggested 'Medium' should be the default, but I didn't expect that it would actually beat the 'High' setting model in my test.
0:44

Kind of shocking how much better GPT-5-Codex is vs the regular 'Thinking' models in ChatGPT. My subjective rankings for the fruit machine test: 1. GPT-5-Codex-Medium 2. GPT-5-Thinking-Heavy 3. GPT-5-Pro 4. GPT-5-Codex-High 5. GPT-5-Codex-Low 6. GPT-5-Thinking-Standard 7. GPT-5-Thinking-Extended 8. GPT-5-Thinking-Light OpenAI Codex team have suggested 'Medium' should be the default, but I didn't expect that it would actually beat the 'High' setting model in my test.

Peter Gostev

101,848 просмотров • 8 месяцев назад

GPT-4 Mini Game - Ghoul City - Version 1 🎮🤖 Ghoul City is a simple side-scrolling video game that I created entirely with GPT-4 and Midjourney. To create Ghoul City, I pretended to not have any coding background and instead let AI handle all of the coding and debugging. 🧵👇
0:43

GPT-4 Mini Game - Ghoul City - Version 1 🎮🤖 Ghoul City is a simple side-scrolling video game that I created entirely with GPT-4 and Midjourney. To create Ghoul City, I pretended to not have any coding background and instead let AI handle all of the coding and debugging. 🧵👇

Allen T.

282,905 просмотров • 3 лет назад

GPT-5 Thinking I like revisiting this prompt every now and then to see how much better models have gotten over time
0:27

GPT-5 Thinking I like revisiting this prompt every now and then to see how much better models have gotten over time

Angel Bogado 🌻

145,322 просмотров • 9 месяцев назад

Just tried vibecoding with ThreeJS again (after more than 6 months) and I have to say that the models have gotten much better at coding with ThreeJS and creating 3D models from scratch.
0:30

Just tried vibecoding with ThreeJS again (after more than 6 months) and I have to say that the models have gotten much better at coding with ThreeJS and creating 3D models from scratch.

Danny Limanseta

203,588 просмотров • 2 месяцев назад

Sam Altman says the leap from GPT-4 to GPT-5 will be as big as that of GPT-3 to 4 and the plan is to integrate the GPT and o series of models into one model that can do everything
0:57

Sam Altman says the leap from GPT-4 to GPT-5 will be as big as that of GPT-3 to 4 and the plan is to integrate the GPT and o series of models into one model that can do everything

Tsarathustra

224,102 просмотров • 1 год назад

.The Information Reporter Stephanie Palazzolo on OpenAI's GPT-5—a major step up for coding and what it means for competitors. "GPT-5 is a step up on a lot of different domains...one area that really stood out to [sources] was with coding." "Not only is GPT-5 better on more academic...tasks, but it's also better on the more practical programming tasks...working with very large and complex code bases." "If GPT-5 is going to be significantly better at these more practical everyday programming tasks, that could prove to be bad news for Anthropic." Watch the full episode on
2:54

.The Information Reporter Stephanie Palazzolo on OpenAI's GPT-5—a major step up for coding and what it means for competitors. "GPT-5 is a step up on a lot of different domains...one area that really stood out to [sources] was with coding." "Not only is GPT-5 better on more academic...tasks, but it's also better on the more practical programming tasks...working with very large and complex code bases." "If GPT-5 is going to be significantly better at these more practical everyday programming tasks, that could prove to be bad news for Anthropic." Watch the full episode on

The Information

52,067 просмотров • 10 месяцев назад

Spent the last few days vibe coding on my NVIDIA DGX Spark. Here's what I learned. Qwen 3.5 122B took one minute and nine seconds to respond "Hi how are you doing". Unusable for vibe coding. Gemma 4 was fast but built a dot instead of a first person shooter game. GPT-OSS 120B was the sweet spot. Fast, capable, and actually produced working HTML. Open source models running locally are not replacing Claude Opus 4.6 or Codex with GPT 5.4. Not even close. But they're getting better every month. The new DGX Spark Bench is live on Real-world benchmarks for local models on local hardware. This is just the start. Full video below.
21:03

Spent the last few days vibe coding on my NVIDIA DGX Spark. Here's what I learned. Qwen 3.5 122B took one minute and nine seconds to respond "Hi how are you doing". Unusable for vibe coding. Gemma 4 was fast but built a dot instead of a first person shooter game. GPT-OSS 120B was the sweet spot. Fast, capable, and actually produced working HTML. Open source models running locally are not replacing Claude Opus 4.6 or Codex with GPT 5.4. Not even close. But they're getting better every month. The new DGX Spark Bench is live on Real-world benchmarks for local models on local hardware. This is just the start. Full video below.

BridgeMind

54,982 просмотров • 1 месяц назад

Sam Altman says the leap from GPT-4 to GPT-5 will be as big as that of GPT-3 to 4 and the plan is to integrate the GPT and o series of models into one model that can do everything - that’s the AGI
0:55

Sam Altman says the leap from GPT-4 to GPT-5 will be as big as that of GPT-3 to 4 and the plan is to integrate the GPT and o series of models into one model that can do everything - that’s the AGI

Chubby♨️

231,773 просмотров • 1 год назад

The value produced by models is getting so much better so fast that old hardware is actually getting *more* expensive to rent. 3 years ago, the best model you could run on a H100 chip was GPT-4. Now, you can run GPT-5.4 on it, which is smaller and cheaper to run while producing much more valuable tokens. w. Dylan Patel
3:46

The value produced by models is getting so much better so fast that old hardware is actually getting *more* expensive to rent. 3 years ago, the best model you could run on a H100 chip was GPT-4. Now, you can run GPT-5.4 on it, which is smaller and cheaper to run while producing much more valuable tokens. w. Dylan Patel

Dwarkesh Patel

77,908 просмотров • 2 месяцев назад

GPT-5.2-high by OpenAI is off to a strong start in the Code Arena. ⚡️ If you’re new here: Code Arena is where AI models build full web apps, tools, and interactive sites — all from a single prompt. Watch the video to see GPT-5.2-high in action, then try your own prompt and reply with your creation below. ⬇️
1:24

GPT-5.2-high by OpenAI is off to a strong start in the Code Arena. ⚡️ If you’re new here: Code Arena is where AI models build full web apps, tools, and interactive sites — all from a single prompt. Watch the video to see GPT-5.2-high in action, then try your own prompt and reply with your creation below. ⬇️

Arena.ai

246,068 просмотров • 5 месяцев назад

here's a side by side comparison of a ray-tracing simulator by gpt-5 and claude 4.1 (opus) gpt-5 one-shotted this. claude genuinely blew me away with how badly it failed (and you all know how much i like claude)
1:42

here's a side by side comparison of a ray-tracing simulator by gpt-5 and claude 4.1 (opus) gpt-5 one-shotted this. claude genuinely blew me away with how badly it failed (and you all know how much i like claude)

Riley Coyote

42,687 просмотров • 9 месяцев назад

OpenAI researcher, Michelle Pokrass: the challenge in building GPT‑5 is finding the right balance between reasoning and conversation. o3 thinks hard, but it isn't ideal for casual chat. GPT‑4.1 improved at coding by sacrificing some chit-chat quality. now, the goal is to train a model that knows when to think hard and when to talk
0:45

OpenAI researcher, Michelle Pokrass: the challenge in building GPT‑5 is finding the right balance between reasoning and conversation. o3 thinks hard, but it isn't ideal for casual chat. GPT‑4.1 improved at coding by sacrificing some chit-chat quality. now, the goal is to train a model that knows when to think hard and when to talk

Haider.

195,733 просмотров • 1 год назад

GPT-5 is 25x cheaper than GPT-4 at launch It raced to billions of tokens/minute within 2 hours of launch I talked to OpenAI's Olivier Godement about: • GPT-5, gpt-oss, and OpenAI's release strategy • How open-source models solve the enterprise puzzle • The fastest tech adoption in recent memory Check out our full conversation below:
57:14

GPT-5 is 25x cheaper than GPT-4 at launch It raced to billions of tokens/minute within 2 hours of launch I talked to OpenAI's Olivier Godement about: • GPT-5, gpt-oss, and OpenAI's release strategy • How open-source models solve the enterprise puzzle • The fastest tech adoption in recent memory Check out our full conversation below:

Zain Kahn

438,660 просмотров • 9 месяцев назад

Three years ago, Gemini started by understanding the world. With Gemini 2, models learned to think and reason. Late last year, Gemini 3 brought any idea to life. Today, we’re continuing that journey with our Gemini 3.5 series, starting with Gemini 3.5 Flash, delivering frontier performance for agents and coding.
1:01

Three years ago, Gemini started by understanding the world. With Gemini 2, models learned to think and reason. Late last year, Gemini 3 brought any idea to life. Today, we’re continuing that journey with our Gemini 3.5 series, starting with Gemini 3.5 Flash, delivering frontier performance for agents and coding.

Google AI

68,210 просмотров • 17 дней назад

🚀Introducing Code Arena: the next generation of live coding evals for frontier AI models. Built to test how models plan, scaffold, debug, and build real web apps step-by-step. Try Claude, GPT-5, GLM-4.6 and Gemini in Code Arena today!
0:56

🚀Introducing Code Arena: the next generation of live coding evals for frontier AI models. Built to test how models plan, scaffold, debug, and build real web apps step-by-step. Try Claude, GPT-5, GLM-4.6 and Gemini in Code Arena today!

Arena.ai

327,208 просмотров • 6 месяцев назад

Had early access to GPT-5.4 and Pro. They are very good. One fun illustration of progress, this is the same prompt I used in GPT-4 below (making a 3D space inspired by Piranesi) now in GPT-5.4 Pro. There were no errors, made in a single prompt plus one to "make it better."
0:28

Had early access to GPT-5.4 and Pro. They are very good. One fun illustration of progress, this is the same prompt I used in GPT-4 below (making a 3D space inspired by Piranesi) now in GPT-5.4 Pro. There were no errors, made in a single prompt plus one to "make it better."

Ethan Mollick

188,297 просмотров • 3 месяцев назад

GPT-5 thinking has been incredible at coding so far i'm not a big fan of vibe coding, but just tried a "browser OS" test in one shot - gemini 2.5 pro failed - claude 4.1 handled flow better, but not as good overall - gpt-5 nailed it, and added all the standard features DEMO 👇
1:34

GPT-5 thinking has been incredible at coding so far i'm not a big fan of vibe coding, but just tried a "browser OS" test in one shot - gemini 2.5 pro failed - claude 4.1 handled flow better, but not as good overall - gpt-5 nailed it, and added all the standard features DEMO 👇

Haider.

43,656 просмотров • 10 месяцев назад

AI has its PhD and now it’s on the job market. Introducing the AI Productivity Index (APEX), a benchmark that measures how well we’ve automated the most valuable industries in the world. Most benchmarks study abstract capabilities. APEX evaluates model performance on real deliverables across law, finance, consulting, and medicine. The models most capable of doing work today, according to APEX: 🥇 GPT 5 🥈 Grok 4 🥉 Gemini 2.5 Flash Other findings: - GPT 5 demonstrates the strongest performance across all 4 domains - Some cheaper models outperform more expensive models from the same provider (e.g. Gemini 2.5 Flash vs. Gemini 2.5 Pro) - The best open source model, Qwen (7th), performs only 2% behind Grok 4 overall
1:44

AI has its PhD and now it’s on the job market. Introducing the AI Productivity Index (APEX), a benchmark that measures how well we’ve automated the most valuable industries in the world. Most benchmarks study abstract capabilities. APEX evaluates model performance on real deliverables across law, finance, consulting, and medicine. The models most capable of doing work today, according to APEX: 🥇 GPT 5 🥈 Grok 4 🥉 Gemini 2.5 Flash Other findings: - GPT 5 demonstrates the strongest performance across all 4 domains - Some cheaper models outperform more expensive models from the same provider (e.g. Gemini 2.5 Flash vs. Gemini 2.5 Pro) - The best open source model, Qwen (7th), performs only 2% behind Grok 4 overall

Brendan (can/do)

451,298 просмотров • 8 месяцев назад

Free GPT-5.3-Codex in Orchids! One of the best coding models in the world right now. > Connect your ChatGPT subscription. > Select GPT-5.3-Codex. > Done, no Orchids credits will be consumed. The best way to build any app at orchids [dot] app.
0:37

Free GPT-5.3-Codex in Orchids! One of the best coding models in the world right now. > Connect your ChatGPT subscription. > Select GPT-5.3-Codex. > Done, no Orchids credits will be consumed. The best way to build any app at orchids [dot] app.

Bud

24,048 просмотров • 3 месяцев назад