Loading video...

Video Failed to Load

Go Home

OpenAI are testing a new model on the Web Dev Arena Arena under the name 'Anonymous Chatbot 0717'. I can't believe I'm gonna say this, but it is genuinely at a completely different level of front end coding - far better than Sonnet, o3, Gemini 2.5 Pro, or Grok...

petergostev's profile picture

Peter Gostev

11,815 subscribers

495,815 views • 11 months ago •via X (Twitter)

Science & TechnologyNews & PoliticsEducation
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

i keep hearing about how GLM-5.2 not only is great at coding but also that is on Opus 4.8 level when it comes to front end design I wanted to find out so... i put it to the test.. you can be the judge
1:07

i keep hearing about how GLM-5.2 not only is great at coding but also that is on Opus 4.8 level when it comes to front end design I wanted to find out so... i put it to the test.. you can be the judge

Hermes Agent Tips

70,973 views • 21 days ago

The LM Arena source and the “anonymous-chatbot-0717” tag reads o3 alpha responses 2025 07 17. O3 Alpha is live in stealth. I have a suspicion that it’s the same model that snatched second in the coding comp, It’s one-shotting every task. Doubt it is the incoming ChatGPT agent; if it were, I feel as if OpenAI would be parading full coding benchmark flexes by now. Just look at this thing one shot a Minecraft replica 👇
0:51

The LM Arena source and the “anonymous-chatbot-0717” tag reads o3 alpha responses 2025 07 17. O3 Alpha is live in stealth. I have a suspicion that it’s the same model that snatched second in the coding comp, It’s one-shotting every task. Doubt it is the incoming ChatGPT agent; if it were, I feel as if OpenAI would be parading full coding benchmark flexes by now. Just look at this thing one shot a Minecraft replica 👇

Chris

22,234 views • 11 months ago

I have been testing “OpenAI” o3 mini-high. The exposure of the “reasoning” on this model in my tests seem to not be the full reasoning, but a shifted and edited and tunicated version of what we would expect from a full exposure of the reasoning engine. See the video on the left. One can compare this to my FREE Open Source local newly quantized and distilled DeepSeek R1 8b (llama). See the video on the right. Clearly we see the full reading with DeepSeek R1 and something well tunicates with o3 mini-high (getting mad typing that name folks). Compare the quality of the outputs and the reasoning insights. Frankly there is no comparison. It feels like “OpenAI” begrudgingly released the reasoning output because they had to, but gave us something of a simulated reasoning and not the actual one. Of course my local lap top running an 8b model is slower, but all of the outputs and the actual creative writing is superior on the FREE model. The reasoning output, when legitimate can be many times more valuable than the answer. In the past week I have found thousands of ways to use in in many projects. Thus far I would have been far more impressed with o3 mini if I have never seen DeepSeek. However today it is too little—too late. The prompt: “Write a very creative and funny story on a pig and butterfly as friends living on Mars.”
1:45

I have been testing “OpenAI” o3 mini-high. The exposure of the “reasoning” on this model in my tests seem to not be the full reasoning, but a shifted and edited and tunicated version of what we would expect from a full exposure of the reasoning engine. See the video on the left. One can compare this to my FREE Open Source local newly quantized and distilled DeepSeek R1 8b (llama). See the video on the right. Clearly we see the full reading with DeepSeek R1 and something well tunicates with o3 mini-high (getting mad typing that name folks). Compare the quality of the outputs and the reasoning insights. Frankly there is no comparison. It feels like “OpenAI” begrudgingly released the reasoning output because they had to, but gave us something of a simulated reasoning and not the actual one. Of course my local lap top running an 8b model is slower, but all of the outputs and the actual creative writing is superior on the FREE model. The reasoning output, when legitimate can be many times more valuable than the answer. In the past week I have found thousands of ways to use in in many projects. Thus far I would have been far more impressed with o3 mini if I have never seen DeepSeek. However today it is too little—too late. The prompt: “Write a very creative and funny story on a pig and butterfly as friends living on Mars.”

Brian Roemmele

74,506 views • 1 year ago

Introducing `gpt-oss Pro Mode`! Basically o3 Pro, but for the new OpenAI open source models :) Pro Mode chains together up to 10 instances of the new OpenAI GPT-OSS model, enabling it to produce a better answer than one instance alone could create! Open source, link here:
0:21

Introducing `gpt-oss Pro Mode`! Basically o3 Pro, but for the new OpenAI open source models :) Pro Mode chains together up to 10 instances of the new OpenAI GPT-OSS model, enabling it to produce a better answer than one instance alone could create! Open source, link here:

Matt Shumer

315,683 views • 11 months ago

Opus 4.5 (new model from Anthropic) can do something no model could do until now: It can close the design loop. This is (in my testing) the first model that can reliably do the visual loop of Generate Code ⇛ Render ⇛ Look at it ⇛ Improve. Step 3 (Visual critique) has been a real problem for so long. Models will be myopic or defensive when reviewing designs - it's been hard to tell if this has been a training or a vision problem. Opus 4.5 seems to have fixed it - it's not amazing, but it finally *can* do it. Claude models have historically (once again, in my testing) lagged behind in terms of visual understanding. Gemini for the last year has been the best - but there might be a new leader.
10:06

Opus 4.5 (new model from Anthropic) can do something no model could do until now: It can close the design loop. This is (in my testing) the first model that can reliably do the visual loop of Generate Code ⇛ Render ⇛ Look at it ⇛ Improve. Step 3 (Visual critique) has been a real problem for so long. Models will be myopic or defensive when reviewing designs - it's been hard to tell if this has been a training or a vision problem. Opus 4.5 seems to have fixed it - it's not amazing, but it finally *can* do it. Claude models have historically (once again, in my testing) lagged behind in terms of visual understanding. Gemini for the last year has been the best - but there might be a new leader.

Hrishi

57,822 views • 7 months ago

GPT-5 Pro is genuinely a top tier model, it is the best. I know some GPT-5 reactions have been mixed (including from me), but OpenAI has made great strides with Pro. I have made 12 simulations that no other model would match, not from OpenAI, Google, xAI or Anthropic. All of them were 1-3 shots (mostly to fix small issues) and the output is really outstanding. OpenAI Developers
1:35

GPT-5 Pro is genuinely a top tier model, it is the best. I know some GPT-5 reactions have been mixed (including from me), but OpenAI has made great strides with Pro. I have made 12 simulations that no other model would match, not from OpenAI, Google, xAI or Anthropic. All of them were 1-3 shots (mostly to fix small issues) and the output is really outstanding. OpenAI Developers

Peter Gostev

58,631 views • 11 months ago

Got introduced to , an AI code assistant specialised for Unity by Julian Park and after dabbling with it for a day, I am really impressed with how good it is for vibe coding on the Unity Game Engine. Bezi early impressions: - Bezi works direcly on Unity with a Plugin, this means that I don't need a Unity MCP - Because Bezi is built for Unity, the success rate of feature implementations is visibly higher than general coding models - It was able to integrate Unity store assets like a Weather system to this game pretty seamlessly - I was able to add a fishing database, lighting and weather systems into this game fairly quickly I'm very impressed with the results with Bezi so far. I feel that vibe coding a full indie game on Unity and releasing it on Steam, Mobile and Web is within reach. This also validates one thing that I have been suspecting: A specialised model designed for a specific use case can perform better than a general model at the particular domain. Very exciting!
0:30

Got introduced to , an AI code assistant specialised for Unity by Julian Park and after dabbling with it for a day, I am really impressed with how good it is for vibe coding on the Unity Game Engine. Bezi early impressions: - Bezi works direcly on Unity with a Plugin, this means that I don't need a Unity MCP - Because Bezi is built for Unity, the success rate of feature implementations is visibly higher than general coding models - It was able to integrate Unity store assets like a Weather system to this game pretty seamlessly - I was able to add a fishing database, lighting and weather systems into this game fairly quickly I'm very impressed with the results with Bezi so far. I feel that vibe coding a full indie game on Unity and releasing it on Steam, Mobile and Web is within reach. This also validates one thing that I have been suspecting: A specialised model designed for a specific use case can perform better than a general model at the particular domain. Very exciting!

Danny Limanseta

48,991 views • 3 months ago

OpenAI Research Chief, Mark Chen: Gemini 3 is a pretty good model, but benchmarks only show part of the picture We already have internal models performing at the same level as Gemini 3, and even better successors are planned for release soon
0:36

OpenAI Research Chief, Mark Chen: Gemini 3 is a pretty good model, but benchmarks only show part of the picture We already have internal models performing at the same level as Gemini 3, and even better successors are planned for release soon

Haider.

54,231 views • 7 months ago

🚨 New Models Alert: WebDev 💻 GPT-5-Codex and Qwen3-Coder-Plus are both now available on WebDev Arena! In the WebDev Arena, you can test out all the best frontier AI coding models on web development tasks. Vote for your preferred response and see how they stack up on the leaderboard. Prompt: "build a 90s inspired resume website for "Ella Marina", she is a front end web developer with a love for Lisa Frank and late 1990s R&B music. She works on front end development at LMArena"
0:24

🚨 New Models Alert: WebDev 💻 GPT-5-Codex and Qwen3-Coder-Plus are both now available on WebDev Arena! In the WebDev Arena, you can test out all the best frontier AI coding models on web development tasks. Vote for your preferred response and see how they stack up on the leaderboard. Prompt: "build a 90s inspired resume website for "Ella Marina", she is a front end web developer with a love for Lisa Frank and late 1990s R&B music. She works on front end development at LMArena"

Arena.ai

21,096 views • 9 months ago

Jason Calacanis: Anthropic, OpenAI and others are trying to kill OpenClaw Why? Because an open source agent platform is an existential threat to frontier model companies. @jason: “ People are going to say I'm a conspiracy theorist, but the number one goal, I believe, in the large language model, frontier model space, is to kill (OpenClaw). This is a giant movement to stop it, because this is the equivalent of having an open source Android-like player in the market, and that could be incredibly disruptive. Because, I believe, open source is going to win the day on the large language models and take 90% of the token usage, and I think the entire frontier model space could be undercut by open source. And I think they realize that SLMs, the smaller language models that are verticalized now, that will run on desktops and laptops and are even starting to run on the top ones, that is their biggest competitive threat, and I hope it happens.”
0:41

Jason Calacanis: Anthropic, OpenAI and others are trying to kill OpenClaw Why? Because an open source agent platform is an existential threat to frontier model companies. @jason: “ People are going to say I'm a conspiracy theorist, but the number one goal, I believe, in the large language model, frontier model space, is to kill (OpenClaw). This is a giant movement to stop it, because this is the equivalent of having an open source Android-like player in the market, and that could be incredibly disruptive. Because, I believe, open source is going to win the day on the large language models and take 90% of the token usage, and I think the entire frontier model space could be undercut by open source. And I think they realize that SLMs, the smaller language models that are verticalized now, that will run on desktops and laptops and are even starting to run on the top ones, that is their biggest competitive threat, and I hope it happens.”

The All-In Podcast

64,267 views • 3 months ago

After a couple more days with Composer 2.5, I've got a pretty good sense of what it can do for game dev, specifically this mouse cursor racing game I'm building. It nailed ~80% of the features I threw at it, from planning to execution. Pretty amazing. I did have to switch to Opus 4.7 MAX a few times for features that need stronger visual understanding, like adding a 360 loop to the track or nailing a specific visual effect I had in mind. But man, Opus 4.7 MAX is expensive. Composer 2.5's visual understanding is weaker than Opus 4.7, but for most other things it's pretty damn close, and 10x cheaper. So it's now my default. The beauty of Cursor is I can switch models whenever I want, so I'm never stuck on one. Really excited for the larger incoming model. I have a feeling it's going to shine at planning. Can't wait!
0:59

After a couple more days with Composer 2.5, I've got a pretty good sense of what it can do for game dev, specifically this mouse cursor racing game I'm building. It nailed ~80% of the features I threw at it, from planning to execution. Pretty amazing. I did have to switch to Opus 4.7 MAX a few times for features that need stronger visual understanding, like adding a 360 loop to the track or nailing a specific visual effect I had in mind. But man, Opus 4.7 MAX is expensive. Composer 2.5's visual understanding is weaker than Opus 4.7, but for most other things it's pretty damn close, and 10x cheaper. So it's now my default. The beauty of Cursor is I can switch models whenever I want, so I'm never stuck on one. Really excited for the larger incoming model. I have a feeling it's going to shine at planning. Can't wait!

Danny Limanseta

171,643 views • 1 month ago

I am testing the amazing Enoch by Mike HealthRanger and team and it is absolutely amazing. A free local AI built on a far wider field of wisdom. My goal: get it to run offline on an iPhone! I am quantizing the model to an aggressive 2-bit level using Q2_K or Q4_K_M. We lose some resolution but we gain portability to any device. The full free version is still small but requires more hefty hardware. But look at this emergency nuclear Fallout response. The keeper-of-the-status-quo Wikipedia types would have you suffer with limited crude ways to react. This response is stellar and will save your life. I will be working on the quantized version and if it is worthy release it for free on the MIT license like the larger Enoch. I will also incorporate this model with all of my other free models as it is a goldmine of astonishing work. Thank you Mike amazing work sir.
2:25

I am testing the amazing Enoch by Mike HealthRanger and team and it is absolutely amazing. A free local AI built on a far wider field of wisdom. My goal: get it to run offline on an iPhone! I am quantizing the model to an aggressive 2-bit level using Q2_K or Q4_K_M. We lose some resolution but we gain portability to any device. The full free version is still small but requires more hefty hardware. But look at this emergency nuclear Fallout response. The keeper-of-the-status-quo Wikipedia types would have you suffer with limited crude ways to react. This response is stellar and will save your life. I will be working on the quantized version and if it is worthy release it for free on the MIT license like the larger Enoch. I will also incorporate this model with all of my other free models as it is a goldmine of astonishing work. Thank you Mike amazing work sir.

Brian Roemmele

66,592 views • 8 months ago

Most voice models are great at cloning voices, but they still manage to erase the person. I have an accent. Voice models don't know how to preserve it. Whenever I clone my voice, models get the words right, but mess up the rhythm badly. They flatten my vowels, and everything drifts toward a generic American accent. I'm attaching one example from Mirage. This is the first model I have heard of that can reproduce access as-is. • My accent stays intact, even when speaking English and Spanish • My pacing and cadence feel intentional, not averaged • The expressivity of my voice comes through Best part: Mirage only needs a short sample of your voice to clone it. I think this solves the hard part of voice cloning: intelligibility is easy, but identity is what makes a huge difference. Listen to the attached sample, and you'll notice the difference if you compare it with any other model out there. If you want to try this out, check out this link: Thanks to the Mirage team for collaborating with me on this post.
0:21

Most voice models are great at cloning voices, but they still manage to erase the person. I have an accent. Voice models don't know how to preserve it. Whenever I clone my voice, models get the words right, but mess up the rhythm badly. They flatten my vowels, and everything drifts toward a generic American accent. I'm attaching one example from Mirage. This is the first model I have heard of that can reproduce access as-is. • My accent stays intact, even when speaking English and Spanish • My pacing and cadence feel intentional, not averaged • The expressivity of my voice comes through Best part: Mirage only needs a short sample of your voice to clone it. I think this solves the hard part of voice cloning: intelligibility is easy, but identity is what makes a huge difference. Listen to the attached sample, and you'll notice the difference if you compare it with any other model out there. If you want to try this out, check out this link: Thanks to the Mirage team for collaborating with me on this post.

Santiago

31,245 views • 6 months ago

"AIM-120 D3..that actually should have been a completely different variant so E or F model..I worked in one of the units that was doing the test..everything is new in this missile..everything about it is different." ~ MIke B The Merge 🇺🇲 Follow & subscribe to the podcast👇
1:04

"AIM-120 D3..that actually should have been a completely different variant so E or F model..I worked in one of the units that was doing the test..everything is new in this missile..everything about it is different." ~ MIke B The Merge 🇺🇲 Follow & subscribe to the podcast👇

AirPower | MIL-STD

43,437 views • 2 years ago

BREAKING 🚨 OpenAI new model o3 Alpha is INSANE 🔥 - Rank 2 in world hardest coding competition behind Psyho (pending confirmation by oai) - best coding and physics model - beaten o3 pro - great web dev skills - one prompt creation of minecraft and GTA Watch the amazing demos to believe it. Did Sam Altman sneak in a sliver of GPT-5 to show what’s coming soon?
0:22

BREAKING 🚨 OpenAI new model o3 Alpha is INSANE 🔥 - Rank 2 in world hardest coding competition behind Psyho (pending confirmation by oai) - best coding and physics model - beaten o3 pro - great web dev skills - one prompt creation of minecraft and GTA Watch the amazing demos to believe it. Did Sam Altman sneak in a sliver of GPT-5 to show what’s coming soon?

Prashant

18,713 views • 11 months ago

I joined OpenAI at the beginning of the year -- partly because I was excited about the possibility of better voice interaction with computers. So it was *especially* amazing to work with the team here on the gpt-4o model launch. It's hard to grok until you try it how big of a step forward this is for human/computer voice communication. It feels different -- it's obvious that the model understands you better than anything you've used before. This is my favorite demo of gpt-4o, it demonstrates not just good stt/tts, but actual conversational ability over full, realistic phone call. It's so obvious how useful this will be!
2:13

I joined OpenAI at the beginning of the year -- partly because I was excited about the possibility of better voice interaction with computers. So it was *especially* amazing to work with the team here on the gpt-4o model launch. It's hard to grok until you try it how big of a step forward this is for human/computer voice communication. It feels different -- it's obvious that the model understands you better than anything you've used before. This is my favorite demo of gpt-4o, it demonstrates not just good stt/tts, but actual conversational ability over full, realistic phone call. It's so obvious how useful this will be!

Peter Bakkum

144,441 views • 2 years ago

I tried this so you don't have to. I know this is going to absolutely shock you but no this does not match the performance of Mythos. A few early thoughts: 1. The limits are pretty bad. I used 100% of my 5-hour usage in less than 1 prompt. 2. I specifically gave it a threejs task because it is an area that SOTA models have made big strides in, that other models just are not great at. I asked it to build a replica of Rocket League. I'll put the prompt in the comments. The game was pretty bad and notably worse than GPT 5.5. Even after multiple fixes, it took 7-8 back and forth with Codex just to get it an almost playable condition. Prior to these fixes, the game was not playable. Maybe it's really strong in other disciplines. I'd love to test that but I hit my limit in 1 prompt lol. GPT 5.5 by contrast did a pretty good job and required no follow ups. Fable would have absolutely nailed this as well. But yeah, early impressions...not great. But I hope I'm wrong. More testing tomorrow.
0:29

I tried this so you don't have to. I know this is going to absolutely shock you but no this does not match the performance of Mythos. A few early thoughts: 1. The limits are pretty bad. I used 100% of my 5-hour usage in less than 1 prompt. 2. I specifically gave it a threejs task because it is an area that SOTA models have made big strides in, that other models just are not great at. I asked it to build a replica of Rocket League. I'll put the prompt in the comments. The game was pretty bad and notably worse than GPT 5.5. Even after multiple fixes, it took 7-8 back and forth with Codex just to get it an almost playable condition. Prior to these fixes, the game was not playable. Maybe it's really strong in other disciplines. I'd love to test that but I hit my limit in 1 prompt lol. GPT 5.5 by contrast did a pretty good job and required no follow ups. Fable would have absolutely nailed this as well. But yeah, early impressions...not great. But I hope I'm wrong. More testing tomorrow.

am.will

585,915 views • 18 days ago

I'm sorry I've not been very active adding new things to the Ironmouse model index this last few months but I'm back at it again. I have added more animations to the model cards that show when you hover over the cards. (They won't play until they download so it may take a second when you first hover over them) #ironmouseart
0:55

I'm sorry I've not been very active adding new things to the Ironmouse model index this last few months but I'm back at it again. I have added more animations to the model cards that show when you hover over the cards. (They won't play until they download so it may take a second when you first hover over them) #ironmouseart

TheGyroscopicTree

14,639 views • 4 months ago