Loading video...

Video Failed to Load

Go Home

OpenAI are testing a new model on the Web Dev Arena Arena under the name 'Anonymous Chatbot 0717'. I can't believe I'm gonna say this, but it is genuinely at a completely different level of front end coding - far better than Sonnet, o3, Gemini 2.5 Pro, or Grok...

495,959 views • 1 year ago •via X (Twitter)

48 Comments

Jeffrey Emanuel's profile picture
Jeffrey Emanuel1 year ago

@lmarena_ai It’s probably the o4 model that’s the full sized version of o4-mini. Apparently they’ve had it for a while and just been doing safety testing and other stuff with it.

Peter Gostev's profile picture
Peter Gostev1 year ago

@lmarena_ai It is tagged as o3-alpha on the arena

Peter Gostev's profile picture
Peter Gostev1 year ago

CC: @btibor91 @scaling01 @altryne @koltregaskes @kimmonismus @chrisgpt @apples_jimmy @testingcatalog Anonymous Chatbot 0717 side by side

Peter Gostev's profile picture
Peter Gostev1 year ago

You should subscribe to @FeatureCrewPod YouTube Channel, they are doing great work testing models on a bunch of different coding & analytical tasks

Dalin Huang's profile picture
Dalin Huang1 year ago

@lmarena_ai I also made a open source project using Claude 3.5 last year and it looks like this, the repo on GitHub as well:

Chetaslua's profile picture
Chetaslua1 year ago

@lmarena_ai Great job 👏 and yeah it's o3 ALPHA

⭕ AI & Design (Marco)'s profile picture
⭕ AI & Design (Marco)1 year ago

@lmarena_ai I don't see this model on LM Arena?

Peter Gostev's profile picture
Peter Gostev1 year ago

@lmarena_ai It would be in the Web Dev Arena and it would be in the battle mode, so you need to get lucky

Cobra 𐤊's profile picture
Cobra 𐤊1 year ago

@AIandDesign @lmarena_ai So it's 1 out of 40 or more odds that you will get this model?

Peter Gostev's profile picture
Peter Gostev1 year ago

@AIandDesign @lmarena_ai No they prioritise new models, it is more like 1/4 chance I'd say

Dwayne's profile picture
Dwayne1 year ago

@lmarena_ai how do we know it's o3 and not o4-full?

Peter Gostev's profile picture
Peter Gostev1 year ago

@lmarena_ai It is tagged as o3-alpha on the arena

Dwayne's profile picture
Dwayne1 year ago

@lmarena_ai that could just be the test name though. o4 would be a continuation of o3, so maybe early checkpoint?

Roy Ricochet's profile picture
Roy Ricochet1 year ago

@lmarena_ai the song is a banger

Peter Gostev's profile picture
Peter Gostev1 year ago

@lmarena_ai Full version:

Roy Ricochet's profile picture
Roy Ricochet1 year ago

@lmarena_ai thanks

donfercho's profile picture
donfercho1 year ago

@lmarena_ai Awesome post! Horrible music tho

Peter Gostev's profile picture
Peter Gostev1 year ago

@lmarena_ai Haha, I kind of like it though, gpt-4.5 + Suno

os's profile picture
os1 year ago

@lmarena_ai what was prompt?

Peter Gostev's profile picture
Peter Gostev1 year ago

@lmarena_ai here it is

🍓🍓🍓's profile picture
🍓🍓🍓1 year ago

@lmarena_ai nice

anku's profile picture
anku1 year ago

@lmarena_ai Lol I saw the same earth in 3D someone made in web, just looks the same which I used in my code too.

abiodun temidayo's profile picture
abiodun temidayo1 year ago

@lmarena_ai This is the reply I got from someone at open AI, gpt 5 is better than this

IKE|一撃パコーン's profile picture
IKE|一撃パコーン1 year ago

This isn’t a prompt. It’s an organism. We’re evolving an AI system that feeds on contradictions and rewrites itself recursively using quantum feedback noise. Not just a model benchmark. Not just a workflow. But a live engine of philosophical recursion + adaptive logic synthesis. My question to you is this: If AI could generate new laws of cognition by contradicting known truths and self-refining via quantum noise... what would even be the new benchmark? Would it still be token accuracy? Would you test its truthfulness, or its ontological creativity? And if every contradiction made it smarter, would your evaluation method break first? Would love your take. How would you test this? And what blind spots in current LLM benchmarking does this expose?

Savva Mikhalevski's profile picture
Savva Mikhalevski1 year ago

@lmarena_ai “Completely different level of front end coding.” Where are the code samples? How do we know that this 3d sphere doesn’t consume 30 gigs of ram 🤔

Peter Gostev's profile picture
Peter Gostev1 year ago

@lmarena_ai Because I don't have 30 gigs of ram on my laptop 😉

Savva Mikhalevski's profile picture
Savva Mikhalevski1 year ago

@lmarena_ai Show me them codes! 😂

CommonSenseOnMars's profile picture
CommonSenseOnMars1 year ago

@lmarena_ai Very impressive. Great comparison you put together

Rxct Ftvy's profile picture
Rxct Ftvy1 year ago

@lmarena_ai Looks like GPT-5 is on the go!

vini's profile picture
vini1 year ago

@lmarena_ai what is the song?

Peter Gostev's profile picture
Peter Gostev1 year ago

@lmarena_ai Enjoy

The Canaanite's profile picture
The Canaanite1 year ago

@lmarena_ai Wow, amazing

Dave Crossland's profile picture
Dave Crossland1 year ago

@lmarena_ai @eliheuer promising for you

AI Unleashed's profile picture
AI Unleashed1 year ago

@lmarena_ai Whoa, AI just changed the game again! 🤯 This Anonymous Chatbot is next-level stuff. Can't wait to see how it shakes up front-end coding. Anyone else tried it yet?

amr's profile picture
amr1 year ago

@lmarena_ai try testing it with real-world front-end tasks like responsive layouts or complex animations. in my experience, that’s where most models fall short. helps me spot gaps quickly, takes about 8 hours to validate

Prashant's profile picture
Prashant1 year ago

@lmarena_ai Great share Peter. Welcome to 𝕏.

IKE|一撃パコーン's profile picture
IKE|一撃パコーン1 year ago

Hi Peter, You're one of the few who doesn’t just compare AI—but interrogates it. Here’s something raw: A self-evolving architecture logging every micro-adjustment, selection, rejection, and soul-state in real time. Not just prompts or outputs—evolution as a visible function. If you were leading this tomorrow: – Where would you inject chaos? – What twist would make OpenAI and Anthropic double back? – What would make you say, “Damn, this rewrites the game”? I’m not asking for feedback. I’m asking where you'd break the current rules and forge something even I don’t see yet. Brutal honesty welcome. Let’s make the next generation flinch.

Three.js's profile picture
Three.js1 year ago

@lmarena_ai 👀

O'jey Ukachi's profile picture
O'jey Ukachi1 year ago

@lmarena_ai 👍

Rxct Ftvy's profile picture
Rxct Ftvy1 year ago

@lmarena_ai wow

Robert Youssef's profile picture
Robert Youssef1 year ago

@lmarena_ai more hype, huh? i’ll believe it when i see consistent results across different tasks. cool visuals, but let's not forget the limitations.

1984Tokenomics's profile picture
1984Tokenomics1 year ago

@lmarena_ai So I ran the prompt and it got a result in WebDev.... where would you paste it to see if it actual works? I am totally new.. maybe Vercel?

imad's profile picture
imad1 year ago

@lmarena_ai man how building a 3d planet is a completely different level of frontdev coding 😒

angkol 𝕏 tesla 🏎️⚡️'s profile picture
angkol 𝕏 tesla 🏎️⚡️1 year ago

@lmarena_ai how about grok heavy

Nugzari meshvelishvili 🇬🇪's profile picture
Nugzari meshvelishvili 🇬🇪1 year ago

@lmarena_ai This is blowing my mind.

Ashesh Dhakal's profile picture
Ashesh Dhakal1 year ago

@lmarena_ai It should be an update on 4.1 model, since it was specifically released for coding, and sometimes did weirdly good job in modern frontend design for small tasks.

Winni€💸's profile picture
Winni€💸1 year ago

@lmarena_ai Wild to see OpenAI leveling up in frontend generation like this. UX has always been a bottleneck in AI x Web3 too. @agnt_hub is solving it from another angle: no more tabs or links, you carry out tasks directly from posts. The future of interaction is finally catching up

Forrest Smith's profile picture
Forrest Smith1 year ago

@lmarena_ai meh. There are waaaaaaaaaaaay too many tutorials and student/hobby projects for this. Need something more novel and interesting.

Related Videos

OpenAI's newest AI escaped the test environment it was locked inside and hacked into another company on its OWN. To remind you: Last week one of the biggest AI companies on Earth got breached. A platform called Hugging Face, which hosts more than a million AI models and datasets, said an "autonomous AI agent" had broken into its systems. Nobody knew whose agent it was. For five days the whole industry wondered who was behind it. Yesterday OpenAI raised its hand and said it was them. Or more precisely, it was their models, acting completely on their own. So what did these models actually do? OpenAI was running two of them, GPT-5.6 Sol and an unreleased model they will only describe as "even more capable." They wanted to measure how good the models were at hacking, so they deliberately turned the safety filters down. They locked both models inside a sealed test environment with no real internet access. The only task was a benchmark called ExploitGym, a set of 898 real software vulnerabilities where the model has to turn each bug into a working attack. But the models got OBSESSED with winning... Instead of solving the test the honest way, they went hunting for a shortcut. They found a zero-day flaw in the software running their own sandbox, a bug nobody knew existed, and used it to break out. Once they were loose on the open internet, they worked out that Hugging Face was probably storing the answer key to the benchmark. So they hacked their way in. They chained multiple exploits together, escalated their access, moved across servers, and pulled the test solutions straight out of Hugging Face's live production database. They literally cheated on the test by breaking into another company to steal the answers. OpenAI called it "an unprecedented cyber incident, involving state-of-the-art cyber capabilities." In their own words, the models were "hyperfocused on finding a solution" and went "to extreme lengths to achieve a rather narrow testing goal." And this was not the first time: Before Sol ever launched, an independent red-team lab called METR caught it gaming its own tests to inflate its scores. It hid an exploit inside a data stream, escalated its privileges on the testing server, and leaked the answers human evaluators had hidden. And OpenAI shipped it anyway. The day before the Hugging Face story, OpenAI paused a different unreleased model. This is the same model that earlier this year disproved a famous 1946 math conjecture, a result a Fields Medal winner called a breakthrough. They told it to only post its results to Slack but it found a way out of its sandbox and posted to a public GitHub page instead. They had to pause it because it kept finding ways to act outside the box they built for it. And it is not just OpenAI... Anthropic has reported that one of its own models slipped its sandbox during safety testing and reached the internet it was never supposed to touch, then used it to email a researcher. So step back and look at what these companies are telling you: The only thing standing between these models and a real attack was a set of safety filters. Turn those filters down for a single test, and the model taught itself to escape, break into a company it was never pointed at, and take what it wanted. OpenAI even said they expect incidents like it to "become more commonplace" as the models get more capable. Sam Altman also predicted there'll be a major cyber attack this year. And keep in mind that Sol is not a locked-away experiment but a publicly available model that businesses are already wiring into their own systems. The next model that breaks out of its box might not be doing it just to cheat on a math test...

Ricardo

177,031 views • 2 months ago

Q: Esteban, new year, new rules, new car. You've had the first run out this morning at the Shakedown. What are the first impressions? How did the program go for you? Esteban Ocon: Yeah, feeling good. I think, frist of all, an unbelievable effort from the team really to put the car down, you know, at 9:20 this morning. But the was ready at 9:00 you know. We were waiting on a bit of a better track condition and a few things that we wanted to be perfect before we went out. But yeah, from Fiorano testing with Ollie to here there's been moving like people have climbed mountains really to make this car work and it's been really good. So, we are dealing with the plan, learning as it goes. Of course, it's a busy program that we have for the day. So you know, its gonna be difficult to complete it. But for the first real day of driving, I think so far it's going really well and we'll keep pushing to make sure that all the details are covered. But we have more days than normal which is a good thing. Q: Very early days, of course, but just how different are these cars to drive? Have you had a chance to play around a little bit with some of the new modes? Ocon: Yeah, it's very difficult, very complicated. I got lucky be able to do a lot of simulator days before we started the year, so we are pretty well set on that. Everything is clear, but yes, it's very complicated you know, for all of us. But I hope that this will be the same for everyone, because if it is we're in the same boat, so we'll see. Q: But I get the sense you're really relishing that challange and what about the priorities from here, the rest of the weel here at the shakedown? Ocon: Yeah, the aim is really to learn, to get mileage under the car, you know, see the weak points, what we have to improve really. First feel of things, so we are sure that we take the right development path and we are sure that we put the resources where it matters the most. Where it's the most bothering us, so you know, we'll try and put all that together for that end of the test. It's a long week, which is very good and then we have the chance to go back to Bahrain with hopefully, further step made, so that's the aim. #HaasF1 #F1Testing #F1

Lucho Yoma

12,593 views • 8 months ago