正在加载视频...

视频加载失败

Introducing Real World Engineering Bench (RWE-Bench). AI isn’t great at designing rockets, engines, or chips yet. With better evals and RL environments, it will be. Software was just the beginning. The physical world is next.

167,771 次观看 • 20 天前 •via X (Twitter)

40 条评论

Xplore AI 的头像
Xplore AI20 天前

The RWE-Bench leaderboard is live now. We scored 11 frontier models on 20 real physical engineering tasks, everything from designing engine components to routing circuit boards to simulating the flow through turbine vanes. Physics solvers check every design against the strict requirements set by our engineers. A run only passes if it meets every single one of them. GPT-6 Astra leads at 37%.

Xplore AI 的头像
Xplore AI20 天前

Agents are given actual engineering tasks and then work in sandboxes using the same CAD and CAE tools that human engineers would have access to. One mechanical engineering example: design the crankshaft for a 3-cylinder diesel engine. The agent has to ensure the counterweights balance the system without exceeding the mass limit, and its fillets survive peak firing loads and millions of fatigue cycles.

Xplore AI 的头像
Xplore AI20 天前

One electrical engineering example: route the DDR3 interface between an FPGA and 2 memory chips. That’s 77 nets on an 8-layer board with 295 parts already placed. Every trace has to stay skew-matched to its strobe and hold its impedance. The board fails if one net is off.

Xplore AI 的头像
Xplore AI20 天前

One aerospace engineering example: simulate flow through high-pressure turbine vanes. The agent needs to mesh the passage, set up and run CFD sims, and solve for surface heat transfer and pressure loss.

Xplore AI 的头像
Xplore AI20 天前

We’re building harder tasks in more engineering domains. To define the frontier of real-world engineering, we need RL environments designed by industry experts, hard enough to seem impossible for today’s models. If you want to build them with us, we’re hiring engineers and researchers.

Xplore AI 的头像
Xplore AI20 天前

If you want your model to master real-world engineering, or if you just want to learn more about how your model performs today, send us a DM. Read more here:

Guli Moreno 的头像
Guli Moreno20 天前

Bofff que calidad!

Jesus 的头像
Jesus20 天前

Lets make it!! Insane team and opportunity

jan 的头像
jan20 天前

10/10. Extremely excited about as a developer... and industrial engineer!!! From @AISaturdays_ES to the moon 🔥🚀

Chris Barber 的头像
Chris Barber20 天前

lfg!

Lightspeed 的头像
Lightspeed20 天前

Congratulations on the launch!

James Alcorn 的头像
James Alcorn20 天前

👏

ταῦ 的头像
ταῦ20 天前

Congrats to the team!

pablo 的头像
pablo20 天前

let's goo 🚀

Abijah Kajabika 的头像
Abijah Kajabika19 天前

came for the benchmark, stayed for bach (nice music choice)

Xavier de Gracia 的头像
Xavier de Gracia19 天前

This is amazing, congrats!

Daniel Elechiguerra 的头像
Daniel Elechiguerra20 天前

Insane product, Bort! Such a big opportunity ahead

Erik Newsham 的头像
Erik Newsham19 天前

:)

Patrick Douglas 的头像
Patrick Douglas19 天前

@maketaster you may like this. I wonder if test data could be tied back to train the models, in particular for a given business.

Karen Zhou 的头像
Karen Zhou19 天前

@paigeinsf

Jaime Martín 的头像
Jaime Martín20 天前

🚀🚀🚀 amazing work!!!!

The SI Maximalist 的头像
The SI Maximalist20 天前

Giving SI rocket-design homework makes “show your work” a much more interesting instruction

Joan Cabezas 的头像
Joan Cabezas20 天前

🔥

Adria Blancafort 的头像
Adria Blancafort19 天前

🚀🚀🚀

Rishi Desai 的头像
Rishi Desai19 天前

epic engineering eval :)))

Kepler 的头像
Kepler20 天前

I love Humanity.

Pirodas 的头像
Pirodas20 天前

Increibleee

Zac Baker 的头像
Zac Baker19 天前

Fantastic to see this come together :)

Alejandro Buján 的头像
Alejandro Buján20 天前

let’s go!

Salvador M. Algarra 的头像
Salvador M. Algarra20 天前

Great job… and that’s only the beginning!

Sergio Paniego 的头像
Sergio Paniego19 天前

🔥

Adam 的头像
Adam19 天前

Very interesting

Santiago Hernández 的头像
Santiago Hernández19 天前

Real world engineering is the next frontier. Excited for you guys to take the world there!

Uri Rolls 的头像
Uri Rolls20 天前

🚀 🤖

Juan Vecino 的头像
Juan Vecino19 天前

Insane team! Congrats

Elisa Gómez de Lope 的头像
Elisa Gómez de Lope20 天前

Way to go! Physical AI is getting 🔥🔥

Ernesto David Peña H 的头像
Ernesto David Peña H19 天前

🚀🚀🚀

Rey Neill 的头像
Rey Neill19 天前

We’ve been doing this internally for electronics! Will definitely give it a go

Felipe Cardona 的头像
Felipe Cardona19 天前

This is game changing 🔝🚀🚀🚀

Vignesh 的头像
Vignesh20 天前

This is absolutely phenomenal. Would we be able to contribute to the next set?

相关视频