Loading video...

Video Failed to Load

Go Home

OpenAI's new o3 reasoning model has achieved a verified state-of-the-art score on the ARC-AGI benchmark

tsarnick's profile picture

Tsarathustra

86,234 subscribers

27,655 views • 1 year ago •via X (Twitter)

Science & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

ARC Prize President Greg Kamradt says OpenAI's o3 model has surpassed the human threshold on the ARC-AGI benchmark - scoring 87.5 where the human threshold is 85 in a "major milestone" that is "new territory" in the ARC-AGI world
1:03

ARC Prize President Greg Kamradt says OpenAI's o3 model has surpassed the human threshold on the ARC-AGI benchmark - scoring 87.5 where the human threshold is 85 in a "major milestone" that is "new territory" in the ARC-AGI world

Tsarathustra

71,466 views • 1 year ago

o3 has scored over 85% on ARC-AGI 🤯 Human performance is at 85% In other words: AGI has been achieved in 2024 2025 is going to be wild!
1:10

o3 has scored over 85% on ARC-AGI 🤯 Human performance is at 85% In other words: AGI has been achieved in 2024 2025 is going to be wild!

Yana Welinder

216,365 views • 1 year ago

ARC-AGI is redefining how to measure progress on the path to AGI - focusing on reasoning, generalization, and adaptability instead of memorization or scale. At NeurIPS 2025, YC's Diana sat down with ARC Prize President Greg Kamradt to find out why most AI benchmarks fail, how ARC-AGI reveals the limits of today’s models, and why measuring intelligence may be harder than building it. 00:11 — What ARC Prize is and why it exists 00:38 — François Chollet’s definition of AGI 01:48 — What ARC-AGI Actually Tests 02:25 — When LLMs Failed the ARC Benchmark 03:38 — ARC-AGI Becomes the Standard 04:49 — False Positives in AI Progress 06:06 — The Evolution of ARC-AGI 08:55 — Measuring Intelligence beyond just accuracy 10:25 — What happens if a model solves ARC-AGI?
11:59

ARC-AGI is redefining how to measure progress on the path to AGI - focusing on reasoning, generalization, and adaptability instead of memorization or scale. At NeurIPS 2025, YC's Diana sat down with ARC Prize President Greg Kamradt to find out why most AI benchmarks fail, how ARC-AGI reveals the limits of today’s models, and why measuring intelligence may be harder than building it. 00:11 — What ARC Prize is and why it exists 00:38 — François Chollet’s definition of AGI 01:48 — What ARC-AGI Actually Tests 02:25 — When LLMs Failed the ARC Benchmark 03:38 — ARC-AGI Becomes the Standard 04:49 — False Positives in AI Progress 06:06 — The Evolution of ARC-AGI 08:55 — Measuring Intelligence beyond just accuracy 10:25 — What happens if a model solves ARC-AGI?

Y Combinator

98,369 views • 8 months ago

Sam Altman's OpenAI just revealed that their new o3 model has achieved artificial general intelligence (AGI) This is a big deal because it can now outsmart humans, but it costs a fortune.
12:04

Sam Altman's OpenAI just revealed that their new o3 model has achieved artificial general intelligence (AGI) This is a big deal because it can now outsmart humans, but it costs a fortune.

Financelot

107,594 views • 1 year ago

OpenAI's new o3 model is crazy good at math and logic. Here's an example of a financial analysis question using Box AI and o3 on an earnings document where advanced math and reasoning are required. This wouldn't have been possible even 3 months ago in AI.
0:26

OpenAI's new o3 model is crazy good at math and logic. Here's an example of a financial analysis question using Box AI and o3 on an earnings document where advanced math and reasoning are required. This wouldn't have been possible even 3 months ago in AI.

Aaron Levie

85,903 views • 1 year ago

Apple's AI Reasoning Model Paper Explained Apple’s disruptive new AI reasoning model research paper, “The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models” explained, and what it means for AGI.
3:22

Apple's AI Reasoning Model Paper Explained Apple’s disruptive new AI reasoning model research paper, “The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models” explained, and what it means for AGI.

Harper Carroll

37,956 views • 1 year ago

ARC-AGI-3 Preview Event Recap Greg Kamradt steps through our Interactive Reasoning Benchmark thesis * Why static benchmarks fall short measuring agentic capabilities * The ARC Prize approach to creating interactive benchmarks
17:19

ARC-AGI-3 Preview Event Recap Greg Kamradt steps through our Interactive Reasoning Benchmark thesis * Why static benchmarks fall short measuring agentic capabilities * The ARC Prize approach to creating interactive benchmarks

ARC Prize

22,248 views • 1 year ago

Sentient took AI Startup of the Year at the Minsky Awards 🙌 ROMA Search achieved an industry-leading 81.7% accuracy, significantly surpassing competitors on the FRAMES benchmark for multi-step reasoning. On the SEAL-0 benchmark for complex, multi-source reasoning, ROMA with 45.6% accuracy more than doubled the score of Gemini 2.5 Pro (19.8%). ROMA is available on GitHub, try it out today👇
1:17

Sentient took AI Startup of the Year at the Minsky Awards 🙌 ROMA Search achieved an industry-leading 81.7% accuracy, significantly surpassing competitors on the FRAMES benchmark for multi-step reasoning. On the SEAL-0 benchmark for complex, multi-source reasoning, ROMA with 45.6% accuracy more than doubled the score of Gemini 2.5 Pro (19.8%). ROMA is available on GitHub, try it out today👇

Sentient

482,992 views • 10 months ago

Introducing Gemini 3.1 Pro 🚀 3.1 Pro represents a major step forward in core reasoning. It scored 77.1% (more than doubling 3 Pro’s score) on ARC-AGI-2, the benchmark that evaluates a model's ability to solve new logic patterns and work through challenges it hasn’t encountered before. This demo illustrates how the model can go beyond the prompt. Instead of rendering a video or static graphic, 3.1 Pro codes a full environment, integrating generative audio and providing UI controls.
0:47

Introducing Gemini 3.1 Pro 🚀 3.1 Pro represents a major step forward in core reasoning. It scored 77.1% (more than doubling 3 Pro’s score) on ARC-AGI-2, the benchmark that evaluates a model's ability to solve new logic patterns and work through challenges it hasn’t encountered before. This demo illustrates how the model can go beyond the prompt. Instead of rendering a video or static graphic, 3.1 Pro codes a full environment, integrating generative audio and providing UI controls.

Google AI

3,067,134 views • 5 months ago

Today we’re taking a big step on the path toward AGI and releasing Gemini 3— our most intelligent model yet. With Gemini 3, you can bring any idea to life. It is state-of-the-art in reasoning, the best model in the world for multimodal understanding, and our best agentic and vibe coding model.
0:51

Today we’re taking a big step on the path toward AGI and releasing Gemini 3— our most intelligent model yet. With Gemini 3, you can bring any idea to life. It is state-of-the-art in reasoning, the best model in the world for multimodal understanding, and our best agentic and vibe coding model.

Google AI

492,973 views • 9 months ago

Sam Altman proposed a future AGI test: if a model like "GPT-8" solved quantum gravity and could explain the reasoning behind its discovery would that qualify as AGI? David Deutsch agreed that it would qualify as AGI, making it a potential benchmark
0:40

Sam Altman proposed a future AGI test: if a model like "GPT-8" solved quantum gravity and could explain the reasoning behind its discovery would that qualify as AGI? David Deutsch agreed that it would qualify as AGI, making it a potential benchmark

Haider.

766,874 views • 10 months ago

You can smell a big model. Not the parameter count. Not the benchmark score. It's that feeling when something is actually reasoning. Not just pattern matching. We call it "big model smell."
0:52

You can smell a big model. Not the parameter count. Not the benchmark score. It's that feeling when something is actually reasoning. Not just pattern matching. We call it "big model smell."

Arena.ai

112,227 views • 4 months ago

.ARC Prize launched ARC AGI 3. AI scores less than 1%, humans get 100%. Is this the ultimate benchmark?
9:37

.ARC Prize launched ARC AGI 3. AI scores less than 1%, humans get 100%. Is this the ultimate benchmark?

Matthew Berman

26,969 views • 4 months ago

Today, we shared evals for an early version of the next model in our o-model reasoning series: OpenAI o3
9:38

Today, we shared evals for an early version of the next model in our o-model reasoning series: OpenAI o3

OpenAI

1,669,305 views • 1 year ago

Introducing SYNTHETIC-1: Collaboratively generating the largest synthetic dataset of verified reasoning traces for math, coding and science using DeepSeek-R1. Join us to contribute compute towards state-of-the-art open reasoning models.
0:27

Introducing SYNTHETIC-1: Collaboratively generating the largest synthetic dataset of verified reasoning traces for math, coding and science using DeepSeek-R1. Join us to contribute compute towards state-of-the-art open reasoning models.

Prime Intellect

198,657 views • 1 year ago