正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

OpenAI's new o3 reasoning model has achieved a verified state-of-the-art score on the ARC-AGI benchmark

Tsarathustra

86,234 subscribers

27,655 次观看 • 1 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

ARC Prize President Greg Kamradt says OpenAI's o3 model has surpassed the human threshold on the ARC-AGI benchmark - scoring 87.5 where the human threshold is 85 in a "major milestone" that is "new territory" in the ARC-AGI world

ARC Prize President Greg Kamradt says OpenAI's o3 model has surpassed the human threshold on the ARC-AGI benchmark - scoring 87.5 where the human threshold is 85 in a "major milestone" that is "new territory" in the ARC-AGI world

Tsarathustra

71,466 次观看 • 1 年前

o3 has scored over 85% on ARC-AGI 🤯 Human performance is at 85% In other words: AGI has been achieved in 2024 2025 is going to be wild!

o3 has scored over 85% on ARC-AGI 🤯 Human performance is at 85% In other words: AGI has been achieved in 2024 2025 is going to be wild!

Yana Welinder

216,365 次观看 • 1 年前

ARC-AGI is redefining how to measure progress on the path to AGI - focusing on reasoning, generalization, and adaptability instead of memorization or scale. At NeurIPS 2025, YC's Diana sat down with ARC Prize President Greg Kamradt to find out why most AI benchmarks fail, how ARC-AGI reveals the limits of today’s models, and why measuring intelligence may be harder than building it. 00:11 — What ARC Prize is and why it exists 00:38 — François Chollet’s definition of AGI 01:48 — What ARC-AGI Actually Tests 02:25 — When LLMs Failed the ARC Benchmark 03:38 — ARC-AGI Becomes the Standard 04:49 — False Positives in AI Progress 06:06 — The Evolution of ARC-AGI 08:55 — Measuring Intelligence beyond just accuracy 10:25 — What happens if a model solves ARC-AGI?

ARC-AGI is redefining how to measure progress on the path to AGI - focusing on reasoning, generalization, and adaptability instead of memorization or scale. At NeurIPS 2025, YC's Diana sat down with ARC Prize President Greg Kamradt to find out why most AI benchmarks fail, how ARC-AGI reveals the limits of today’s models, and why measuring intelligence may be harder than building it. 00:11 — What ARC Prize is and why it exists 00:38 — François Chollet’s definition of AGI 01:48 — What ARC-AGI Actually Tests 02:25 — When LLMs Failed the ARC Benchmark 03:38 — ARC-AGI Becomes the Standard 04:49 — False Positives in AI Progress 06:06 — The Evolution of ARC-AGI 08:55 — Measuring Intelligence beyond just accuracy 10:25 — What happens if a model solves ARC-AGI?

Y Combinator

98,369 次观看 • 8 个月前

Sam Altman's OpenAI just revealed that their new o3 model has achieved artificial general intelligence (AGI) This is a big deal because it can now outsmart humans, but it costs a fortune.

Sam Altman's OpenAI just revealed that their new o3 model has achieved artificial general intelligence (AGI) This is a big deal because it can now outsmart humans, but it costs a fortune.

Financelot

107,594 次观看 • 1 年前

OpenAI's new o3 model is crazy good at math and logic. Here's an example of a financial analysis question using Box AI and o3 on an earnings document where advanced math and reasoning are required. This wouldn't have been possible even 3 months ago in AI.

OpenAI's new o3 model is crazy good at math and logic. Here's an example of a financial analysis question using Box AI and o3 on an earnings document where advanced math and reasoning are required. This wouldn't have been possible even 3 months ago in AI.

Aaron Levie

85,903 次观看 • 1 年前

Apple's AI Reasoning Model Paper Explained Apple’s disruptive new AI reasoning model research paper, “The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models” explained, and what it means for AGI.

Apple's AI Reasoning Model Paper Explained Apple’s disruptive new AI reasoning model research paper, “The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models” explained, and what it means for AGI.

Harper Carroll

37,956 次观看 • 1 年前

ARC-AGI-3 Preview Event Recap Greg Kamradt steps through our Interactive Reasoning Benchmark thesis * Why static benchmarks fall short measuring agentic capabilities * The ARC Prize approach to creating interactive benchmarks

ARC-AGI-3 Preview Event Recap Greg Kamradt steps through our Interactive Reasoning Benchmark thesis * Why static benchmarks fall short measuring agentic capabilities * The ARC Prize approach to creating interactive benchmarks

ARC Prize

22,248 次观看 • 1 年前

Sentient took AI Startup of the Year at the Minsky Awards 🙌 ROMA Search achieved an industry-leading 81.7% accuracy, significantly surpassing competitors on the FRAMES benchmark for multi-step reasoning. On the SEAL-0 benchmark for complex, multi-source reasoning, ROMA with 45.6% accuracy more than doubled the score of Gemini 2.5 Pro (19.8%). ROMA is available on GitHub, try it out today👇

Sentient took AI Startup of the Year at the Minsky Awards 🙌 ROMA Search achieved an industry-leading 81.7% accuracy, significantly surpassing competitors on the FRAMES benchmark for multi-step reasoning. On the SEAL-0 benchmark for complex, multi-source reasoning, ROMA with 45.6% accuracy more than doubled the score of Gemini 2.5 Pro (19.8%). ROMA is available on GitHub, try it out today👇

Sentient

482,992 次观看 • 10 个月前

Introducing Gemini 3.1 Pro 🚀 3.1 Pro represents a major step forward in core reasoning. It scored 77.1% (more than doubling 3 Pro’s score) on ARC-AGI-2, the benchmark that evaluates a model's ability to solve new logic patterns and work through challenges it hasn’t encountered before. This demo illustrates how the model can go beyond the prompt. Instead of rendering a video or static graphic, 3.1 Pro codes a full environment, integrating generative audio and providing UI controls.

Introducing Gemini 3.1 Pro 🚀 3.1 Pro represents a major step forward in core reasoning. It scored 77.1% (more than doubling 3 Pro’s score) on ARC-AGI-2, the benchmark that evaluates a model's ability to solve new logic patterns and work through challenges it hasn’t encountered before. This demo illustrates how the model can go beyond the prompt. Instead of rendering a video or static graphic, 3.1 Pro codes a full environment, integrating generative audio and providing UI controls.

Google AI

3,067,134 次观看 • 5 个月前

Today we’re taking a big step on the path toward AGI and releasing Gemini 3— our most intelligent model yet. With Gemini 3, you can bring any idea to life. It is state-of-the-art in reasoning, the best model in the world for multimodal understanding, and our best agentic and vibe coding model.

Today we’re taking a big step on the path toward AGI and releasing Gemini 3— our most intelligent model yet. With Gemini 3, you can bring any idea to life. It is state-of-the-art in reasoning, the best model in the world for multimodal understanding, and our best agentic and vibe coding model.

Google AI

492,973 次观看 • 9 个月前

Sam Altman proposed a future AGI test: if a model like "GPT-8" solved quantum gravity and could explain the reasoning behind its discovery would that qualify as AGI? David Deutsch agreed that it would qualify as AGI, making it a potential benchmark

Sam Altman proposed a future AGI test: if a model like "GPT-8" solved quantum gravity and could explain the reasoning behind its discovery would that qualify as AGI? David Deutsch agreed that it would qualify as AGI, making it a potential benchmark

Haider.

766,874 次观看 • 10 个月前

You can smell a big model. Not the parameter count. Not the benchmark score. It's that feeling when something is actually reasoning. Not just pattern matching. We call it "big model smell."

You can smell a big model. Not the parameter count. Not the benchmark score. It's that feeling when something is actually reasoning. Not just pattern matching. We call it "big model smell."

Arena.ai

112,227 次观看 • 4 个月前

.ARC Prize launched ARC AGI 3. AI scores less than 1%, humans get 100%. Is this the ultimate benchmark?

.ARC Prize launched ARC AGI 3. AI scores less than 1%, humans get 100%. Is this the ultimate benchmark?

Matthew Berman

26,969 次观看 • 4 个月前

Today, we shared evals for an early version of the next model in our o-model reasoning series: OpenAI o3

Today, we shared evals for an early version of the next model in our o-model reasoning series: OpenAI o3

OpenAI

1,669,265 次观看 • 1 年前

Introducing SYNTHETIC-1: Collaboratively generating the largest synthetic dataset of verified reasoning traces for math, coding and science using DeepSeek-R1. Join us to contribute compute towards state-of-the-art open reasoning models.

Introducing SYNTHETIC-1: Collaboratively generating the largest synthetic dataset of verified reasoning traces for math, coding and science using DeepSeek-R1. Join us to contribute compute towards state-of-the-art open reasoning models.

Prime Intellect

198,657 次观看 • 1 年前