Загрузка видео...

Не удалось загрузить видео

На главную

Mathematics offers a unique window into AI's reasoning capabilities. Discover why we've launched FrontierMath—a benchmark of hundreds of unpublished, expert-level math problems—to understand the frontier of artificial intelligence.

EpochAIResearch's profile picture

Epoch AI

47,066 subscribers

394,050 просмотров • 1 год назад •via X (Twitter)

Наука и технологииОбразование
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 10

Фото профиля Epoch AI
Epoch AI1 год назад

Learn more about FrontierMath, explore sample problems with detailed solutions, and see how current AI systems perform on FrontierMath:

Фото профиля Daniel Paleka
Daniel Paleka1 год назад

How many problems are there in the dataset? I guess about 290?

Фото профиля Tilman Bayer
Tilman Bayer1 год назад

SOTA among math benchmarks... I see what you did there 😉

Фото профиля Alfred Wahlforss
Alfred Wahlforss1 год назад

Go Elliot!

Фото профиля Fred Zhang
Fred Zhang1 год назад

are problem statements formalized?

Фото профиля Charlie Snell
Charlie Snell1 год назад

Banger

Фото профиля Luis Garicano 🇪🇺🇺🇦
Luis Garicano 🇪🇺🇺🇦1 год назад

You did not try o1-preview?

Фото профиля João Augusto
João Augusto1 год назад

That is awesome guys!!

Фото профиля YJxAI – e/acc
YJxAI – e/acc1 год назад

IF Humans can take weeks to achieve the result. Should not o1 be given the same amount of time to think . Given its increase in performance by increasing Test time Compute

Фото профиля Jason Rute @ JMM 2025
Jason Rute @ JMM 20251 год назад

What is the process by which researchers can submit models to be evaluated on this benchmark? Or are you only interested in leading foundation models? (But even then, you have to consider prompting strategies, no?)

Похожие видео

"It’s not AI; it’s AC; Artificial Cleverness!" Sir Roger Penrose explains why current "Artificial Intelligence" is missing the most critical ingredient: consciousness. By delving into the limits of mathematical computability, he argues that while computers are masters of "computational mathematics," true intelligence requires a conscious understanding that exists beyond any algorithm. At the fundamental level, what we call AI is just high-speed calculation. To Penrose, intelligence and consciousness are inseparable; and until a machine can "understand," it’s simply being clever.
0:52

"It’s not AI; it’s AC; Artificial Cleverness!" Sir Roger Penrose explains why current "Artificial Intelligence" is missing the most critical ingredient: consciousness. By delving into the limits of mathematical computability, he argues that while computers are masters of "computational mathematics," true intelligence requires a conscious understanding that exists beyond any algorithm. At the fundamental level, what we call AI is just high-speed calculation. To Penrose, intelligence and consciousness are inseparable; and until a machine can "understand," it’s simply being clever.

Cosmos Archive

83,200 просмотров • 5 месяцев назад

AI only has pre-schooler level capabilities for visual tasks. "The frontier models—the best of them—still reason around the age of a preschooler, and any elementary school kid in that benchmark was able to beat all the frontier models on these visual tasks." "These are tasks that are not just object recognition. It's about spatial reasoning... tasks like navigating through the maze…” — Andrew M. Dai, CEO of Elorian
0:49

AI only has pre-schooler level capabilities for visual tasks. "The frontier models—the best of them—still reason around the age of a preschooler, and any elementary school kid in that benchmark was able to beat all the frontier models on these visual tasks." "These are tasks that are not just object recognition. It's about spatial reasoning... tasks like navigating through the maze…” — Andrew M. Dai, CEO of Elorian

The Information

25,680 просмотров • 1 месяц назад

Does AI have a plausibility problem? Or rather, do we have a problem with AI's plausibility? Watch Terry Tao's full Oxford Mathematics Public Lecture (supported by XTX Markets) as he suggests new ways of doing mathematics in an artificial intelligence future.
0:53

Does AI have a plausibility problem? Or rather, do we have a problem with AI's plausibility? Watch Terry Tao's full Oxford Mathematics Public Lecture (supported by XTX Markets) as he suggests new ways of doing mathematics in an artificial intelligence future.

Oxford Mathematics

31,830 просмотров • 2 лет назад

A month ago, we invited 30 of the world’s top mathematicians to Berkeley for a weekend to finish a very hard math exam. The 2025 FrontierMath Symposium wrapped up the hardest tier of FrontierMath, our benchmark for AI’s math abilities. The mathematicians tested AI models on their most challenging math problems, and discussed AI’s future in math. Watch our closing ceremony footage for a glimpse behind the scenes. -Timestamps- (00:00) - Intro by Elliot Glazer - Epoch AI (03:38) - Topology | Sergei Gukov - Caltech (06:53) - Algebraic Geometry | Ravi Vakil - Stanford (09:10) - Number Theory | Ken Ono - University of Virginia (13:19) - Combinatorics | Igor Pak - UCLA (16:54) - Analysis | Paata Ivanisvili - UC Irvine (18:18) - Closing Remarks
19:39

A month ago, we invited 30 of the world’s top mathematicians to Berkeley for a weekend to finish a very hard math exam. The 2025 FrontierMath Symposium wrapped up the hardest tier of FrontierMath, our benchmark for AI’s math abilities. The mathematicians tested AI models on their most challenging math problems, and discussed AI’s future in math. Watch our closing ceremony footage for a glimpse behind the scenes. -Timestamps- (00:00) - Intro by Elliot Glazer - Epoch AI (03:38) - Topology | Sergei Gukov - Caltech (06:53) - Algebraic Geometry | Ravi Vakil - Stanford (09:10) - Number Theory | Ken Ono - University of Virginia (13:19) - Combinatorics | Igor Pak - UCLA (16:54) - Analysis | Paata Ivanisvili - UC Irvine (18:18) - Closing Remarks

Epoch AI

21,379 просмотров • 1 год назад

📁 Yann LeCun, an expert in artificial intelligence and a pioneer of deep learning, explains that current systems do not understand the physical world and lack real memory or reasoning. He adds that, despite the vast resources spent on training and refining them, they remain far behind the learning ability of a four-year-old child.
1:51

📁 Yann LeCun, an expert in artificial intelligence and a pioneer of deep learning, explains that current systems do not understand the physical world and lack real memory or reasoning. He adds that, despite the vast resources spent on training and refining them, they remain far behind the learning ability of a four-year-old child.

Jon Hernandez

24,687 просмотров • 9 месяцев назад

❗️Previously unpublished footage of the launch of an S-200 anti-aircraft missile transferred by Poland, converted into a ground-launched version
0:37

❗️Previously unpublished footage of the launch of an S-200 anti-aircraft missile transferred by Poland, converted into a ground-launched version

🪖MilitaryNewsUA🇺🇦

239,759 просмотров • 1 месяц назад

Terence Tao says AI could help rework mathematics from the ground up, doing math problems at a scale never done before and leading to a new age of discovery
0:35

Terence Tao says AI could help rework mathematics from the ground up, doing math problems at a scale never done before and leading to a new age of discovery

Tsarathustra

63,759 просмотров • 1 год назад

“AI can not crack bitcoin”, says Elon Musk “We see no way for artificial intelligence to subvert the fundamentals of mathematics and hash bitcoin easily. AI can not defy fundamental math. It can improve the efficiency of hashing, but not crack it”
1:25

“AI can not crack bitcoin”, says Elon Musk “We see no way for artificial intelligence to subvert the fundamentals of mathematics and hash bitcoin easily. AI can not defy fundamental math. It can improve the efficiency of hashing, but not crack it”

Documenting ₿itcoin 📄

308,099 просмотров • 1 год назад

I launched my High-Level Advisory Body on Artificial Intelligence. This is the starting point for a global conversation on the governance of AI, so that its benefits to all of humanity are maximized, and the risks contained & diminished.
0:36

I launched my High-Level Advisory Body on Artificial Intelligence. This is the starting point for a global conversation on the governance of AI, so that its benefits to all of humanity are maximized, and the risks contained & diminished.

António Guterres

345,938 просмотров • 2 лет назад

We’re pushing the boundaries of intelligence even further with Gemini 3 Deep Think. 🧠 This mode meaningfully improves reasoning capabilities by exploring many hypotheses simultaneously to solve problems. Here’s how it coded a simulated dominoes game from a single prompt ⬇️
0:40

We’re pushing the boundaries of intelligence even further with Gemini 3 Deep Think. 🧠 This mode meaningfully improves reasoning capabilities by exploring many hypotheses simultaneously to solve problems. Here’s how it coded a simulated dominoes game from a single prompt ⬇️

Google DeepMind

248,035 просмотров • 8 месяцев назад

#WATCH | Maharashtra: In a bid to improve the nutrition level of tribal children of Gadchiroli, a unique Artificial Intelligence-based machine has been installed at Todsa Ashram School of Etapalli. The machine takes a photo of the student with her/his plate of food and within a few seconds, without any human intervention, identifies whether the quality of the food is good.
1:16

#WATCH | Maharashtra: In a bid to improve the nutrition level of tribal children of Gadchiroli, a unique Artificial Intelligence-based machine has been installed at Todsa Ashram School of Etapalli. The machine takes a photo of the student with her/his plate of food and within a few seconds, without any human intervention, identifies whether the quality of the food is good.

ANI

1,494,698 просмотров • 3 лет назад

Pope Leo XIV calls for artificial intelligence to be immediately disarmed and compares it to a nuclear missile. He says artificial intelligence is turning into an instrument of death that seeks to dominate the lives of all humans. “An instrument of domination.”
1:01

Pope Leo XIV calls for artificial intelligence to be immediately disarmed and compares it to a nuclear missile. He says artificial intelligence is turning into an instrument of death that seeks to dominate the lives of all humans. “An instrument of domination.”

Shadow of Ezra

131,381 просмотров • 3 месяцев назад

"For it to NOT be a bubble... requires that the AI companies make hundreds of billions of dollars a year, in the next 24 months. That would be the fastest growing business in history." —Derek Thompson on why "there's no off-ramp" for the impact of artificial intelligence
1:56

"For it to NOT be a bubble... requires that the AI companies make hundreds of billions of dollars a year, in the next 24 months. That would be the fastest growing business in history." —Derek Thompson on why "there's no off-ramp" for the impact of artificial intelligence

Pablo Torre Finds Out

73,775 просмотров • 5 месяцев назад

Owners of some iPhones are in line to get cash payments of up to $95 from Apple after the company on Tuesday reached a $250 million settlement in a class-action lawsuit for false advertising of its artificial intelligence capabilities.
1:02

Owners of some iPhones are in line to get cash payments of up to $95 from Apple after the company on Tuesday reached a $250 million settlement in a class-action lawsuit for false advertising of its artificial intelligence capabilities.

The Associated Press

135,774 просмотров • 3 месяцев назад

Owners of some iPhones are in line to get cash payments of up to $95 from Apple after the company on Tuesday reached a $250 million settlement in a class-action lawsuit for false advertising of its artificial intelligence capabilities.
0:26

Owners of some iPhones are in line to get cash payments of up to $95 from Apple after the company on Tuesday reached a $250 million settlement in a class-action lawsuit for false advertising of its artificial intelligence capabilities.

ABC News

78,610 просмотров • 3 месяцев назад

ARTIFICIAL INTELLIGENCE Pentagon UFO Report Shows Hundreds of New Incidents A new report from the Pentagon on UFOs reveals hundreds of new incidents have been reported involving unidentified aerial phenomena’s on a daily basis.
0:50

ARTIFICIAL INTELLIGENCE Pentagon UFO Report Shows Hundreds of New Incidents A new report from the Pentagon on UFOs reveals hundreds of new incidents have been reported involving unidentified aerial phenomena’s on a daily basis.

SANTINO

136,001 просмотров • 1 год назад