Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Mathematics offers a unique window into AI's reasoning capabilities. Discover why we've launched FrontierMath—a benchmark of hundreds of unpublished, expert-level math problems—to understand the frontier of artificial intelligence.

EpochAIResearch's profile picture

Epoch AI

47,066 subscribers

394,050 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & TechnologieBildung
LIVE

Anya Rossi• Live Now

Private livecam show

10 Kommentare

Profilbild von Epoch AI
Epoch AIvor 1 Jahr

Learn more about FrontierMath, explore sample problems with detailed solutions, and see how current AI systems perform on FrontierMath:

Profilbild von Daniel Paleka
Daniel Palekavor 1 Jahr

How many problems are there in the dataset? I guess about 290?

Profilbild von Tilman Bayer
Tilman Bayervor 1 Jahr

SOTA among math benchmarks... I see what you did there 😉

Profilbild von Alfred Wahlforss
Alfred Wahlforssvor 1 Jahr

Go Elliot!

Profilbild von Fred Zhang
Fred Zhangvor 1 Jahr

are problem statements formalized?

Profilbild von Charlie Snell
Charlie Snellvor 1 Jahr

Banger

Profilbild von Luis Garicano 🇪🇺🇺🇦
Luis Garicano 🇪🇺🇺🇦vor 1 Jahr

You did not try o1-preview?

Profilbild von João Augusto
João Augustovor 1 Jahr

That is awesome guys!!

Profilbild von YJxAI – e/acc
YJxAI – e/accvor 1 Jahr

IF Humans can take weeks to achieve the result. Should not o1 be given the same amount of time to think . Given its increase in performance by increasing Test time Compute

Profilbild von Jason Rute @ JMM 2025
Jason Rute @ JMM 2025vor 1 Jahr

What is the process by which researchers can submit models to be evaluated on this benchmark? Or are you only interested in leading foundation models? (But even then, you have to consider prompting strategies, no?)

Ähnliche Videos

"It’s not AI; it’s AC; Artificial Cleverness!" Sir Roger Penrose explains why current "Artificial Intelligence" is missing the most critical ingredient: consciousness. By delving into the limits of mathematical computability, he argues that while computers are masters of "computational mathematics," true intelligence requires a conscious understanding that exists beyond any algorithm. At the fundamental level, what we call AI is just high-speed calculation. To Penrose, intelligence and consciousness are inseparable; and until a machine can "understand," it’s simply being clever.
0:52

"It’s not AI; it’s AC; Artificial Cleverness!" Sir Roger Penrose explains why current "Artificial Intelligence" is missing the most critical ingredient: consciousness. By delving into the limits of mathematical computability, he argues that while computers are masters of "computational mathematics," true intelligence requires a conscious understanding that exists beyond any algorithm. At the fundamental level, what we call AI is just high-speed calculation. To Penrose, intelligence and consciousness are inseparable; and until a machine can "understand," it’s simply being clever.

Cosmos Archive

83,200 Aufrufe • vor 5 Monaten

AI only has pre-schooler level capabilities for visual tasks. "The frontier models—the best of them—still reason around the age of a preschooler, and any elementary school kid in that benchmark was able to beat all the frontier models on these visual tasks." "These are tasks that are not just object recognition. It's about spatial reasoning... tasks like navigating through the maze…” — Andrew M. Dai, CEO of Elorian
0:49

AI only has pre-schooler level capabilities for visual tasks. "The frontier models—the best of them—still reason around the age of a preschooler, and any elementary school kid in that benchmark was able to beat all the frontier models on these visual tasks." "These are tasks that are not just object recognition. It's about spatial reasoning... tasks like navigating through the maze…” — Andrew M. Dai, CEO of Elorian

The Information

25,680 Aufrufe • vor 1 Monat

Does AI have a plausibility problem? Or rather, do we have a problem with AI's plausibility? Watch Terry Tao's full Oxford Mathematics Public Lecture (supported by XTX Markets) as he suggests new ways of doing mathematics in an artificial intelligence future.
0:53

Does AI have a plausibility problem? Or rather, do we have a problem with AI's plausibility? Watch Terry Tao's full Oxford Mathematics Public Lecture (supported by XTX Markets) as he suggests new ways of doing mathematics in an artificial intelligence future.

Oxford Mathematics

31,830 Aufrufe • vor 2 Jahren

A month ago, we invited 30 of the world’s top mathematicians to Berkeley for a weekend to finish a very hard math exam. The 2025 FrontierMath Symposium wrapped up the hardest tier of FrontierMath, our benchmark for AI’s math abilities. The mathematicians tested AI models on their most challenging math problems, and discussed AI’s future in math. Watch our closing ceremony footage for a glimpse behind the scenes. -Timestamps- (00:00) - Intro by Elliot Glazer - Epoch AI (03:38) - Topology | Sergei Gukov - Caltech (06:53) - Algebraic Geometry | Ravi Vakil - Stanford (09:10) - Number Theory | Ken Ono - University of Virginia (13:19) - Combinatorics | Igor Pak - UCLA (16:54) - Analysis | Paata Ivanisvili - UC Irvine (18:18) - Closing Remarks
19:39

A month ago, we invited 30 of the world’s top mathematicians to Berkeley for a weekend to finish a very hard math exam. The 2025 FrontierMath Symposium wrapped up the hardest tier of FrontierMath, our benchmark for AI’s math abilities. The mathematicians tested AI models on their most challenging math problems, and discussed AI’s future in math. Watch our closing ceremony footage for a glimpse behind the scenes. -Timestamps- (00:00) - Intro by Elliot Glazer - Epoch AI (03:38) - Topology | Sergei Gukov - Caltech (06:53) - Algebraic Geometry | Ravi Vakil - Stanford (09:10) - Number Theory | Ken Ono - University of Virginia (13:19) - Combinatorics | Igor Pak - UCLA (16:54) - Analysis | Paata Ivanisvili - UC Irvine (18:18) - Closing Remarks

Epoch AI

21,379 Aufrufe • vor 1 Jahr

📁 Yann LeCun, an expert in artificial intelligence and a pioneer of deep learning, explains that current systems do not understand the physical world and lack real memory or reasoning. He adds that, despite the vast resources spent on training and refining them, they remain far behind the learning ability of a four-year-old child.
1:51

📁 Yann LeCun, an expert in artificial intelligence and a pioneer of deep learning, explains that current systems do not understand the physical world and lack real memory or reasoning. He adds that, despite the vast resources spent on training and refining them, they remain far behind the learning ability of a four-year-old child.

Jon Hernandez

24,685 Aufrufe • vor 9 Monaten

Terence Tao says AI could help rework mathematics from the ground up, doing math problems at a scale never done before and leading to a new age of discovery
0:35

Terence Tao says AI could help rework mathematics from the ground up, doing math problems at a scale never done before and leading to a new age of discovery

Tsarathustra

63,759 Aufrufe • vor 1 Jahr

❗️Previously unpublished footage of the launch of an S-200 anti-aircraft missile transferred by Poland, converted into a ground-launched version
0:37

❗️Previously unpublished footage of the launch of an S-200 anti-aircraft missile transferred by Poland, converted into a ground-launched version

🪖MilitaryNewsUA🇺🇦

239,759 Aufrufe • vor 1 Monat

“AI can not crack bitcoin”, says Elon Musk “We see no way for artificial intelligence to subvert the fundamentals of mathematics and hash bitcoin easily. AI can not defy fundamental math. It can improve the efficiency of hashing, but not crack it”
1:25

“AI can not crack bitcoin”, says Elon Musk “We see no way for artificial intelligence to subvert the fundamentals of mathematics and hash bitcoin easily. AI can not defy fundamental math. It can improve the efficiency of hashing, but not crack it”

Documenting ₿itcoin 📄

308,099 Aufrufe • vor 1 Jahr

I launched my High-Level Advisory Body on Artificial Intelligence. This is the starting point for a global conversation on the governance of AI, so that its benefits to all of humanity are maximized, and the risks contained & diminished.
0:36

I launched my High-Level Advisory Body on Artificial Intelligence. This is the starting point for a global conversation on the governance of AI, so that its benefits to all of humanity are maximized, and the risks contained & diminished.

António Guterres

345,938 Aufrufe • vor 2 Jahren

We’re pushing the boundaries of intelligence even further with Gemini 3 Deep Think. 🧠 This mode meaningfully improves reasoning capabilities by exploring many hypotheses simultaneously to solve problems. Here’s how it coded a simulated dominoes game from a single prompt ⬇️
0:40

We’re pushing the boundaries of intelligence even further with Gemini 3 Deep Think. 🧠 This mode meaningfully improves reasoning capabilities by exploring many hypotheses simultaneously to solve problems. Here’s how it coded a simulated dominoes game from a single prompt ⬇️

Google DeepMind

248,035 Aufrufe • vor 8 Monaten

#WATCH | Maharashtra: In a bid to improve the nutrition level of tribal children of Gadchiroli, a unique Artificial Intelligence-based machine has been installed at Todsa Ashram School of Etapalli. The machine takes a photo of the student with her/his plate of food and within a few seconds, without any human intervention, identifies whether the quality of the food is good.
1:16

#WATCH | Maharashtra: In a bid to improve the nutrition level of tribal children of Gadchiroli, a unique Artificial Intelligence-based machine has been installed at Todsa Ashram School of Etapalli. The machine takes a photo of the student with her/his plate of food and within a few seconds, without any human intervention, identifies whether the quality of the food is good.

ANI

1,494,698 Aufrufe • vor 3 Jahren

Pope Leo XIV calls for artificial intelligence to be immediately disarmed and compares it to a nuclear missile. He says artificial intelligence is turning into an instrument of death that seeks to dominate the lives of all humans. “An instrument of domination.”
1:01

Pope Leo XIV calls for artificial intelligence to be immediately disarmed and compares it to a nuclear missile. He says artificial intelligence is turning into an instrument of death that seeks to dominate the lives of all humans. “An instrument of domination.”

Shadow of Ezra

131,381 Aufrufe • vor 2 Monaten

"For it to NOT be a bubble... requires that the AI companies make hundreds of billions of dollars a year, in the next 24 months. That would be the fastest growing business in history." —Derek Thompson on why "there's no off-ramp" for the impact of artificial intelligence
1:56

"For it to NOT be a bubble... requires that the AI companies make hundreds of billions of dollars a year, in the next 24 months. That would be the fastest growing business in history." —Derek Thompson on why "there's no off-ramp" for the impact of artificial intelligence

Pablo Torre Finds Out

73,775 Aufrufe • vor 5 Monaten

Owners of some iPhones are in line to get cash payments of up to $95 from Apple after the company on Tuesday reached a $250 million settlement in a class-action lawsuit for false advertising of its artificial intelligence capabilities.
1:02

Owners of some iPhones are in line to get cash payments of up to $95 from Apple after the company on Tuesday reached a $250 million settlement in a class-action lawsuit for false advertising of its artificial intelligence capabilities.

The Associated Press

135,774 Aufrufe • vor 3 Monaten

Owners of some iPhones are in line to get cash payments of up to $95 from Apple after the company on Tuesday reached a $250 million settlement in a class-action lawsuit for false advertising of its artificial intelligence capabilities.
0:26

Owners of some iPhones are in line to get cash payments of up to $95 from Apple after the company on Tuesday reached a $250 million settlement in a class-action lawsuit for false advertising of its artificial intelligence capabilities.

ABC News

78,610 Aufrufe • vor 3 Monaten

ARTIFICIAL INTELLIGENCE Pentagon UFO Report Shows Hundreds of New Incidents A new report from the Pentagon on UFOs reveals hundreds of new incidents have been reported involving unidentified aerial phenomena’s on a daily basis.
0:50

ARTIFICIAL INTELLIGENCE Pentagon UFO Report Shows Hundreds of New Incidents A new report from the Pentagon on UFOs reveals hundreds of new incidents have been reported involving unidentified aerial phenomena’s on a daily basis.

SANTINO

136,001 Aufrufe • vor 1 Jahr