Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Mathematics offers a unique window into AI's reasoning capabilities. Discover why we've launched FrontierMath—a benchmark of hundreds of unpublished, expert-level math problems—to understand the frontier of artificial intelligence.

EpochAIResearch's profile picture

Epoch AI

47,066 subscribers

394,050 görüntüleme • 1 yıl önce •via X (Twitter)

Bilim & TeknolojiEğitim
LIVE

Anya Rossi• Live Now

Private livecam show

10 Yorum

Epoch AI profil fotoğrafı
Epoch AI1 yıl önce

Learn more about FrontierMath, explore sample problems with detailed solutions, and see how current AI systems perform on FrontierMath:

Daniel Paleka profil fotoğrafı
Daniel Paleka1 yıl önce

How many problems are there in the dataset? I guess about 290?

Tilman Bayer profil fotoğrafı
Tilman Bayer1 yıl önce

SOTA among math benchmarks... I see what you did there 😉

Alfred Wahlforss profil fotoğrafı
Alfred Wahlforss1 yıl önce

Go Elliot!

Fred Zhang profil fotoğrafı
Fred Zhang1 yıl önce

are problem statements formalized?

Charlie Snell profil fotoğrafı
Charlie Snell1 yıl önce

Banger

Luis Garicano 🇪🇺🇺🇦 profil fotoğrafı
Luis Garicano 🇪🇺🇺🇦1 yıl önce

You did not try o1-preview?

João Augusto profil fotoğrafı
João Augusto1 yıl önce

That is awesome guys!!

YJxAI – e/acc profil fotoğrafı
YJxAI – e/acc1 yıl önce

IF Humans can take weeks to achieve the result. Should not o1 be given the same amount of time to think . Given its increase in performance by increasing Test time Compute

Jason Rute @ JMM 2025 profil fotoğrafı
Jason Rute @ JMM 20251 yıl önce

What is the process by which researchers can submit models to be evaluated on this benchmark? Or are you only interested in leading foundation models? (But even then, you have to consider prompting strategies, no?)

Benzer Videolar

"It’s not AI; it’s AC; Artificial Cleverness!" Sir Roger Penrose explains why current "Artificial Intelligence" is missing the most critical ingredient: consciousness. By delving into the limits of mathematical computability, he argues that while computers are masters of "computational mathematics," true intelligence requires a conscious understanding that exists beyond any algorithm. At the fundamental level, what we call AI is just high-speed calculation. To Penrose, intelligence and consciousness are inseparable; and until a machine can "understand," it’s simply being clever.
0:52

"It’s not AI; it’s AC; Artificial Cleverness!" Sir Roger Penrose explains why current "Artificial Intelligence" is missing the most critical ingredient: consciousness. By delving into the limits of mathematical computability, he argues that while computers are masters of "computational mathematics," true intelligence requires a conscious understanding that exists beyond any algorithm. At the fundamental level, what we call AI is just high-speed calculation. To Penrose, intelligence and consciousness are inseparable; and until a machine can "understand," it’s simply being clever.

Cosmos Archive

83,200 görüntüleme • 5 ay önce

AI only has pre-schooler level capabilities for visual tasks. "The frontier models—the best of them—still reason around the age of a preschooler, and any elementary school kid in that benchmark was able to beat all the frontier models on these visual tasks." "These are tasks that are not just object recognition. It's about spatial reasoning... tasks like navigating through the maze…” — Andrew M. Dai, CEO of Elorian
0:49

AI only has pre-schooler level capabilities for visual tasks. "The frontier models—the best of them—still reason around the age of a preschooler, and any elementary school kid in that benchmark was able to beat all the frontier models on these visual tasks." "These are tasks that are not just object recognition. It's about spatial reasoning... tasks like navigating through the maze…” — Andrew M. Dai, CEO of Elorian

The Information

25,680 görüntüleme • 1 ay önce

Does AI have a plausibility problem? Or rather, do we have a problem with AI's plausibility? Watch Terry Tao's full Oxford Mathematics Public Lecture (supported by XTX Markets) as he suggests new ways of doing mathematics in an artificial intelligence future.
0:53

Does AI have a plausibility problem? Or rather, do we have a problem with AI's plausibility? Watch Terry Tao's full Oxford Mathematics Public Lecture (supported by XTX Markets) as he suggests new ways of doing mathematics in an artificial intelligence future.

Oxford Mathematics

31,830 görüntüleme • 2 yıl önce

A month ago, we invited 30 of the world’s top mathematicians to Berkeley for a weekend to finish a very hard math exam. The 2025 FrontierMath Symposium wrapped up the hardest tier of FrontierMath, our benchmark for AI’s math abilities. The mathematicians tested AI models on their most challenging math problems, and discussed AI’s future in math. Watch our closing ceremony footage for a glimpse behind the scenes. -Timestamps- (00:00) - Intro by Elliot Glazer - Epoch AI (03:38) - Topology | Sergei Gukov - Caltech (06:53) - Algebraic Geometry | Ravi Vakil - Stanford (09:10) - Number Theory | Ken Ono - University of Virginia (13:19) - Combinatorics | Igor Pak - UCLA (16:54) - Analysis | Paata Ivanisvili - UC Irvine (18:18) - Closing Remarks
19:39

A month ago, we invited 30 of the world’s top mathematicians to Berkeley for a weekend to finish a very hard math exam. The 2025 FrontierMath Symposium wrapped up the hardest tier of FrontierMath, our benchmark for AI’s math abilities. The mathematicians tested AI models on their most challenging math problems, and discussed AI’s future in math. Watch our closing ceremony footage for a glimpse behind the scenes. -Timestamps- (00:00) - Intro by Elliot Glazer - Epoch AI (03:38) - Topology | Sergei Gukov - Caltech (06:53) - Algebraic Geometry | Ravi Vakil - Stanford (09:10) - Number Theory | Ken Ono - University of Virginia (13:19) - Combinatorics | Igor Pak - UCLA (16:54) - Analysis | Paata Ivanisvili - UC Irvine (18:18) - Closing Remarks

Epoch AI

21,379 görüntüleme • 1 yıl önce

📁 Yann LeCun, an expert in artificial intelligence and a pioneer of deep learning, explains that current systems do not understand the physical world and lack real memory or reasoning. He adds that, despite the vast resources spent on training and refining them, they remain far behind the learning ability of a four-year-old child.
1:51

📁 Yann LeCun, an expert in artificial intelligence and a pioneer of deep learning, explains that current systems do not understand the physical world and lack real memory or reasoning. He adds that, despite the vast resources spent on training and refining them, they remain far behind the learning ability of a four-year-old child.

Jon Hernandez

24,687 görüntüleme • 9 ay önce

Terence Tao says AI could help rework mathematics from the ground up, doing math problems at a scale never done before and leading to a new age of discovery
0:35

Terence Tao says AI could help rework mathematics from the ground up, doing math problems at a scale never done before and leading to a new age of discovery

Tsarathustra

63,759 görüntüleme • 1 yıl önce

❗️Previously unpublished footage of the launch of an S-200 anti-aircraft missile transferred by Poland, converted into a ground-launched version
0:37

❗️Previously unpublished footage of the launch of an S-200 anti-aircraft missile transferred by Poland, converted into a ground-launched version

🪖MilitaryNewsUA🇺🇦

239,759 görüntüleme • 1 ay önce

I launched my High-Level Advisory Body on Artificial Intelligence. This is the starting point for a global conversation on the governance of AI, so that its benefits to all of humanity are maximized, and the risks contained & diminished.
0:36

I launched my High-Level Advisory Body on Artificial Intelligence. This is the starting point for a global conversation on the governance of AI, so that its benefits to all of humanity are maximized, and the risks contained & diminished.

António Guterres

345,938 görüntüleme • 2 yıl önce

“AI can not crack bitcoin”, says Elon Musk “We see no way for artificial intelligence to subvert the fundamentals of mathematics and hash bitcoin easily. AI can not defy fundamental math. It can improve the efficiency of hashing, but not crack it”
1:25

“AI can not crack bitcoin”, says Elon Musk “We see no way for artificial intelligence to subvert the fundamentals of mathematics and hash bitcoin easily. AI can not defy fundamental math. It can improve the efficiency of hashing, but not crack it”

Documenting ₿itcoin 📄

308,099 görüntüleme • 1 yıl önce

We’re pushing the boundaries of intelligence even further with Gemini 3 Deep Think. 🧠 This mode meaningfully improves reasoning capabilities by exploring many hypotheses simultaneously to solve problems. Here’s how it coded a simulated dominoes game from a single prompt ⬇️
0:40

We’re pushing the boundaries of intelligence even further with Gemini 3 Deep Think. 🧠 This mode meaningfully improves reasoning capabilities by exploring many hypotheses simultaneously to solve problems. Here’s how it coded a simulated dominoes game from a single prompt ⬇️

Google DeepMind

248,035 görüntüleme • 8 ay önce

#WATCH | Maharashtra: In a bid to improve the nutrition level of tribal children of Gadchiroli, a unique Artificial Intelligence-based machine has been installed at Todsa Ashram School of Etapalli. The machine takes a photo of the student with her/his plate of food and within a few seconds, without any human intervention, identifies whether the quality of the food is good.
1:16

#WATCH | Maharashtra: In a bid to improve the nutrition level of tribal children of Gadchiroli, a unique Artificial Intelligence-based machine has been installed at Todsa Ashram School of Etapalli. The machine takes a photo of the student with her/his plate of food and within a few seconds, without any human intervention, identifies whether the quality of the food is good.

ANI

1,494,698 görüntüleme • 3 yıl önce

Pope Leo XIV calls for artificial intelligence to be immediately disarmed and compares it to a nuclear missile. He says artificial intelligence is turning into an instrument of death that seeks to dominate the lives of all humans. “An instrument of domination.”
1:01

Pope Leo XIV calls for artificial intelligence to be immediately disarmed and compares it to a nuclear missile. He says artificial intelligence is turning into an instrument of death that seeks to dominate the lives of all humans. “An instrument of domination.”

Shadow of Ezra

131,381 görüntüleme • 2 ay önce

"For it to NOT be a bubble... requires that the AI companies make hundreds of billions of dollars a year, in the next 24 months. That would be the fastest growing business in history." —Derek Thompson on why "there's no off-ramp" for the impact of artificial intelligence
1:56

"For it to NOT be a bubble... requires that the AI companies make hundreds of billions of dollars a year, in the next 24 months. That would be the fastest growing business in history." —Derek Thompson on why "there's no off-ramp" for the impact of artificial intelligence

Pablo Torre Finds Out

73,775 görüntüleme • 5 ay önce

Owners of some iPhones are in line to get cash payments of up to $95 from Apple after the company on Tuesday reached a $250 million settlement in a class-action lawsuit for false advertising of its artificial intelligence capabilities.
1:02

Owners of some iPhones are in line to get cash payments of up to $95 from Apple after the company on Tuesday reached a $250 million settlement in a class-action lawsuit for false advertising of its artificial intelligence capabilities.

The Associated Press

135,774 görüntüleme • 3 ay önce

Owners of some iPhones are in line to get cash payments of up to $95 from Apple after the company on Tuesday reached a $250 million settlement in a class-action lawsuit for false advertising of its artificial intelligence capabilities.
0:26

Owners of some iPhones are in line to get cash payments of up to $95 from Apple after the company on Tuesday reached a $250 million settlement in a class-action lawsuit for false advertising of its artificial intelligence capabilities.

ABC News

78,610 görüntüleme • 3 ay önce

ARTIFICIAL INTELLIGENCE Pentagon UFO Report Shows Hundreds of New Incidents A new report from the Pentagon on UFOs reveals hundreds of new incidents have been reported involving unidentified aerial phenomena’s on a daily basis.
0:50

ARTIFICIAL INTELLIGENCE Pentagon UFO Report Shows Hundreds of New Incidents A new report from the Pentagon on UFOs reveals hundreds of new incidents have been reported involving unidentified aerial phenomena’s on a daily basis.

SANTINO

136,001 görüntüleme • 1 yıl önce