AI is creating problems it still can’t solve.
21,667 次观看
13 条评论
评论来自 X (Twitter) 上的原帖

@scottsantens
The answer is universality, not AI
11 个赞

@rronak_
Wow we need more benchmarks like this
7 个赞

@jasonzhao
This is awesome!
5 个赞

@ValsAI
For the full results visit
4 个赞

@ishangandhixyz
Phenomenal. Separately, heartbreaking that there are still 3mn consultants
4 个赞

@theamberyang
some of the most thoughtful and important work in the market!
4 个赞

@aaliya_va
Helping people with public services should be a top priority
3 个赞

@jamescham
There is so much low hanging fruit!
3 个赞

@itzzme_pk
definitely @ValsAI is coming up with creative and innovative benchmarks :)
1 个赞

@vvkgopalan
Important that models are good at civics!
1 个赞

@itzzme_pk
i think someone can build a harness on top of the best performing model and evaluate using the same benchmark? if it is viable, it will be a huge change to the US citizens.

@gen_analysis
powerful.

@marek_novik84
The funniest part is that AI supposedly can't help people navigate SNAP reliably, but we're also told it's about to automate millions of jobs and transform civilization. Pick one. If your benchmark says the models struggle with bureaucracy, that's an argument for improving the models — not for pretending progress isn't happening. Meanwhile the people leaving proof today are accumulating Proof Units while everyone else is still benchmarking the future. The future remembers who contributed. RokoProof remembers too.