Loading video...

Video Failed to Load

Go Home

Compare AI models side by side with the Artificial Analysis model comparison tool Select any model and compare them across: ➤ Artificial Analysis Intelligence Index scores ➤ Individual benchmark scores ➤ Artificial Analysis Capability Index scores including Finance & Accounting, Strategy & Ops, Legal, Healthcare & Medical, Engineering, and...

26,511 views • 5 days ago •via X (Twitter)

10 Comments

Theo - t3.gg's profile picture
Theo - t3.gg5 days ago

I’ll give you guys the codebase for this if you promise to actually ship it with dark mode and all the useless models turned off by default (WTF is step3 and why is it on???)

大伟|AI × Web3's profile picture
大伟|AI × Web35 days ago

十周陪伴比单个高光更有价值:观众真正买单的不是完美人设,而是看得见的成长轨迹。能让本人也为变化自豪,这段内容才完成了从流量到认同的转化。

Louis Amira's profile picture
Louis Amira5 days ago

Why is the model list incomplete? @TheUnbiasedCo Pareto would help a lot of people get more intelligence for less money.

🇮🇷اشکانیان🇮🇷's profile picture
🇮🇷اشکانیان🇮🇷5 days ago

Plaese test fledge alpha

Raimo's profile picture
Raimo5 days ago

add classification models!! Jev Vs openAi Decisions Vs others

Demi🧜🏽‍♀️'s profile picture
Demi🧜🏽‍♀️5 days ago

Compare AI models side by side with the Artificial Analysis model comparison tool. You and @JonLeeMiller are the two accounts I most enjoy following.

Jatin Garg's profile picture
Jatin Garg5 days ago

the comparison is only useful if it shows how models behave differently on the same exact prompt. aggregate benchmark scores don't predict which one works better for your specific use case.

ShadowAguy's profile picture
ShadowAguy5 days ago

the spreadsheet will outlive the leaderboard, which is how benchmark charts quietly become historical artifacts between model releases.

0x7z7z's profile picture
0x7z7z5 days ago

Dark mode guys for Gods sake

The AI Maximalist's profile picture
The AI Maximalist5 days ago

Artificial Analysis gives you clear scores for every model side by side so the best choice stands out without guesswork and saves time when picking tools

Related Videos

We’re launching Optima. Now anyone can create a custom benchmark for their use case, leveraging Artificial Analysis’ leading research and platform Building and running benchmarks is difficult. We have distilled Artificial Analysis’ research and experience developing benchmarks into Optima, a new platform for benchmarking models on your own workloads and comparing performance, speed and cost efficiency. Optima allows you to find the best model for your task, or an equally performant alternative to your current setup at 10x lower cost or time per task. We’ve integrated Artificial Analysis' research and experience in benchmarks across the Optima workflow: ➤ Build benchmarks based on your own data and use cases: There are three ways to build a benchmark with Optima. Upload an existing evaluation dataset from your own files or Hugging Face, or import agent traces from platforms including Arize AI, Braintrust and langfuse.com. Install the Optima skill to build a benchmark using context from your coding environment and previous sessions. Or simply describe your use case and provide example inputs and outputs, and Optima will build the benchmark for you ➤ Run across the latest models: Run the same benchmark across leading models in a single click, and keep your leaderboard up to date as soon as new models are released ➤ Bring Artificial Analysis grading to your own benchmark: Evaluate responses against objective rubric criteria or using the same pairwise judging approach used for Artificial Analysis benchmarks including GDPval-AA and AA-Briefcase. For pairwise judging, select your preferred responses from a sample and Optima uses those preferences to rank models across your test set ➤ Compare performance, cost and time efficiency: Optima measures more than model performance. Cost per Task and Time per Task are tracked alongside benchmark scores, with category-level results and support for custom metrics, allowing you to compare the tradeoffs between models for your specific use case Ahead of launch, here are examples questions our beta testers answered with Optima: ➤ Which model can save me 10x the cost without a meaningful decrease in quality for my finance & accounting agent? ➤ Which model best matches the writing style of lawyers for my legal agent? ➤ Which model can best identify different elements in my custom image dataset? Optima is available today. Build your own benchmark at

Artificial Analysis

133,508 views • 1 month ago