OpenAI's o1 had the highest share of questions answered when attempted in SimpleQA benchmark in 2025. Claude-3 had the highest share of simply not attempting questions, though whether this is due to lack of data or other reasons is unknown.
Source clarifies: "SimpleQA presents models with over 4,000 short fact-seeking questions that are straightforward, easily gradable, and relatively challenging. These questions span a diverse range of topics, including history, science and technology, art, and geography"
Profit from the additional features of your individual account
Currently, you are using a shared account. To use individual functions (e.g., mark statistics as favourites, set
statistic alerts) please log in with your personal account.
If you are an admin, please authenticate by logging in again.
Learn more about how Statista can support your business.
Stanford University. (March 30, 2025). Artificial intelligence (AI) models performance on SimpleQA benchmark in 2025, by share of questions answered [Graph]. In Statista. Retrieved July 06, 2025, from https://www.statista.com/statistics/1612496/ai-simpleqa-share-of-questions-answered/
Stanford University. "Artificial intelligence (AI) models performance on SimpleQA benchmark in 2025, by share of questions answered." Chart. March 30, 2025. Statista. Accessed July 06, 2025. https://www.statista.com/statistics/1612496/ai-simpleqa-share-of-questions-answered/
Stanford University. (2025). Artificial intelligence (AI) models performance on SimpleQA benchmark in 2025, by share of questions answered. Statista. Statista Inc.. Accessed: July 06, 2025. https://www.statista.com/statistics/1612496/ai-simpleqa-share-of-questions-answered/
Stanford University. "Artificial Intelligence (Ai) Models Performance on Simpleqa Benchmark in 2025, by Share of Questions Answered." Statista, Statista Inc., 30 Mar 2025, https://www.statista.com/statistics/1612496/ai-simpleqa-share-of-questions-answered/
Stanford University, Artificial intelligence (AI) models performance on SimpleQA benchmark in 2025, by share of questions answered Statista, https://www.statista.com/statistics/1612496/ai-simpleqa-share-of-questions-answered/ (last visited July 06, 2025)
Artificial intelligence (AI) models performance on SimpleQA benchmark in 2025, by share of questions answered [Graph], Stanford University, March 30, 2025. [Online]. Available: https://www.statista.com/statistics/1612496/ai-simpleqa-share-of-questions-answered/
