OpenNash ↗
AI evaluation domain · 21 source-backed records

Science, Math, and Reasoning Benchmarks

These suites test mathematical reasoning, research-level science, biology, physics, and scientific coding. Many are built to resist contamination, and top scores on some are still low.

21 benchmarksVerified 2026-11-03JSON data ↓
Decision guidance

What do hard science and reasoning benchmarks tell us?

Use them to find the limits of current models and to compare reasoning settings. They do not show that a model can do research alone. Check whether tools were on, answers are machine-checked, tasks are private, and runs were repeated.

21

Benchmarks in this domain

Sources first · alphabetical collection order

Runnability describes access to a usable repository, dataset, or harness—not whether setup is easy.

AIME 2026

specializedrunnable
2026-11-03
Tests
Tests math problem solving on the 30 problems of the 2026 AIME (American Invitational Mathematics Examination). Each answer is an integer.
Best for
A dated, difficult math signal with explicit versioning.
Classification
benchmark · emerging · mixed

AIRS-Bench

specializedrunnable
2026-10-26
Tests
Tests AI research agents on 20 tasks taken from recent machine learning papers. Agents must plan, run, and improve experiments with no baseline code.
Best for
Comparing AI research agents on executable experiment outcomes.
Classification
benchmark · emerging · open

ARC-AGI-2

recommendedpartial
2026-10-26
Tests
Tests abstract reasoning with grid puzzles. The model sees a few input-output examples and must produce the output grid for a new input.
Best for
Abstract reasoning and generalization stress testing
Classification
benchmark · legacy · mixed

ARC-AGI-3

recommendedpartial
2026-10-26
Tests
Puts an agent in new game environments with no instructions. The agent must find the goal, learn the rules, and win as efficiently as a human.
Best for
Testing how fast an agent learns a new task from experience.
Classification
agent benchmark · current · mixed

BIG-Bench Hard (BBH)

referencerunnable
2026-10-26
Tests
Tests multi-step reasoning on 23 hard BIG-Bench tasks where earlier models scored below the average human rater.
Best for
Legacy reasoning regression checks
Classification
benchmark · legacy · open

CritPt

specializedrunnable
2026-10-26
Tests
Tests LLMs (large language models) on research-level physics problems that physicists wrote from their own unpublished work. Answers can be checked by machine.
Best for
Niche frontier physics reasoning
Classification
benchmark · current · open

FrontierMath

recommendedhosted
2026-10-26
Tests
Gives the model several hundred unpublished math problems written by mathematicians. Tiers 1-3 go from undergraduate to advanced graduate level. Tier 4 is research level.
Best for
Comparing the strongest models on hard math that is not in public training data.
Classification
benchmark · current · hosted

GPQA / GPQA Diamond

recommendedrunnable
2026-11-03
Tests
Tests science knowledge with multiple-choice questions in biology, physics, and chemistry. PhD experts reach 65 percent, and skilled non-experts with web access reach 34 percent.
Best for
Expert science reasoning
Classification
benchmark · current · open

GSM8K

referencerunnable
2026-11-03
Tests
Tests multi-step arithmetic on 8,500 grade-school math word problems.
Best for
Historical baselines and regression checks; it is increasingly saturated for frontier-model selection.
Classification
benchmark · legacy · open

HMMT February 2026

specializedrunnable
2026-11-03
Tests
Gives the model the problems from the February 2026 HMMT (Harvard-MIT Mathematics Tournament) competition. Checks each final answer against a gold answer.
Best for
A fresh math signal that complements AIME-style evaluation.
Classification
benchmark · emerging · mixed

Humanity's Last Exam

recommendedrunnable
2026-11-03
Tests
Gives the model 2,500 expert-written closed-ended questions across many academic subjects, some with images. Checks multiple-choice and short answers automatically.
Best for
Hard frontier academic reasoning
Classification
benchmark · current · open

LAB-Bench / LABBench2

recommendedrunnable
2026-10-26
Tests
Tests whether an AI system can do practical biology research tasks. Tasks cover literature, figures, databases, protocols, and DNA and protein sequences. LABBench2 puts similar tasks in more realistic contexts.
Best for
Biology research assistants
Classification
benchmark · current · open

LifeSciBench

specializedhosted
2026-10-26
Tests
Gives the model expert-written life-science research tasks with a grading rubric for each task. Tests realistic research work, not only biology question answering.
Best for
Evaluating whether systems can support realistic research work beyond biology QA.
Classification
benchmark · emerging · mixed

LiveBench

recommendedrunnable
2026-10-26
Tests
Gives the model new questions from recent sources such as math competitions, arXiv papers, and news. Covers math, coding, reasoning, language, instruction following, and data analysis.
Best for
General model signal that resists stale benchmark gaming
Classification
benchmark · current · open

MATH / AIME-style evals

recommendedrunnable
2026-10-26
Tests
Gives the model competition mathematics problems with a single final answer. MATH has 12,500 problems with step-by-step solutions.
Best for
Mathematical reasoning and launch-card comparison
Classification
benchmark · current · open

MLE-bench

recommendedrunnable
2026-10-26
Tests
Gives an AI agent 75 machine-learning engineering competitions from Kaggle. The agent must prepare data, train models, and submit predictions.
Best for
ML engineering agents
Classification
agent benchmark · current · open

MMLU-Pro

recommendedrunnable
2026-11-03
Tests
Gives the model multiple-choice questions across academic and professional subjects, with ten answer options. It adds harder reasoning questions and removes noisy MMLU questions.
Best for
Broad expert knowledge screening
Classification
benchmark · current · open

NanoFold Public

specializedrunnable
2026-11-03
Tests
Tests how well a protein structure model learns from a small fixed training set. Public data has 10,000 training chains and 1,000 validation chains. Ranking uses hidden validation chains.
Best for
Specialist life-science model comparisons with a public result feed.
Classification
benchmark · emerging · open

Pencil Puzzle Bench

specializedrunnable
2026-10-26
Tests
Gives the model pencil puzzles, which are constraint-satisfaction problems with one unique solution. Checks every move against the puzzle rules.
Best for
Reasoning without LLM judges
Classification
benchmark · current · open

SciAgentArena

specializedrunnable
2026-10-26
Tests
Gives AI agents about 200 real research tasks with step-by-step verification in an interactive environment. Tests whether agents can do scientific data analysis and open-ended research.
Best for
Comparing research-agent reliability, cost, and task-level scientific contribution.
Classification
benchmark · emerging · open

WeirdML

specializedpartial
2026-10-26
Tests
Gives the model unusual hand-made machine learning tasks with unfamiliar data. In v3, an agent must build ML (machine learning) pipelines with limited data, unclear goals, or little feedback.
Best for
Anti-gaming ML reasoning
Classification
benchmark · current · mixed