Sample content · easy to replace
Glossary
Benchmark
A frozen set of tasks plus a scoring rule. It is not the same as your production job.
Sample glossary term.
A benchmark is an evaluation suite. For agents, the harness is part of what you are measuring. Read dates, cost, and contamination notes before you believe a chart. Sample desk note: How to read an agent benchmark.