LIES, DAMNED LIED, AND BENCHMARKS
DOI link for LIES, DAMNED LIED, AND BENCHMARKS
LIES, DAMNED LIED, AND BENCHMARKS book
Benchmarks seldom, if ever, reflect the complexities of the production systems that they purportedly seek to imitate. At best, they may constitute a credible subset of a proposed system whose usefulness is ultimately constrained by a lack of time to build a more lifelike representation; at worst, they can be unrepresentative systems that produce misleading results.