Java performance geek Aleksey Shipilёv doesn't just work on tools that help developers to write and run better benchmarks; he also takes on the meta side of performance measurement. A good benchmark shouldn't be used to "prove a point in a holy war" or as a marketing tool, he says. Instead, good benchmarks strive to understand the whole system:
The exact numbers don’t usually matter there, it is important to see through them and understand why those numbers are arranged in that particular way [...] Benchmarks, in this parlance, are the tools which isolate and quantify the behavior in a particular lab environment.
-- Interview with Martijn Verburg, jClarity, May 2014
Previous Topic
