This is exactly why I've been struggling with this issue of comparative, versus analytical testing.
In comparative testing, your only goal is establish which block is better, and its your total margins of error that's going to define your ability to do that. Otherwise, you just have to make sure that your testing conditions are similar, and as pHaestus pointed out, your results are going to fall within a range, which is best expressed using error bars.
In plain words, you'll only be able to tell that one block is better than the other if these error bars don't overlap. The more accurate you test, the shorter the error bar is going to be.
[edit: rambling removed]
Since87: thanks for the correction (fixed) (I hope that the meaning was still understood!) Nice catch!
Last edited by bigben2k; 09-12-2003 at 08:32 AM.
|