22 Sep 12, 01:51AM
Notice the portion where I specifically mention "compared to the other map in the head to head." The head to head view is a skewing factor that doesn't necessarily end up giving you the specific information that is wanted.
If your poll somehow put map A against map B a greater number of times than any other map, and map B sucks, then map A will have an artificially inflated score because of the map to which it is being compared.
In the two poll styles that I suggested, you are getting directly to the exact data you want on the first pass, every time, with no confounding factors. Each map is weighed on its own merits and is either liked or not liked, in the first. In the second, people pick their top liked maps, with an option to put them in weighted order.
These give only the information desired and nothing more, with the least possibility for unintentional bias.
If your poll somehow put map A against map B a greater number of times than any other map, and map B sucks, then map A will have an artificially inflated score because of the map to which it is being compared.
In the two poll styles that I suggested, you are getting directly to the exact data you want on the first pass, every time, with no confounding factors. Each map is weighed on its own merits and is either liked or not liked, in the first. In the second, people pick their top liked maps, with an option to put them in weighted order.
These give only the information desired and nothing more, with the least possibility for unintentional bias.