Also, I can sort of see what you mean about this hurting mafia a bit, but most arguments that are made over who voted first aren't ever challenged. Usually players have a pretty good idea of the order of votes. I don't think this would make much of a difference. I could be wrong though.
Its still no reason not to implement it into spectating games though.
