Don't. Tab out and play Fallout 4 while the game progresses along, and only vote if they try to kick.