You don't have to select the last blinking one. The box with the points always starts on the right. Then, they're shuffled 4 times, and each time the 2 boxes that blink swap their positions.
So, let's say, on the first shuffle the left and middle boxes blink, the points still are in the right...