Night owls tended to see the dress correctly.

It has something to do with how good people are at looking at visual keys in the picture to determine the color.

All colors are pervieved relatively. Vsauce on YouTube has a good video on this