The eyes have it: Men do see things differently to women
The way that the visual centers of men and women’s brains works is different, finds new research published in BioMed Central’s open access journal Biology of Sex Differences. Men have greater sensitivity to fine detail and rapidly moving stimuli, but women are better at discriminating between colors.
Not sure what your mean by it doesn’t work that way
If men were predominantly doing the hunting, women would be more likely to choose a more successful hunter (more likely to pass on their genes if they have a better mate)
Also in general the ones who were better at hunting and their mates would be more likely to survive long enough to have children