Another thing correlated with gender is levels of various hormones.
Hormones can affect the development and function of various parts of the body including the brain. Thus they could affect perception and interpretation of perceptions.
Perception is a very strong predictor of interest - people are not interested in things that cannot perceive. e.g. I am not motivated to clean the house until long after my wife is because I literally do not see the dust until the concentration passes as sufficient threshold. My wife sees it much sooner - different eyes. When she points it out to me, then I can see it and am motivated to clean.
Some aspects of perception are definitely gender-based. Tetrachomas are (almost) always women. Colour-blind people are much more often men. I'm sure you can imagine that affecting interest in assorted different ways.
I'm sure there are other perception differences that correlate to some extent with genetic or hormonal differences between the genders - unfortunately I don't have a list.