I don't believe that this is the case, but it's fun to think about:

It'd be interesting if the median physical form of males/females that people find attractive was actually the form that Adam and Eve had, and the preferences for either form are still there to this day, only hidden amidst some divergences.

This is complicated by that cultures seem to have varying ideas of the ideal physical form, but, for fun, consider that this could be the case due to subjective differences in the perception of those forms by our ancestors, and those perceptions have been magnified many times over the generations.