Mis-read part of the poll question, as I'm not attracted to men personally... But my answer is more what I prefer for myself.
I have mixed feelings about my body hair, maybe it's like sammm commented... we don't start off with so much hair and it grows in later. But will say that I trim my chest, stomach, and pubic hair to keep it a more manageable length. This requires less regular work compared to getting rid of all the hair, but also makes me cooler than allowing it to grow wildly. This is the main reason for me to worry about it as I tend to overheat easily and having lots of chest hair, especially during the summer only makes it worse.