Well, the mind is part of the body, but I know what you mean.
My wife and I like both. My job's mentally stimulating and challenging (hers is, too), and we also like games that "exercise" the mind, like cards. We make sure to get plenty of physical exercise, too. I also find meditation and stretching/yoga to be excellent for the mind/body.