Yes and No. It depends for me. Is it something that is going to hurt you or cause resentment? If it is I would say no or have to talk about it. If it is something not so life threatening that my partner enjoys and it only happens every now and then sure.