Wait, so this is in a non committed relationship? If this is the case, then no, I wouldn't be mad. I would be annoyed but that's about it unless it kept happening on a continual basis.
Here's why, why do all the stuff leading up to sex if there was no natural completion of the process? To be clear, I mean activities that include and not limited to dirty talk, making out, heavy petting, fondling, viewing the partner in her/his underwear, viewing him/her topless, bottomless, and other visually stimulating activities.
For me, that is just too much stimulation to be left not utilized. I would need a good reason why this was happening in order for me not to "move on."