When you're comfortable and it doesn't feel unsafe.
Once, very early on I went in the men's room by accident - I never did that at that point, I didn't even own a binder. The Panera bread had switched their bathrooms for some reason. When I was done, there was some guy at a sink shaving. He didn't even notice or say anything. I'm glad that here, culturally, guys aren't "bathroom socialisers" like many women are.
The point is - if you're in a place you feel safe, there probably won't be a problem. At least around here, no one wants to make eye contact or talk while in a bathroom.
I wouldn't want to use a bar or club bathroom where people are behaving abnormally under the influence - but I guess it would depend on how well I passed (I'm at a point in my life where I don't always try). If I was going to cause a fuss in the women's room, I wouldn't go in there.
I don't think any of the conditions you listed are really necessary to use whatever bathroom. There are cismen who don't stand to pee (for medical reasons or preference), ones with no facial hair and higher voices, and lots of cispeople don't "pass" 100% of the time (certainly not trying to say that "cispeople have it just as bad!", but just trying to boost your confidence by pointing out that there are plenty of ways to be male cis- or whatever).
So just do whatever as long as it's safe.