I can only answer as to my own situation. 20 years ago I reacted the exact same way with my wife. She didn't bat an eyelash and kept pushing forward with me. Not aggressive, but she didn't give up and she let her feelings be known very clearly how she felt about me. I'm so glad she didn't let me play the fool and walk away...she's easily the best part of my life. 20 years later and 2 kids, I'm still deeply in love with her and we laugh about how I tried to run away scared because of my confusing emotions about how I was feeling for her. Don't give up! If its worth having, it's worth fighting for! If you love him, fight for him!