I had a situation where a man I was talking to became erratic and verbally abusive. It was not a safe or healthy place for me to be. I quit responding, wrote down as much data as I could about him, including his number and then blocked him. I then told someone about what had happened because I was genuinely afraid.
No one should have to put up with abuse. However, I don’t think it should be used as a go-to under the guise of not feeling safe. Being afraid someone will be mad at you is one thing. Fearing for your personal safety is another.