That's why you do not give them the chance.
And that requires you to have a chance to attack them. Which also requires you to know that theyre a threat, or for you to be the antagonist.
Normally, people dont go, "hey, dude. im gonna beat you senseless. you can get your weapon out now."