Do what you'd do in any other situation when you realize that the vibe is going against you and could get ugly, except you're outnumbered badly. You get to a safer location among friendlies. Just because you're in a town and not a bar or mall doesn't change the ancient rules of self-preservation. The plan was placed in you at birth. Activate it.