Why do the guards in bowerstone keep on attacking you in Fable 2

Iyou have ressisted arrest or attacked one of them you will have to travel away from bowerstone and back again.