In Oblivion Ive been attacked by daedric worshippers in towns who look like ordinary townsfolk and then transform into these red masked worshippers who attack me for no reason. Why is this

this is the exact reason i NEVER kill any civillian, the dudes are obviously involved in a quest, or... they know how to summon daedric weapons, so they use em