How do you get ruffians out your garden on viva pinata

buy a dastardos head shovel at the beggars store before you do anything, when a ruffian comes give him 1 coin and hit him repeatedly.
hope this helps.