Is there a way to delete items from your inventory in Stick RPG 2

No, but you do have unlimited inventory spaces. so that helps