Can you lose your wandering horses if you restart

What game are you talking about?
By the way the answer is most likely yes.