Do you have to keep the gameshark on your game boy advance if you want to keep all the cheats you got

yes, you do. because if you don't the cheat will be cancelled by Joshua Thomas