Can downgrade psp firmware from 5.5 to 5.3

Yes, you can. But you must be very careful while downgrading because it can brick your PSP.