Simply add the old address back, you don't even need to set it as primary in order to receive messages. Any messages that were sent during the period where the address was removed cannot be recovered though, unless the sending party re-attempts delivery.
