The battery is removed, and My MP-1 is powering up fine and retaining settings.
The picture is worth a thousand words. (Or, in this particular case, 8192 words of 8 bits each):