Some third party PSOne memory cards have a battery as well as N64. I don't know about PS2 third party cards and for Xbox and GC as well.
NeoGeo. And I wouldn't try replacing it either, it's easier to buy a new one or find a PCMCIA S-Ram card with replaceable battery.
None of the official nintedo 64 & gamecube memory cards have batteries in them. Its only when you buy some of the 3rd party jobs that you risk having a battery in them. Putting a battery in a memory cards seems strange to me.