Here is a pic of a tamagotchi with the red and white tab inserted (right hand side) taken from the flickr photos that *mimitchi* recently posted of their collection:
When you put the tab in (the one the Tamagotchi originally comes with), it slides right between the battery and the circuit, so you effectively turn it off in a sense.