Once the door clicks, you can open it to reveal the slots holding the memory card and the battery.

Focusing on the larger slot, this holds the battery. Push the orange tab away from the slot, this will eject the old battery if one was previously inside.

Once this slot is open, you can place the new battery inside.

Make sure to close the orange tab to secure it in place!