Gently remove the battery from its holder using the plastic opening tool.

Insert new battery.

Clean and re-apply thermal paste to the heat sink areas circled in orange. See Step 15 in iMac G4 17" Model M9168LLA Hard Drive Replacement for better photos and description.