Remove the strip of black tape to reveal the voltage regulator.

Notice how the batteries are soldered in parallel - "+ve to +ve" and "-ve to -ve". The batteries have a ridge on the +ve end. The board goes close to the +ve end with the lip.

Remove the voltage regulator and its attached wires. Keep it because you'll solder to the new batteries.