You don't have to remove the speaker to get to the rest of it

Unscrew the 3 screws holding the speaker in - 2x8mm Plastic Tapping Screws

Undo the screw holding the USB Cable down (it also connects to the speaker) - 2x10mm Plastic Tapping with a Washer

Unplug the Speaker and remove