To thoroughly clean the AAA cover, you must disassemble it. You will not be able to fully clean it assembled.

Stick a screwdriver or pry tool in the side with one pin. DO NOT pry on the side with 2; it can break the second pin.

LIft up on the clip and remove it. This can be safely cleaned in a vinegar bath.