Wrap a lint-free cloth or a coffee filter over the point of a spudger and apply a few drops of highly-concentrated isopropyl alcohol (over 90%) to it.

Wipe in one direction along the perimeter of the frame to clean the adhesive residue.

Take your time doing this. A clean frame allows replacement adhesive to lay evenly, ensuring a better bond.