Use a cotton ball or swab and apply rubbing alcohol until it is moist but not dripping.

Scrub the heatsink surface with the cotton ball until all thermal compound is removed.

If the thermal compound is hard or crusty, a cotton swab will work better at removing it than a cotton ball.