Place the multimeter on resistance mode and test the resistance of the capacitor.

If the resistance increases/decreases, the capacitor is working fine. If the resistance of the capacitor reads 0 or over several kilo ohms, the capacitor needs to be replaced.