Remove the bushings from the middle shaft (the one you just removed from the outer shaft), and pull the bottom cap off.

This bottom cap is probably what has been causing your problems with retraction, but we'll get to that later.