Gently pull the dynamo straight upwards to remove it.

The gears and where they are seated on the dynamo, are covered in grease. Try to avoid touching where the gears seat, to keep the new gears as lubricated as possible!