Remove the 4 marked 6-32 hex screws with a 2mm Phillips hex screwdriver.

There are a number of Phillips head screws underneath. These don't need to be removed to remove the power supply.

Note the different PSU for Mac Pro 1,1 through 3,1 versus Mac Pro 4,1 and 5,1.