To uninstall the Plug-In, you first have to navigate to the Exchequer Customisation Setup as mentioned when installing.

When you have done this, select the plug-in by clicking on it, and then (instead of clicking the install button as shown here) click Remove.