To uninstall the Plug-In, you first have to navigate to the Exchequer Customisation Setup as mentioned when installing.

When you have done this, select the plug-in by clicking on it, and then (instead of clicking the save button as shown here)  click Remove.