You may have to set it to run in private windows. That may be off by default. To do that go to the Add-Ons Manager, click the ellipsis next to the add-on and click 'manage', and there will be a 'Run in Private Windows' option that is probably not set to 'Allow'.