So when I activate it I get a large performance drop, as might be expected from how vim works and how this plugin works. Which is fine. But the problem is that it will never recover unless I close/reload the buffer or restart vim.
I've tried it through both ColorToggle and ColorClear, but despite the fact that the highlighting has gone the performance does not recover.
I'm running neovim v0.4.4 and the latest version of the plugin.