I've encountered this in version 3, and it seems to still be there in version 4:
The "Show only while hovering, for both the addon icons and/or the blizzrd icons - simply doesn't work. reloaduingUi doesn't make it appear as it is set, nor does restarting the game.
It's worth noting, for all of my posts here, that I've tried uninstallling the addon >>Â deleting the SavedVariables files >> and reinstalling the addon. It didn't solve even one of the issues I reported. I ended up reverting to the old SavedVariables file.