Create/open an icon, display the toolbar, then right-click on it and click on Configure toolbar. In the upper right corner of the window is a checkbox called Hidden. Uncheck that, click OK and then close the icon.
Do this while no other window with an icon is opened. Otherwise the last closed window will override the setting.