UI of addin loaded without rest of addin


I have met this behaviour recently. When there is a UI defined in xml files (Ribbon.xml etc.) this part of Add UI is loaded even the Addin is not set like Auto-load. So it is a little bit strange because none of the addin parts should be loaded. The AddinMain() is called when you click on any button definned in addin ribon.