Not in the sidebar (as it doesn’t support multiple selections yet) but by selecting multiple groups in the view and changing the icon in the Info inspector/popover. This might also be of useful for you: Can we color the project icon? - #34 by valente