I like that idea, actually 
I wonder if it could be added to the wish list for custom metadata set, which already includes “I wish I could deselect a selection in a set”.
I like that idea, actually I wonder if it could be added to the wish list for custom metadata set, which already includes “I wish I could deselect a selection in a set”.