Removes a Holder from the list of holders managed by this
a Set object
the Holder to remove from this