Remove an address by index, or all addresses.
a Address object
The address to remove, use -1 to remove all address.