You can remove all items in your cart by clicking here.
Clicking an icon under "Add/Remove" will only add/remove one of the items.