I Need Advice Regarding a Mistake in the Shipment!

So, some weeks ago I shipped Amazon FBA, but accidentally sent the wrong product. I sent another one instead of sending the product shown in the ASIN and SKU. The wrong product and the ASIN are not that different since they only differ by quantity. The wrong product I sent is bigger than the product of the ASIN. Do you think people will be mad for sending a larger quantity than the original ASIN? Should I remove the inventory?