Pan-EU Inventory Storage and Additional FBA costs

I have shipped my product to Germany and enabled storage in some other EU countries. I noticed for non-Germany sales, I am being charged a premium FBA fee for shipment from Germany. I assumed Amazon distributes the stock around the enabled storage countries automatically. Any ideas how I can avoid these costs?