Once you cancelled the order that was the end of that transaction. You will pay brokerage on the amount sold as if that was the order in first place.