Hi Lor,
Very good question! I would say both are acceptable. Personally, I would choose "the pleasure was all mine". I'm not sure I would say "no" prior to it though. It just sounds a bit like you are disagreeing, rather than being polite, which is your intention in this situation.
Best wishes,
Neil