Others have covered most of this, but I just thought I would add something.
"Mind you", tends to be used as a direction changer conjunction in the sentence, and in this context, implies a tone of confidentiality, (as in, I'm telling you this, but don't spread it around.)
eg)
* the builders took an extra long lunch break, mind you, I wasn't very happy about it, given I was paying by the hour.