In this case "loosely" means "imprecisely".
"The gentleman in question, using the term 'gentleman' loosely, was in an inebriated condition." In this example, the speaker is referring to a man who, the speaker considers, does not really count as a gentleman, perhaps because of his discourteous behaviour.