It can be a simple acknowledgment that you are listening to someone. As if to say 'go on, I'm listening.'
But, depending on the inflection, it can also be used sarcastically, or to convey doubt in the person's story. The first is usually short, Mm-hm, the second is usually more drawn out Mmm-hmmmm.