Haunt means to linger or stay in a place while causing distress. Something which haunts your mind is something which you think about repeatedly and distracts or otherwise distresses you.
Peace of mind means you are not distressed by anything. You are calm and your mind is clear. You do not feel fear, stress, or anxiety.