"Referent" refers to that which is doing the referring, whereas "reference" is that to which is being referred. For example, "horse" is only a word (or a concept, depeding on how far you want to go into Saussurean linguistics (signifier/signified)), whereas the big, hairy animal that runs quickly is the "reference." Does that make sense?