The pronunciation/accent, and slang of people on the street are different, and HKers mix in a lot more English words and phrases when speaking.
Since I'd only ever learned HK Cantonese up to that point, I remember thinking that the first person I met from Canton was speaking Cantonese as a second language. (Mainly because her accent was so different from what I was used to.) However, my HK friends assured me that she was speaking "real" Cantonese, and that we were speaking Hong Kong Cantonese.
That said, I recently met some people from Canton/Guangzhou and the difference in accent was much less noticeable to me than ever before. So, I've either gotten used to the sound of "real" Cantonese, or the two dialects have grown closer together thanks to improved communication, the internet, movies, etc. (It's probably some combination of the two.)