Often, not always, they are interchangeable; "reside" is more formal. There is a distinction when a person is visiting somewhere. Note that "reside" and "resident" are similar.
So, if I go to Japan on a visit, I still reside in the United States, even though at the moment I am living in japan.