Grammatically it doesn’t matter. However, logically one should say “on one hand … on THE other hand.” That’s because when you pick the first hand you have two to choose from. So “the” one isn’t logical. It’s one out of two. However, once the first has been chosen, there is only one other one, so it is THE other hand. It’s mathematics, not English.