"Let's go" is just that - a suggestion to leave.
"Come on" will often be used in the same context, but is more general. It means to get organised. So 'come on, let's go' is the natural order - get organised, finish what you are doing, and then let's go.
I would disagree with Kevin's comment that "Come on" sounds more encouraging; "Let's go" sounds more snappy and impatient.
Let's go is often just a suggestion. "Come on" on the other hand usually means that the speaker is getting frustrated with waiting around.