Those two sentences have different meanings.
"Since I was 20' refers only to the year following your twentieth birthday. You were only 20 for a single year.
"Since my 20s" refers to your entire decade between the ages of 20 and 29. It is a ten-year period.
And no, you can't say "my 20". This doesn't mean anything.
By the way...you should have said "I've been wanting to visit France". Present perfect continuous.
"I've been wanted" doesn't mean anything (unless you're a wanted criminal that the police are looking for!).