There's gentle irony in the statement. It's something you can say about your fame, especially if you're unknown in your own country.
The point is, it doesn't necessarily have to be the truth - it's used jokingly to excuse a lack of fame at home. This is now a well-known catchphrase, probably thanks to the song. "I'm in a rock band." "Really? I've never heard of you." "Well, I'm big in Japan."
Of course, very few Westerners would bother going to Japan to verify this.
(My Korean friend also pointed out that Japan is geographically a "smaller" country, so you could be famous, but your fame is very limited.)