Yes, that is the correct way to ask the question.

Yes, you can also say: My birthday was yesterday or Was it his birthday yesterday? or Yesterday it was my/his/her birthday.

Yes. You can say, "When was your birthday?" You could also ask, "Was your birthday yesterday?"

Really, my birthday was yesterday "12th september"