"called me into his office" is going to be what you hear most frequently, but "asked me into his office" is absolutely acceptable and used as well.
The only one that you gotta be careful with is "called me in his office" because this makes it sound like he is literally calling you by telephone, while being in his office. Instead, "called me into his office" communicates that he is asking you to come to his office.
Espero que te sirva! :)