Yes, it certainly can.
You would need context to work out the meaning. Usually in the second case, you would also use something to make it more polite, as it sounds a little rude on its own.
It's your birthday next week, isn't it? / Yes, I can't wait.
(In a queue) Do you mind if my son uses the toilet before you? / No, sorry, I can't wait.