Hi,
I'd say it's not common exactly, in usual speaking, but that almost all English speakers would know what it means. You can also use "caught unawares", both in places of "by surprise". For example, "I was caught unaware by the postman who knocked on the door while I was still in my dressing gown."
Hope that makes sense!