You can decompose the word into 业, which generally refers to employment/profession, and 余, which means can mean "remaining" or outside of. Combined, therefore, the word means spare time.
Eliot is also correct, however, that the translation depends on the usage. For example, your sentence "你业余时间通常都做什么?" could be translated as "What do you usually do in your spare time?"