In casual conversation, I would almost always use "spend" to talk about time. Expend can be used to describe the amount of time and effort one gives, but I think it's rarely used. I could say, "I spent a lot of time on it." Or I could say, "It was something in which I expended much of my time." "Expend" may sound awkward in normal conversation, so I would use "spend."