If you drive past something, you drive along the road that goes in front of (or possibly beside) that thing.
'Drive' here refers to driving a car ( or possibly something like a taxi, truck, or bus )
To me, the combination of a plain past tense 'did you' with 'every day' sounds a bit odd, without more context.