In "time to back home" there is no verb. There must be a verb for the sentence to be grammatically correct. Time is "when" and "back home" is a "location", but what is happening? What action (verb) is taking place? You can say "time to GO back home" or "time to COME back home" or "time to RETURN back home"