You're right - in speech, "return'd to" can sound like "return 'dto" and be almost indistinguishable from "return to."
You might have to pick it up from the context:
- We must return to the last place we visited.
- I don't want to return to my previous habits.
- We've now returned to the last place we visited.
- Sadly, I have returned to my previous habits.