It's only "I go to play tennis." "Tennis" is the activity, and play is simply the verb. If the activity is a gerund (jogging, swimming, etc), then you can use it directly: "I go swimming."
"I go for..." is only used when the activity is a simple noun and not a gerund. "I go for a game of tennis." "I go for a walk." "I go for a drink."