"Border" is correct, but is not normally used and sounds weird. "Side" is also correct and better than "border", but is still a little weird. "Edge" would be the most common, as Rachel said. Or you can say "I walked up to the swimming pool and jumped in".