The sentence is written perfectly.
In this case, I would use "by your side" in the blank space. "By your side" is very intimate, and implies that you have a close connection with someone and that you will support them. "With you" can just mean "together," and can be used sometimes for intimate connections but also to mean that you'll just stay with someone while they walk through a supermarket. "With you" can be used for intimate or casual situations.