You do not need to say "to you both". If you are speaking to a couple on their Anniversary you are addressing both of them. You would just say, " Happy Anniversary!" or "Congratulations on your Anniversary".
If the couple were good friends of mine I might even say, " Happy Anniversary guys!! Well done!"
I hope this assists you.
Teacher Mark