A comma before "too" is up to you!
Usually we don't use a comma before the word "too" regardless of where the word appears in a sentence but both are grammatically correct.
If you want to emphasize the word, as you might be likely to do in your second sentence, then you should add a comma.