Formally, please say them together. In casual speaking, you can say "Arigatou" alone.
I agree with Richard mostly, except the meaning of "welcome."
In case of saying "you're welcome" in reply to "Thank you," we say "Dou itasimasite."
This ordinary word for a gratitude is often simply translated to "Thank you very much" in English. Most Japanese words and Kanjis have etymology.
"Arigatou" = originally, "Arigatai or Arigatashi" means that it is rare to have, see, hear, or be given something.
"Gozaimasu" = originally said like, ”gozaru + masu” →"Gozarimasuru"→”Gozaimasu”, which has a similar function with Be-verbs and also ,basically, means "to be or to exist" in a very respected way.
But, we never say "Arigatai Gozarimasuru". In some history dramas in the Samurai periods, I hear by putting the word (koto=thing, siawase/happiness) in between, "Arigataki koto/siawase de/ni Gozarimasuru".
It is like hearing phrases from the Shakespearean plays to modern people's ears, I guess...
Formal phrases can be transformed in various informal expressions or into dialects.
Having said the long trivia, I would not recommend to focus on etymology too much when you are beginning to study Japanese, although it is fun to know stories behind the words and it will make your knowledge beautiful in future.