It's so we don't count too fast. When one is counting, the tendency is to speed up over time, and saying Mississippi in between numbers keeps one aware of this tendency, hopefully leading to more accurate counting.
We also say: "1 one thousand, 2 one thousand, 3 one thousand, 4 one thousand..."