Honestly, you really can use one or the other, neither one needs to be used for a specific situation.
If someone bumps into me on the street and says they're sorry, I'd say "Oh, that's okay".
If someone can't go to a movie with me, I'd say "Oh, it's okay, don't worry about it."
But you could seriously use either one, I never really think about it.