Rotten eggs stink, so no one wants to be a rotten egg. Children often say this to get their friends to join in something, especially to jump into a swimming pool (pond, lake, ocean, etc.) When one says it, all of the others run as quickly as possible to get into the swimming pool and not be the last one in.