"It's raining" means that rain is falling right now. If we walk outside, we will get wet.
"It's rainy" means that this is a day when we can expect rain now and then. Perhaps it is not raining now, but we can see that the ground is wet because it was raining earlier, and we can see dark clouds that suggest it will be raining again soon.