Yes, there are rules. You simply need to look up "infinitive gerund verb list". For example, "enjoy" is always followed by "[verb]ing".
Some verbs (not many) can take either infinitive or gerund. "I love playing soccer" and "I love to play soccer" are both correct. If there is a tiny difference, "playing" means you already do it regularly, and "to play" means you don't often have the chance to do it.
However, only "I WOULD LOVE to play soccer" is correct. Pay attention to any other words in the sentence.