It's better to say:
I FELT regret about something.
the rule is, when two verbs come together in a sentence, the second verb is in the infinitive - meaning, uninflected. therefore, the first verb can change its form to either past, present or future form.
However, in this case, the word "regret" stands as a NOUN. therefore:
'I felt regret about...'
'I feel regret about...'
'I will feel regret about...'
:)