Swop the words a bit: at best, he’s mediocre. Meaning he is poor or bad, and the best he can hope for is to be average.
Rankle is a word that means something caused annoyance or resentment probably for some time: the way someone was treated, or a comment for example.