In fact é, ai, and è are 3 différent sounds. But while é and è are firmly established, ai sound is somehow floating between these two. So depending on people, accents, and even words, this sound will sometimes ressemble an é and sometimes ressemble an è.
It's not specific to j'ai, but to all words with the ai sound (lait, fait, français, mais, frais, etc...) especially when the last consonnant is muted. For instance in pair, the r is not muted and the word is clearly pronounced pèr, same for caisse= kèss, plaine=plèn, fraîche=frèch. In most cases when followed by a consonnant, it will sound as è.
Edit : after answering to Phil, I notice these words also enter in this category of muted e following the ai sound, so for the same reason it is pronounced è.
But for muted endings it is floating.
For instance I would personally say :
- j'ai fait ça = jé fé ça.
- oui, je l'ai fait = oui, je l'è fè.
It's really hard to explain it, just habits, on the other hand no one will complain about which sound you choose, so you're free :-)