The only correct way to say that is "We are in a relationship."
Relationships is plural and refers to 2 or more relationships. For example, the one you have with your mom, your partner, your friend and so forth. Those, all combined, are relationships.
I hope this helps Anthony. If not, please feel free to ask.