A triángulo amoroso would be a love triangle in English, so very similar.
I had to do a bit of looking for persona cuadrada, and it turns out it is a "square peg", though I could also see it meaning someone who is "close-minded" or has "a one-track mind" to a certain extent.