You would usually hear "Beyond the bounds of good taste/acceptable behavior"
You can also use "boundaries" and "limits".
"Beyond the pale" is usually used with no qualifier. It means "Beyond acceptable behavior" by itself, so "beyond the pale of acceptable behavior" is redundant.
By the way, "pale" here has an old meaning which isn't used any more. It meant a stake of wood. "Palings", then was a fence made of wood pickets or staves. If you went over the pale (palings), you were then overstepping a boundary.