I've heard this phrase used in the following way: "Quit yanking me" / "Quit jerking around" "Quit messing around" / "Stop joking around"

I think what you mean is "quit yanking my chain". It basically means "leave me alone!"