Normally, shoes would be described as "too big" rather than "too loose." If you want to use "loose", I would use "too loose for me" for shoes, but "too loose on me" for clothes.
That's what sounds right to my native ear, but any of these phrases would be understood.