This usually means that something "lacks consistency" or is weak in some aspects and good in others. Ex: this university is very expensive but the education offered is patchy/spotty to say the least. This means the education is flawed or not ideal given the price.

spotty at best, means incomplete. His knowledge of physics is spotty at best.