It means "to know something is wrong".

It's not an idiom: you can read it literally. "Amiss" means something is not quite right, or inappropriate.