"You could have knocked me over with a feather" means that you were very surprised, even shocked by something. You were so shocked you couldn't even think. When a person is like that, you can easily push him over / push him off his feet to the ground. You don't even need to push hard with your hand. You can use a feather. It is an image, so no one really falls to the ground. ; )