Well I've only heard it being used in a playfully derogatory or self-deprecating way before. A girl who thinks she's unattractive might say "Ugh he'll never notice me, cuz I'm such a potato". It's also often used to describe a lazy or useless person "He's a potato, watching TV all day". Although in your example "She's our potato" it sounds kind of sweet