"Would you like something to eat?
Yes, I'd like some orange."
If the oranges are in wedges or slices, then yes this is possible.
"Would you like something to drink?
Yes, I'd like some orange."
No, this is very unclear. I don't know if you mean orange juice, orange softdrink/soda (eg. Fanta) or orange cordial.