"Leftovers" almost always refers to food. Specifically, it refers to uneaten food, at the end of a meal, that can be saved and eaten the next day.
"My wife always buys a big turkey for Thanksgiving. We eat leftovers for days, which is fine because I actually love leftover turkey."
"Remnants" can refer to almost anything, not just food. It tends to mean small, unusable scraps. It carries a sense of "very little."
Cloth for making clothing comes in long rolls called "bolts." After using it, there is usually a small piece left at the end that is too big to waste, but too small make a piece a clothing. That piece of cloth would be a "remnant."
In the Aeneid, many Trojans were killed by the Greeks, and Aeneas, who survived, calls himself "a remnant left by the Greeks."