"Horticulture" is a fancy word for "gardening" and "agriculture" is a fancy word for "farming." Of course definitions are never precise, but I think that captures the idea. For example, someone cultivating 640 acres of wheat, or sorghum, or corn is definitely engaging in agriculture, not horticulture.