"Rack" is vulgar slang, and a disrespectful way to refer to a woman's breasts.
A deer's antlers can be called a "rack," which is a perfectly acceptable use of the word. Antlers are often collected by hunters and displayed as a trophy. I think the idea behind the vulgar use is that when a man hunts for deer he wants one with big antlers, and when a man hunts for women...