O. Henry was writing in 1910, humorously, to be entertaining. He makes contemporary references, uses slang, and enjoys saying simple things in complicated ways. This is not easy English, and some things in his stories are hard for native English speakers to understand.
The Cardiff Giant was a hoax, a faked "petrified man" ten feet tall, exhibited by P. T. Barnum, that fooled people. He's making fun of the rich man's vague memory by throwing in something incongruous.
He's trying to remember the legend of Caliph Haroun al-Rashid. In his stories, for some reason, O. Henry often makes many references to a story collection called "The Arabian Nights," ancient Persia, Caliph Haroun al-Rashid, the Rubáiyát of Omar Khayyam, and so forth.
You'll notice that he introduces this story with a reference to New York as being "Bagdad-on-the-Subway" and gives things away with a reference to "Mr. H. A. Rashid." He is disguising the name of Caliph Haroun al-Rashid by writing it as if it were the name someone living in New York in 1910!
He's analogizing 1910 New York to the imagined glory of the days of the Arabian Nights.
Caliph Haroun al-Rashid is often portrayed as a wise and humane leader, and--as with other wise leaders--the story is told that he liked to disguise himself by dressing as an ordinary citizen, and go around Bagdad to talk directly to ordinary people.
"Making Persian dates" is a pun. To "make a date" is to make an appointment to meet someone. But "a date" is also the fruit of the date palm tree and is also associated with the Middle East, so a "Persian date" also means the fruit.