It means to put a task to someone that tests their abilities or resources in a demanding but stimulating.
It is not the same as challenging someone to a fight or combat.
"He set a challenge to the group to finish the project ahead of time."
"The president set a challenge to his party members to get the bill through before spring."
"He set a challenge to himself to improve all of his grades for the next semester."