"Steadfast" is suggests personal loyalty, or loyalty to duty. It's only used with people--or, anthropomorphically. Hans Christian Andersen wrote a story entitled "The Steadfast Tin Soldier." It's positive and complimentary. I'd be pleased if my wife called me her "steadfast companion."
"Adamant" and "diamond," the hardest substance on earth, come from the same root. "Adamant" means hard, completely unyielding. It, too, is used mostly of people. "I tried to convince him to yield on this point, but he remained adamant." It's rather uncomplimentary--it is similar to "stubborn." It applies to opinions or choices, not directly to people. You can say "he was a steadfast friend" but you can't say "he was an adamant enemy." You could, however, say "he was an adamant Republican, and would never vote for a Democrat under any circumstances."
"Unyielding" can apply to anything--human, animal, vegetable, mineral--that is hard and won't yield.
"Unyielding" means something that doesn't move even when you push it.
"Stable" just means something that stays put under normal circumstances, but might well move if you push it. Something can be stable, yet yield to force.
For example, a broomstick balanced on your chin is unstable--it falls over if you don't keep dancing around under it.
As you say, a ladder is stable. You can walk away from it and it won't fall over by itself. But it will fall over in a high wind.
A lighthouse is not only stable, but unyielding--it can withstand a heavy storm.