I would say there are two meanings of the expression.
The first one means "it is to hard to carry things".
E.g. The bags were too heavy to bear, so I called for the taxi.
The second one meaning is "it is too difficult to realise"
E.g. The thought of his daughter going to the hospital was heavy to bear.
Hope, it helps ;)