Think about it like this: You can't afford to pay the consequence of not doing the thing you say you "can't afford to do". Essentially that's what you are saying - that you can't afford the cost of not doing something. So, yes, basically you need to do it - not in the sense of being required to by someone else, but in order to avoid some more negative consequence.