断る doesn't only mean refuse.
前もって断ってください。this sentence means, inform us/me in advance please.
so, except for 'refusal', 断り also means 'informing in advance'.
彼は断りもなしに仕事を休んだ。in this sentence, 断りもなしに literally mean 'without asking (permission)', since it's almost the same as saying 'without permission', i think that's why you got confused. although 断り≠許可, but to explain 断りなし, people usually say 'without permission'.