Use a pause before or after saying sorry.
This makes the person you’re talking to listen carefully to what you are saying.
Here are a few examples.
Sorry, (pause) I'm afraid I have to go.
Listen, (pause) sorry Amanda. I'm in a rush.
Sorry, (pause) I better get going.