"I don't want to bother you" is usually used as a refusal of an offer. For example: a crowded cafe, a person sitting alone at a table with papers, books, coffee, laptop spread all over the table. Another person is standing, looking for a place to sit. Person A: "Do you want to sit? I can move everything and make room for you." Person B: "No thanks. I can see you are working, and I don't want to bother you." Person A is making an offer, but Person B doesn't want to inconvenience Person A.
"I don't mean to bother you" is used as a polite acknowledgement that a request will probably bother someone else. For example: same cafe situation. Person B: "I don't mean to bother you, but can you move some of your things so I can sit down?" Person A might refuse or become annoyed but still move his things so that Person B can sit down. "I don't mean to bother you" is usually followed by "but", and then a request that might inconvenience the other person.
It's a subtle difference, but that's how they are typically used differently.