Not trying to lay blame here or anything, just giving some context to why they may get upset. When you constantly say “sorry” multiple times in one conversation the person you’re talking to may feel like this means they are being unreasonable or overly demanding when that was not their intention. It kind of implies that you believe they are upset or frustrated or mad at you right from the start, which ironically can lead to them feeling frustrated. Like I said I’m not trying to say one person’s right or wrong, just giving my little bit of insight.