The day before yesterday I've lost one follower. Yesterday I've lost another follower again. Today it seems like I've lost a mutual, because both of the counters of following and follower decreased one more time.
I don't force my followers to keep following me, but it's annoying to see how the follower counter keeps decreasing in a very short period anyway.