For me it's because usually, if one has more than 3 or 4 partners it's just not possible for them to give all of them proper care and love, there's a big chance that some, or many of these people will start feeling left out
But to each their own I guess, it's just my personal opinion