Yes, it is "only" a 10 to 20% risk per infection. So if you had around 2 tot 3 infections thus far, it is not implausible that you are completely recovered.
Females are more often affected than males, so for males the risk is probably less than 10%.
So for males it is even more plausible to be fine after a few infections.