I understand your argument and there's some truth to it. But on the other hand exactly these kinds of decisions (joining/leaving the EU/NATO/...) have an incredibly strong possible effect, so them being done only based on the decisions of some politicians that were elected on some promises possibly quite unrelated to that decision has its own set of problems.