@pludikovsky No, that doesn't work. You can't exclude those people from, say, decisions about healthcare or pensions or public transport which absolutely do affect them.
It's a flaw. It's not fixable by a tweak to the system. Any such fix is a net loss, on balance.