I named two outstanding open world games recognized as being in the top 5 games of all time that utilize the exact same plot mechanic, either the criticism applies to them (and you aren't) or its invalid criticism.
You bring up immersion... rdr2 is considered the most immersive game ever. Rightly so. You still have imperatives you can ignore.