That is the importance of, #Tesla in this case, maintaining a robust systems safety lifecycle and, for the human test drivers, a robust Safety Management System.
That is, the human test drivers are continuously read into the broader systems aspects of the vehicle under test.
Maintaining such a system converts would-be subjective opinions like the above (which have no technical or safety value) into objective analyses that creates quantifiable reliability progress.