Do not ask a language model questions involving reasoning, factuality, or moral judgment. Language is a vehicle for those, but it is not the SOURCE of them. And there is an enormous amount of language in the public sphere that’s devoid of them—and that trained the models.
