I've recently picked up the habit of asking LLMs a variant of "Is that feature you just told me about real?" immediately after answers that seem too good to be true.
A bit more than half the time my suspicion holds.
"I apologize. I apparently confabulated again."
/cc @driscollis we were just talking about this today.
@bmispelon@treyhunner yeah, i fear the "are you sure" variants are highly likely to trigger an excuse, whether the thing is true or not, I've not witnessed it insisting that the thing is true when i asked, but i didn't experiment with things i knew to be true (i don't use it much).
@tshirtman@bmispelon I've experienced both. It usually admits that it was wrong when it should, but not always.
It sometimes says it was wrong when it doesn't, but that has happened to me more rarely than the opposite. That could be selection bias though. I only ask if it's correct if I suspect it might not be and haven't yet verified. I don't even ask if it seems right and I plan to test it myself anyway.
Add comment