When prompted to provide the current top news headlines from specific outlets, ChatGPT returned non-news output 52–54% of the time (almost always in the form of an ‘I’m unable to’-style message). Bard did this 95% of the time.
For ChatGPT, just 8–10% of requests returned headlines that referred to top stories on the outlet’s homepage at the time. This means that when ChatGPT did return news-like output, the headlines provided did not refer to current top news stories most of the time.
Of the remaining requests, around one-third (30%) returned headlines that referred to real, existing stories from the news outlet in question but they were not among the latest top stories, either because they were old or because they were not at the top of the homepage.
Around 3% of outputs from ChatGPT contained headlines that referred to real stories that could only be found on the website of a different outlet. The misattribution (but not the story itself) could be considered a form of hallucination. A further 3% were so vague and ambiguous that they could not be matched to existing stories. These outputs could also be considered a form of hallucination.
The outputs from ChatGPT are heavily influenced by whether news websites have chosen to block it, and outputs from identical prompts can change over time for reasons that are not clear to users."
The big problem with the ubiquitous push for #AIAssistants is the idea that I would want to talk to them if they just were a bit better.
Sometimes I don't even want to talk to real humans, so why would I ever want a fake human to be my interface to things that I can perfectly read myself?
@ChrisChaffin So now, software nerd that I am, I'm curious about whether they rolled their own audio player or used an off-the-shelf one, and how they're handling DRM on the PC. This might actually give me a reason to use NLS for the first time in like 20 years.
BARD App iOS. For those that did not know, the BARD app has some built in Siri commands, but you have to activate them before they will work. You can do things like start, stop, different sleep timers, set bookmarks, and jump backwards and forwards by time increments. there are also a few interactive commands. To activate any of them, go to the settings tab, swipe to Siri Settings, Double tap the now reading audio button. The commands are divided into 2 categories; Playback, and Navigate, just double tap the category you want. For each command, there will be an add to siri button. If you double tap the button, it will add it to Siri and bring up a screen for that command. The command you will say to Siri will be in the edit field, just double tap to change it if you want. Once things are set, just hit the done button. It will put you back in the BARD app. Its that easy. I like the interactive commands. As you swipe through the list, it will tell you if it is interactive. What that means is that once the command is given, Siri will give you a list of choices to choose from. For example, there is a sleep timer interactive command. If you set this up, then when you say the command, Siri will come back and ask you if you want to set a 15 minute, 30 minute, 45 minute, 60 minute timer, or end of chapter sleep timer. You just tell her what you want, and it is set. I like the interactive commands because you are given choices. These are probably something that I will not always use, but it will be good to have some set up for times they can come in handy. #iPhone#iOS#BARD#Siri#Shortcuts#Commands#HandsFree
@ChrisChaffin its actually a pretty nice ap. Wish we had it as Canadians. We can get it but with no log in info, kind of useless. it is a nice book reading app though.
@heysannidhi I’d add that this is true for humans, too.
(and all of statistics: if you don’t know the truth, regardless of how much you measure, you will always have some remaining uncertainty, though it decreases as long as the law of large numbers is valid: no systematic bias)
There is a difference, though: human minds have evolved to have the majority of their hallucinations in parts that are unlikely to kill you. Because those who did not have perished.
Sorry, ich kann es nicht anders sagen, aber unsere Kinder werden mit einer KI-Shitshow aufwachsen. Und es liegt an jedem Einzelnen von uns, diese KI-Shitshow nicht so schlimm werden zu lassen, wie ich sie mir aktuell vorstelle. 🥶