“The general problem of mixing data with commands is at the root of many of our computer security vulnerabilities.” Great explainer by security researcher Bruce Schneier on why large language models may not be a great choice for tasks like processing your emails. https://cacm.acm.org/opinion/llms-data-control-path-insecurity/
"When the Singaporean government asked local writers if they would agree to having their work used to train a large language model, it probably did not expect the country’s tiny literary community to react so fiercely."
I just issued a data deletion request to #StackOverflow to erase all of the associations between my name and the questions, answers and comments I have on the platform.
One of the key ways in which #RAG works to supplement #LLMs is based on proven associations. Higher ranked Stack Overflow members' answers will carry more weight in any #LLM that is produced.
By asking for my name to be disassociated from the textual data, it removes a semantic relationship that is helpful for determining which tokens of text to use in an #LLM.
If you sell out your user base without consultation, expect a backlash.
@KathyReid The high volume of text for high rank users makes total sense from a training bias perspective, though I think anonymizing authors might not change this.
Unless the RAG provider uses specially designed extractors for user rank info in their corpus, I'm doubtful ML could pick up on a numerical rank like SO karma and figure out to weight by this number. That's too much System 2 thinking for ML, IMO!
Still good to give big firms as little free data as possible, of course! ☺
@sean right but I'm guessing that OpenAI will write custom tokenisers for SO content, which probably would take into account user rank info ... So it's not the ML, it's the data preparation.
@metin Dis yiu test the AI Link to Krita? It works offline and gives also nice results. The option to control the AI reslts is incredible and brings "artist skills back to the desk".
If someone interested in the AI Module for Krita: https://github.com/Acly/krita-ai-diffusion
i used an analogy yesterday, that #LLMs are basically system 1 (from Thinking Fast and Slow), and system 2 doesn’t exist but we can kinda fake it by forcing the LLM to have an internal dialog.
my understanding is that system 1 was more tuned to pattern matching and “gut reactions”, while system 2 is more analytical
i think it probably works pretty well, but curious what others think
@kellogh I use that exact analogy. And emphasize that we certainly do use and need System 2 at least occasionally. At some point, human-like reasoning must use symbols with definite, not probabilistic, outcomes. Can that arise implicitly within attention heads? Similar to embeddings being kinda-sorta knowledge representation? I mean, maybe? But it still seems hugely wasteful to me. I still tend towards neuro-symbolic being the way.
Just came up with a new analogy I'm rather proud of: LLMs are digital compost heaps. They decompose whatever you hurl in and turn it into artificial excrement.
Also I'm moving from StackExchange to Codidact. If I'm going to do any more unpaid labour it's going to be for a not-for-profit, rather than a for-profit company. Feeding that work into a digital compost heap is the push I needed.
#AI#Writing#GenerativeAI#LLMs#ChatBots#Creativity: "Here, at last, is the grisly crux: that AI threatens to ruin for us—for many more of us than we might suppose—not the benefits of reading but those of writing. We don’t all paint or make music, but we all formulate language in some way, and plenty of it is through writing. Even the most basic scraps of writing we do—lessons in cursive, text messages, marginal jottings, postcards, all the paltry offcuts of our minds—improve us. Learning the correct spellings of words, according to many research studies, makes us better readers. Writing by hand impresses new information into the brain and sets off more ideas (again: several studies). And sustained writing of any kind—with chalk on a rock face, or a foot-long novelty pencil, or indeed a laptop—abets contemplation."