Gargron,
@Gargron@mastodon.social avatar

It’s hard not to say “AI” when everybody else does too, but technically calling it AI is buying into the marketing. There is no intelligence there, and it’s not going to become sentient. It’s just statistics, and the danger they pose is primarily through the false sense of skill or fitness for purpose that people ascribe to them.

drsbaitso,

@Gargron Yup. They're not intelligence. They're not hallucinating. They're not making new connections.

They're data-center scale autocorrect.

davep,
dancingtreefrog,
@dancingtreefrog@mastodon.social avatar

@Gargron
I always read "AI" in the news as "Artificial Idiocy." Although the terms "Augmented Idiocy" or "Amplified Idiocy" just came to mind.
@etherdiver

noplasticshower,
@noplasticshower@zirk.us avatar

@Gargron nicely put. Been working on this for several years ... https://berryvilleiml.com/

tuban_muzuru,
@tuban_muzuru@ohai.social avatar

@Gargron

You may have seen this, Eugen - I used to have a Buddhist roshi who would say "Anything worth saying once is worth saying a thousand times."

This is the plainest, most sensible explanation of this AI beast I've ever seen in 40 years of working with machine intelligence.

https://youtu.be/eK0md9tQ1KY?si=k0eEy0rO9Q9tOLs2

prefec2,
@prefec2@norden.social avatar

@Gargron essentially it is often used to bullshit. So AB for artificial bullshiting would be much more fitting or automatic bullshiting. I think the last is the best option.

glider85,

@Gargron I just went to a major US marketing conference in Sept, every single vendor was touting the 'AI-fication' of their products. It's ridiculous because we are customers, we know that they've just rebranded the ML stuff they were already doing!

pspssp,

@Gargron always thought a better term would be "extreme fitting models"

arjankroonen,

@Gargron But to be fair, it is doing a better job at pretending to be intelligent than tons of humans voting nowadays… so I’m not sure I really really care ablut the broad interpretation of “I” being used.

RustyBertrand,
Terci,

@Gargron aptly put

cultdev,

@Gargron probably the single keenest and clearest articulation of this point that i’ve seen yet. no wonder you’re the mastodon guy

Sonofasailor,
@Sonofasailor@mastodon.social avatar

@Gargron I wish these bots would stop being personified. Statistical databases don't have personalities.

pinecone,

@Gargron Oh, the irony. Aren't you just parroting Emily Bender? A chatbot could have said this. How can we know that what you say is more than just your cognitive statistics?

  1. There is intelligence in current LLM based AI. A different sort, but still intelligence. Language competence without comprehension.

  2. Most of what people say is pretty much at the level of parroting.

  3. What you say is half true, half misleading.

Several people on this thread have mentioned this sort of idea.

lightninhopkins,
@lightninhopkins@mastodon.social avatar

@Gargron Plagiarism machine works.

stooovie,
@stooovie@mas.to avatar

@Gargron I'm absolutely not an AI fanboi but we may have to reframe the conversation. Who says humans aren't statistics machines as well? It's not like earth shattering thoughts just pop into our minds without massive amounts of training, observation and mimicry.

MattMerk,
@MattMerk@mastodon.social avatar

@Gargron Which is why I only refer to it as "large language models" or less often "machine learning," when it applies to VFX work in film and TV.

N0rman,

@Gargron GIGO. It's all about the training.

pelielios,
@pelielios@mastodon.social avatar

@Gargron Yes. Anyone who has ever complained about autocorrect should know better than to think "AI" is anything but more of the same.

KingOfRedLions,

@Gargron
Are you saying the "revolutionary artificial intelligence technology" in this toothbrush is just marketing? That there isn't an Nvidia GPU inside analyzing my teeth in realtime? https://oralb.com/en-us/products/electric-toothbrushes/genius-x-limited-electronic-toothbrush-white/

gerowen,
@gerowen@mastodon.social avatar

@Gargron I've been telling people this forever and they don't want to hear it. They're so enamored with the science fiction of "AI" that they don't want to believe that these companies will lie for money.

javier_paredes,

@Gargron
Large Language Models are to intelligence what elevators are to teleportation.

kevinjardine,
@kevinjardine@mastodon.social avatar

@Gargron LLMs are more sophisticated versions of the old ELIZA chatbot. At least ELIZA's creator Joseph Weizenbaum did not attempt to overhype what it was.

https://en.m.wikipedia.org/wiki/ELIZA

evan,
@evan@cosocial.ca avatar

@Gargron come now! This overstates our current knowledge of the nature of intelligence. LLMs are adaptive, they have memory, they use language to communicate, and they integrate disparate experiences to solve problems. They have many of the hallmarks of what we call intelligence. They have more such characteristics than, say, dolphins or chimps. Us knowing how they work is not a disqualifier for them being intelligent.

evan, (edited )
@evan@cosocial.ca avatar

@Gargron [deleted]

KevinMarks,
@KevinMarks@xoxo.zone avatar

@evan @Gargron there are very specific critiques of that article. https://peertube.dair-institute.org/w/gn7Lycfbm684NEi7xok2gf

evan,
@evan@cosocial.ca avatar

@KevinMarks @Gargron can you summarize?

jalcine,
@jalcine@todon.eu avatar

@evan @KevinMarks @Gargron check the citations of that paper would be the most immediate one

evan,
@evan@cosocial.ca avatar

@jalcine @KevinMarks @Gargron which citations?

jalcine,
@jalcine@todon.eu avatar

@evan @KevinMarks @Gargron to the paper you've referenced!

evan,
@evan@cosocial.ca avatar

@jalcine @KevinMarks @Gargron what do they say?

evan,
@evan@cosocial.ca avatar

@jalcine @KevinMarks @Gargron I see a lot of discussion of the Gottfredson definition of intelligence, which was removed. I've only read parts of the most recent version, which says "there's no generally agreed definition of intelligence." Which I think is still true, although I am not an expert in this field.

KevinMarks,
@KevinMarks@xoxo.zone avatar

@evan @Gargron that paper cites a definition of intelligence by racist eugenicists, and doesn't have any actual controls, only vibes. It is worth watching / listening, as is the linked radiolab series on intelligence measuring

evan,
@evan@cosocial.ca avatar

@KevinMarks @Gargron yeah, I'm not going to do that. Send me some written critiques though!

KevinMarks,
@KevinMarks@xoxo.zone avatar
evan,
@evan@cosocial.ca avatar

@KevinMarks @Gargron I deleted my recommendation of this paper.

MattHodges,

@evan @Gargron Not too long ago — in fact, roughly a year or two ago — "Artificial Intelligence" was a term used to describe computer systems which could perform tasks that historically required human cognition. Few people were offended that Chess or Go-playing systems were considered "AI" and "real intelligence" was never a requirement. But, as we see time and time again, "AI is whatever hasn't been done yet."

https://en.wikipedia.org/wiki/AI_effect

MattHodges,

@evan @Gargron I think it's historically incorrect to say that, "technically calling it AI is buying into the marketing". Yes, marketing is capitalizing on it! But the nomenclature matches my CS education from the late 2000s and it matches 70 years of how "AI" is used in research and literature. The recent obsession with asserting "theory of mind" or "intentions" or "originality" or "real intelligence" seems, well, recent.

evan,
@evan@cosocial.ca avatar

@MattHodges @Gargron I think there are a lot of things GPT4 is bad at. It's not very good at simple arithmetic. It is bad at geographical information -- what places are near others, parts of each other. It also does a bad job at string manipulation -- words that start with a particular letter, or words that are anagrams of other words. I don't think you have to resort to mysticism to say why it is not yet human-equivalent. But that doesn't mean it's not intelligent.

MattHodges,

@evan

Yes, and...!

> It's not very good at simple arithmetic.

This is a recurrent example that is starting to illustrate the difference between bare LLMs and the products built on top of them. Eg, ChatGPT is a product built on top of a system. That system has a lot of components. One of those components is a LLM. And another component is a Python interpreter. LLMs can write Python quite well, and Python can do math quite well.

Seems like a pretty intelligent system to me!

evan,
@evan@cosocial.ca avatar

@MattHodges fair enough!

bikeshed,
@bikeshed@503junk.house avatar

@evan ranking LLMs over dolphins or chimps for "intelligence" is pure anthropocentrism.

evan,
@evan@cosocial.ca avatar

@bikeshed I don't think that there's a ranking of intelligence on a single scale. But LLMs are better at, say, language use than chimps are.

bikeshed,
@bikeshed@503junk.house avatar

@evan but again, this is anthropocentric. You're defining language as language that is intelligible to humans and then saying that the tool designed by humans to output human language is better at human language than chimps! It's a silly game that plays into this very stratified view of what constitutes intelligence.

I certainly think that ranking LLMs over dolphins, who we have little understanding of their communication, seems very bizarre.

bikeshed,
@bikeshed@503junk.house avatar

@evan additionally, why is language use a more defining characteristic of intelligence than tool use? Chimps, bonobos, dolphins, octopi, corvids etc all can use tools and solve complex tasks but aren't good at language (to our definition of language). Does this matter?

evan,
@evan@cosocial.ca avatar

@bikeshed I am not! I think you should go back and reread my post with fresh eyes. I said that LLMs do better on some of the measures of intelligence than chimps and dolphins. I didn't say that they are more intelligent than those animals, nor did I say that the measures of intelligence they excel at are more important than the intelligence necessary to survive in the world.

bikeshed,
@bikeshed@503junk.house avatar

@evan agree to disagree, but I struggle to read "They have many of the hallmarks of what we call intelligence. They have more such characteristics than, say, dolphins or chimps" in another way than a kind of ranking.

evan,
@evan@cosocial.ca avatar

@bikeshed I will revise to be clearer.

jszym,
@jszym@cosocial.ca avatar

@evan @Gargron I'd have to disagree. LLMs are primarily used for two things, parsing text, and generating text.

The parsing functions of LLMs are truly incredible, an represent (IMHO) a generational shift in tech. But the world's best regex isn't intelligence in my book, even if it parses semantically.

[1/2]

jszym,
@jszym@cosocial.ca avatar

@evan @Gargron The generating functions of LLMs are (again, IMHO) both the most hyped and least useful function of LLMs.

While LLMs generate text that is coherent, that can illicit emotion or thought or any number of things, we're mostly looking into a mirror. LLMs don't "integrate" knowledge, they're just really, really, really big Markov chains.

Don't get me wrong, "intelligent" systems most certainly will use an LLM, but generating text from prompts the way we do isn't intelligence.

[2/2]

jszym,
@jszym@cosocial.ca avatar

@evan @Gargron Ok, ok, one parting thought:

I'll just add that having memory, being adaptive, and using language to communicate are all things that computer programmes that don't use LLMs do today.

LLMs are (IMHO) the most convincing mimics we've ever created by many orders of magnitude. But they don't actually know anything.

I can't wait for the world to see what truly useful things LLMs can do other than be sometimes right on logic puzzles and write bad poetry.

evan,
@evan@cosocial.ca avatar

@jszym @Gargron what does it mean to "know" something?

jszym,
@jszym@cosocial.ca avatar

@evan @Gargron Ya, I think that's the heart of the question :)

What I'm trying to communicate is that when I ask an LLM "what is on the inside of an orange", the programme isn't consulting some representation of the concept of "orange (fruit)". Rather, it's looking at all the likely words that would follow your prompt.

If you get a hallucination form that prompt, we think it made an error, but really the LLM is doing it's job, just plausible words. My bar for intelligence is personally higher

evan,
@evan@cosocial.ca avatar

@jszym @Gargron the words are a representation.

fifilamoura,
@fifilamoura@eldritch.cafe avatar

@evan Hey, you may be unaware of the actual problem solving, social lives and intelligence of dolphins, they're far more adaptive to reality than an LLM is. And LLMs don't have experiences, that's projecting human sensory capabilities onto them they simply don't have since they're not embodied (experiences are far more than memories and they don't just live in narratives/texts/memories....see current research into PTSD and memory, for instance). @Gargron

evan,
@evan@cosocial.ca avatar

@fifilamoura @Gargron thanks, and that's a fair point. I'd say LLMs are better at other intelligence metrics, like language use.

RememberUsAlways,
@RememberUsAlways@newsie.social avatar

@Gargron

The basic concept of AI, although hyped, is to increase frequency in correlation of data to provide new hypothesis.
How that can lead to sentient computers learning will be discussed at the time when language models are massive. 10 to 15 years from now.
That's it IMHO

preslavrachev,
@preslavrachev@mastodon.social avatar

@Gargron wrote about that a few months ago: https://preslav.me/2023/05/22/i-believe-in-machine-learning-dont-believe-in-artificial-intelligence/

The best we get to call it is Augmented (Human) Intelligence. Like those glasses that overlay things in front of your eyes, current AI is mostly a tool that does stuff for you, and it just happens to do it better than tools before it. New types of problems bring in new tools to solve them. But it’s just brute-forcing an answer in the end, I agree.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • random
  • DreamBathrooms
  • mdbf
  • ngwrru68w68
  • magazineikmin
  • thenastyranch
  • rosin
  • khanakhh
  • osvaldo12
  • Youngstown
  • slotface
  • Durango
  • kavyap
  • InstantRegret
  • tacticalgear
  • anitta
  • ethstaker
  • modclub
  • cisconetworking
  • tester
  • GTA5RPClips
  • cubers
  • everett
  • megavids
  • provamag3
  • normalnudes
  • Leos
  • JUstTest
  • lostlight
  • All magazines