You are vastly more complex than an LLM. There are hundreds of neural transmitters. 20 billion neocortical neurons and 7 thousand connections per neuron. A naive complexity of 2.8e16 combinations. Each thought tweaking those ~7000 connections as it passes from neuron to neuron.
Aware and irrelevant, if anything that helps my point.
The brains training that model are not that model. They are what does the thinking, the model is nothing more than a black box of statistical analysis that spits out stats in a human digestible format.
The brains training that model are thinking, in the exact same way that the AI is. You can pretend that isn’t thinking all you want, but what it’s doing is quite obviously reasoning in tokens.
It’s Stochastic: entirely based on statistical probabilities with no reasoning behind any of its outputs. It’s a parrot in that it can only construct that which has been fed to it as an output. It’s not “thinking in Estonian”: Estonian had been programmed into it either directly via Estonian language material being introduced or indirectly by Estonian patterns matching other similarly trained languages.
So are you. As we scale up, they quite obviously get better at reasoning, just like you said, we’re a much more complex version of this, it’s still bad at it, because it’s tiny. In your mind, how does thinking work, if not in the exact same way LLM’s do that?
Gpt4 still hallucinates all the time. It still fails to reason.
Sometimes it fails to reason, sometimes it hallucinates… so do you. Have you never accidentally said something false? Have you never failed to reason? Consider the following: the thoughts you actually share are a much smaller, filtered version of the thoughts that go on in your head, you’ve censored a massive portion of your thoughts, and you don’t share the bad ones, you’re the same, you just have a filter. You’re a much more complex, significantly more performant, significantly better version of an LLM that converts your sensations into muscle movements.
It is not doing novel things: it’s doing exactly what it has always done in unexpected ways but that’s very different from intelligence and thinking. What’s tripping people up is they’ve never interacted with anything that had the width of knowledge readily available. The complexity of encoding the entire world makes a huge surface where anyone can interact with it and get reasonable responses. That doesn’t make it reasoning, just that it has a very detailed latent space which is very good at natural language queries.
You have not demonstrated the difference, you’ve demonstrated that they’re worse at it, and you even explained WHY, they’re much smaller. That is exactly how the neural network in the brain works, you just want to say that your brain is magical. Yes, it is worse at reasoning than humans, but as demonstrated in that link, it gets better and better with size, unless you believe that the instructions for stacking every single object exists online, you have to accept that while these models are tiny, they’re already beginning to reason in the exact same way you do.