This is a most excellent place for technology news and articles.
Apple's study proves that LLM-based AI models are flawed because they cannot reason
This really isn't a good title, I think. It was understood that LLM-based models don't reason, not on their own.
A better one would be that researchers at Apple proposed a metric that better accounts for reasoning capability, a better sort of "score" for an AI's capability.
I tried it myself (changing the name and changing the values) but lost interest after 3 attempts and always getting the right answer:
https://chatgpt.com/share/670af65d-da08-800f-8ad4-c67782ee5477
https://chatgpt.com/share/670af672-45dc-800f-ac91-cc2811fa89c7
https://chatgpt.com/share/6709e80b-e5a8-800f-90d0-1af3418675ef
Of course they don't, logical reasoning isn't just guessing a word or phrase that comes next.
As much as some of these tech bros want human thinking and creativity to be reducible to mere pattern recognition, it isn't, and it never will be.
But the corpos and Capitalists don't care, because their whole worldview is based in the idea that humans are only as valuable as the profitability they generate for a company.
They don't see any value in poetry, or philosophy, or literature, or historical analysis, or visual arts unless it can be patented, trademarked, copyrighted, and sold to consumers at a good markup.
As if the only difference between Van Goh's art and an LLM is the size of sample data and efficiency of an algorithm.
You don't have to get all philosophical, since the value art is almost by definition debatable.
These models can't do basic logic. They already fail at this. And that's actually relevant to corpos if you can suddenly convince a chatbot to reduce your bill by 60% because bears don't eat mangos or some other nonsensical statement.
These models are nothing more than glorified autocomplete algorithms parroting the responses to questions that already existed in their input.
They're completely incapable of critical thought or even basic reasoning. They only seem smart because people tend to ask the same stupid questions over and over.
If they receive an input that doesn't have a strong correlation to their training, they just output whatever bullshit comes close, whether it's true or not. Which makes them truly dangerous.
And I highly doubt that'll ever be fixed because the brainrotten corporate middle-manager types that insist on implementing this shit won't ever want their "state of the art AI chatbot" to answer a customer's question with "sorry, I don't know."
I can't wait for this stupid AI craze to eat its own tail.
Do we know how human brains reason? Not really... Do we have an abundance of long chains of reasoning we can use as training data?
...no.
So we don't have the training data to get language models to talk through their reasoning then, especially not in novel or personable ways.
But also - even if we did, that wouldn't produce 'thought' any more than a book about thought can produce thought.
Thinking is relational. It requires an internal self awareness. We can't discuss that in text so much that a book is suddenly conscious.
This is the idea that"Sentience can't come from semantics"... More is needed than that.
