this post was submitted on 20 Apr 2024
314 points (96.2% liked)
Technology
58144 readers
4482 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Stop plugging LLMs into everything! They are designed to make up plausible sounding nonsense.
Seems like Facebook is the right place for them than.
They said "plausible."
LLMs are very useful for synthesizing information, e.g. sumamrizing long texts. Yet every company is actually pushing to use it to create more text, which as you say is at least partly nonsense.
It shows against the difference of what users need (quick access to accurate information) vs what these companies eant for us (glue your eyeballs to the screen for the longest possible time by e.g. overwhelming you with information, regardless of the quality)
Well it can be great at making text too, but the usecase has to be very good. Right now lots of companies in the B2B space are using LLMs as a middle layer to chat bots and navigation systems to enhance how they function. They are also being used to create unique lists and inputs for certain systems. However on the consumer side the usecase is pretty mixed with a lot of big companies just muddying their offerings instead of bringing any real value.
no different from what human brains do
Aside from knowledge, context, ability to reason, and spatial awareness.
All of those are just products of the same learning algorithm
Consciousness is not a computer program. Neurons don’t use binary. I’d love it if we had computers that could do squirrel things perfectly but we don’t even have that.
I can appreciate that contemporary neural networks are very different from organic intelligence, but consciousness is most definitely equivalent to a computer program. There are two things preventing us from reproducing it:
Also, for what it’s worth, most organic neurons actually do use binary (“one bit”) activation, while artificial “neurons” use a real-valued activation function for a variety of reasons, the biggest two being that (a) training algorithms require differentiable models, and (b) binary activation functions do not yield a lot of information per neuron while requiring effectively the same amount of memory.
Binary neurons are still neurons
@ShittyBeatlesFCPres @Sorgan71 well, actually those things are not so far apart. Neural networks have their names not just by accidents, name giving neurons work similar to braincells. Also on a non-ai level you could compare the RAM easily yo put short term memory etc.
A piece of friendly advice is to not say “Well, actually…” on the Internet because that’s a meme about know-it-alls. I (and probably everyone on Lemmy) has a tendency to “Well, actually” people and it’s one of those things where people will discount your argument before it begins.
That aside, I do think we’re trying to model the brain using the best tools we have. I suspect the next 100 years will see a revolution in biology that can be compared to previous centuries seeing huge leaps in the understanding of physics, electromagnetism, and the immune system. No one in 1900 could not have ever foreseen us mapping the human genome.
So: I wouldn’t be shocked if neural networks caught up with humans in our lifetimes. But we’re basically trying to reverse engineer it using a lot of electricity and I doubt we’ll get to squirrel level intelligence in my lifetime, much less human level. But who knows? “There are decades where nothing happens; and, there are weeks where decades happen.” (A quote from V.I. Lenin. I don’t want to be political here but hopefully we can all agree he made some history happen.)
The name is an analogy, neural networks do not work in the same way as biological neurons. They were designed by computer scientists, not biologists.
RAM is so far removed from biological short term memory both in how it works and how it's used that the comparison doesn't even make sense. The only similarity is that they're short term information/data stores, so it's equally valid to compare them to a drawing in the sand of a beach.
There is a time and place for nonsense, and this isn't it. I guess it being plausible sounding is the issue.