this post was submitted on 26 Jan 2024
1 points (100.0% liked)

Futurology

1771 readers
9 users here now

founded 1 year ago
MODERATORS
 

Since it's been a controversy on here a couple times, here's a great example of how you can demonstrate an LLM can produce something it can't have seen before.

It doesn't prove anything beyond doubt, but I think these kinds of experiments show to something like a civil law standard that they're not merely parrots.

top 4 comments
sorted by: hot top controversial new old
[–] [email protected] 0 points 9 months ago (1 children)

I think we can all agree that LLMs are just simple machines responding to stimuli and producing what we want to hear, but we're apparently not ready for the conversation that complex machines made out of proteins are any different?

[–] [email protected] 0 points 9 months ago

The human exceptionalism runs strong. At best, you can argue that this specific machine isn't thinking. Once you say no machine could do it, you're forgetting that you too are stardust.

I get accused of falling to the ELIZA effect, but I suspect some of the critics are driven by something like hubris.

[–] [email protected] 0 points 9 months ago (1 children)

They may indeed develop linguistic skills at deeper levels, but LLMs are still only playing with words. Imagine a kid who grew up confined in a library with unlimited books, but no experience of the real world outside, no experiments with moving about, bouncing balls, eating, smelling, seeing, hearing, interacting with others, only reading - might write eloquently but have no 'common sense' of reality. To train a real AI with physical sense and capabilities would be like bringing up a kid - messy, not easy to automate, takes a long time.

[–] [email protected] 0 points 9 months ago

we're still early in development, we just got surprised by how good statistical language modeling alone is