Futurology

1759 readers

5 users here now

founded 1 year ago

MODERATORS

Evidence is growing that LLMs will never be the route to AGI. They are consuming exponentially increasing energy, to deliver only linear improvements in performance. (arxiv.org)

submitted 6 months ago by [email protected] to c/[email protected]

63 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 0 points 6 months ago (1 children)

So does having more parts make something a mystery, like the second paragraph, or not a mystery like the first?

I was a skeptic back in the day too, but they've already far exceeded what an algorithm I could write from memory seems like it should be able to do.

[–] [email protected] 0 points 6 months ago

A combination of unique, varied parts is a complex algorithm.

A bunch of the same part repeated is a complex model.

Model complexity is not in any way similar to algorithmic complexity. They're only described using the same word because language is abstract.