this post was submitted on 31 May 2024
60 points (82.6% liked)

Technology

59161 readers
2140 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
60
Why Is There an AI Hype? | The Luddite (theluddite.org)
submitted 5 months ago by [email protected] to c/[email protected]
25 comments fedilink hide all child comments
 

Companies are training LLMs on all the data that they can find, but this data is not the world, but discourse about the world. The rank-and-file developers at these companies, in their naivete, do not see that distinction....So, as these LLMs become increasingly but asymptotically fluent, tantalizingly close to accuracy but ultimately incomplete, developers complain that they are short on data. They have their general purpose computer program, and if they only had the entire world in data form to shove into it, then it would be complete.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 7 points 5 months ago (1 children)

this data is not the world, but discourse about the world

To be fair, the things most people talk about are things they’ve read or heard of, not their own direct personal experiences. We’ve all been putting our faith in the accuracy of this “discourse about the world”, long before LLMs came along.

[–] [email protected] 3 points 5 months ago (2 children)

Indeed. I've never been to Australia. I've never even left the continent I was born on. I am reasonably sure it exists, though, based on all the second-hand data that I've seen. I even know a fair bit about stuff you can find there, like the Crow Fishers and the Bullet Farm and the Sugartown Cabaret.

[–] [email protected] 2 points 5 months ago

If you are interested there is no direct evidence that Shakespeare ever went to Italy, but he knew plenty of people who did, and travel guides were popular at the time. 13 of his plays are at least partially set in Italy. So about 1/3rd.

Pretty impressive.