Technology

70163 readers

3421 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related news or articles.
Be excellent to each other!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
Check for duplicates before posting, duplicates may be removed
Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago

MODERATORS

[email protected]

301

The Collapse of GPT: Will future artificial intelligence systems perform increasingly poorly due to AI-generated material in their training data? (cacm.acm.org)

submitted 4 days ago by [email protected] to c/[email protected]

57 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 9 points 3 days ago (1 children)

Nah that means you can ask an LLM "is this real" and get a correct answer.

That defeats the point of a bunch of kinds of material.

Deepfakes, for instance. International espionage, propaganda, companies who want "real people".

A simple is_ai checkbox of any kind is undesirable, but those sources will end back up in every LLM, even one that was behaving and flagging its output.

You'd need every LLM to do this, and there's open source models, there's foreign ones. And as has already been proven, you can't rely on an LLM detecting a generated product without it.

The correct way to do it would be to instead organize a not-ai certification for real content. But that would severely limit training data. It could happen once quantity of data isn't the be-all end-all for a model, but I dunno when when or if that'll be the case.

[–] [email protected] 1 points 3 days ago

LLM watermarking is economically desireble. Why would it be more profitable to train worse LLMs on LLM outputs? I'm curious for any argument.

Also, what has deep-fakes anything to do with LLMs? This is not related at all.

A certificate for "real" content is not feasible. It's much easier to just prevent LLMs to train on LLM output.