this post was submitted on 22 Jun 2025
777 points (94.4% liked)

Technology

71949 readers
5116 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

We will use Grok 3.5 (maybe we should call it 4), which has advanced reasoning, to rewrite the entire corpus of human knowledge, adding missing information and deleting errors.

Then retrain on that.

Far too much garbage in any foundation model trained on uncorrected data.

Source.

More Context

Source.

Source.

(page 4) 36 comments
sorted by: hot top controversial new old
[–] [email protected] 3 points 5 days ago

Faek news!

What a dickbag. I'll never forgive him for bastardizing one of my favorite works of fiction (Stranger in a Strange Land)

[–] [email protected] 22 points 5 days ago (6 children)

Aren't you not supposed to train LLMs on LLM-generated content?

Also he should call it Grok 5; so powerful that it skips over 4. That would be very characteristic of him

load more comments (6 replies)
[–] [email protected] 5 points 5 days ago

I love that he can call things "objectively false", but then not actually try and counterpoint any of them. It's wrong because it disagrees with what I believe. Is he going to claim the amounts are wrong, or that Jan 6th is not right wing. Disagree that left wing violence is at the extreme ends targeting property?

Grok is at least showing examples to explain it's conclusion, musk is just copying trumps "nope fake news".

[–] [email protected] 9 points 5 days ago (3 children)

adding missing information

From where?

[–] [email protected] 4 points 5 days ago

He wants to give Grok some digital ketamine and/or other psychoactive LLM mind expansives.

[–] [email protected] 8 points 5 days ago

Musk's fascist ass.

load more comments (1 replies)
[–] [email protected] 8 points 5 days ago

"And the Libertarian founding fathers defeated the woke pro-slavery communists, to get rid of the DEI british and found America (which was uninhabited at the time)" -Grok

[–] [email protected] 8 points 5 days ago* (last edited 5 days ago)

This is just vibe written ~~fantasy~~ historical fiction.

[–] [email protected] 10 points 5 days ago (1 children)

This is the Ministry of Truth.

This is the Ministry of Truth on AI.

load more comments (1 replies)
[–] [email protected] 34 points 5 days ago

iamverysmart

[–] [email protected] 3 points 5 days ago

I've seen what happens when image generating AI trains on AI art and I can't wait to see the same thing for "knowledge"

[–] [email protected] 1 points 5 days ago

I see Mr. Musk has started using intracerebrally.

[–] [email protected] 252 points 5 days ago (2 children)

adding missing information and deleting errors

Which is to say, "I'm sick of Grok accurately portraying me as an evil dipshit, so I'm going to feed it a bunch of right-wing talking points and get rid of anything that hurts my feelings."

load more comments (2 replies)
[–] [email protected] 5 points 5 days ago (1 children)

"Adding missing information" Like... From where?

load more comments (1 replies)
[–] [email protected] 4 points 5 days ago (2 children)

I'm interested to see how this turns out. My prediction is that the AI trained from the results will be insane, in the unable-to-reason-effectively sense, because we don't yet have AIs capable of rewriting all that knowledge and keeping it consistent. Each little bit of it considered in isolation will fit the criteria that Musk provides, but taken as a whole it'll be a giant mess of contradictions.

Sure, the existing corpus of knowledge doesn't all say the same thing either, but the contradictions in it can be identified with deeper consistent patterns. An AI trained off of Reddit will learn drastically different outlooks and information from /r/conservative comments than it would from /r/news comments, but the fact that those are two identifiable communities means that it'd see a higher order consistency to this. If anything that'll help it understand that there are different views in the world.

[–] [email protected] 4 points 5 days ago

LLMs are prediction tools. What it will produce is a corpus that doesn't use certain phrases, or will use others more heavily, but will have the same aggregate statistical "shape".

It'll also be preposterously hard for them to work out, since the data it was trained on always has someone eventually disagreeing with the racist fascist bullshit they'll get it to focus on. Eventually it'll start saying things that contradict whatever it was supposed to be saying, because statistically eventually some manner of contrary opinion is voiced.
They won't be able to check the entire corpus for weird stuff like that, or delights like MLK speeches being rewriten to be anti-integration, so the next version will have the same basic information, but passed through a filter that makes it sound like a drunk incel talking about asian women.

load more comments (1 replies)
[–] [email protected] 15 points 5 days ago (4 children)

That's not how knowledge works. You can't just have an LLM hallucinate in missing gaps in knowledge and call it good.

[–] [email protected] 2 points 5 days ago

Yeah, this would be a stupid plan based on a defective understanding of how LLMs work even before taking the blatant ulterior motives into account.

[–] [email protected] 14 points 5 days ago

And then retrain on the hallucinated knowledge

load more comments (1 replies)
[–] [email protected] 4 points 5 days ago

He’s done with Tesla, isn’t he?

[–] [email protected] 2 points 5 days ago
[–] [email protected] 12 points 5 days ago

What a fucking idiot

[–] [email protected] 25 points 5 days ago (1 children)

How does anyone consider him a "genius"? This guy is just so stupid.

[–] [email protected] 11 points 5 days ago (1 children)

Guessing some kind of PR campaign that he purchased to make him look like a genius on TV and movies.

load more comments (1 replies)
[–] [email protected] 2 points 5 days ago

Solve physics and kill god

[–] [email protected] 15 points 5 days ago

I have Twitter blocked at my router.

Please tell me one of the "politically incorrect but objectively true" facts was that Elon is a pedophile.

[–] [email protected] 23 points 5 days ago

That's a hell of way to say that he wants to rewrite history.

[–] [email protected] 85 points 5 days ago* (last edited 5 days ago) (2 children)

adding missing information

Did you mean: hallucinate on purpose?

Wasn't he going to lay off the ketamine for a while?

Edit: ... i hadnt seen the More Context and now i need a fucking beer or twnety fffffffffu-

[–] [email protected] 5 points 5 days ago* (last edited 5 days ago)

Yeah, let's take a technology already known for filling in gaps with invented nonsense and use that as our new training paradigm.

[–] [email protected] 41 points 5 days ago (1 children)

He means rewrite every narrative to his liking, like the benevolent god-sage he thinks he is.

[–] [email protected] 23 points 5 days ago

Let's not beat around the bush here, he wants it to sprout fascist propaganda.

[–] [email protected] 30 points 5 days ago

If we would talk like this, we’d end up in a padded room and drugged to kingdom come. And for good reason, I should say.

[–] [email protected] 299 points 5 days ago (1 children)

Isn't everyone just sick of his bullshit though?

[–] [email protected] 68 points 5 days ago (1 children)

US tax payers clearly aren't since they're subsidising his drug habit.

[–] [email protected] 59 points 5 days ago* (last edited 5 days ago) (2 children)

If we had direct control over how our tax dollars were spent, things would be different pretty fast. Might not be better, but different.

load more comments (2 replies)
load more comments
view more: ‹ prev next ›