this post was submitted on 22 Jun 2025
777 points (94.4% liked)

Technology

71949 readers
7318 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

We will use Grok 3.5 (maybe we should call it 4), which has advanced reasoning, to rewrite the entire corpus of human knowledge, adding missing information and deleting errors.

Then retrain on that.

Far too much garbage in any foundation model trained on uncorrected data.

Source.

More Context

Source.

Source.

(page 3) 50 comments
sorted by: hot top controversial new old
[–] [email protected] 1 points 4 days ago

I believe it won't work.

They would have to change so much info that won't make a coherent whole. So many alternative facts that clash with so many other aspects of life. So asking about any of it would cause errors because of the many conflicts.

Sure it might work for a bit, but it would quickly degrade and will be so much slower than other models since it needs to error correct constantly.

An other thing is that their training data will also be very limited, and they would have to check every single other one thoroughly for "false info". Increasing their manual labour.

[–] [email protected] 1 points 4 days ago

Grok will round up physics constants and pi as well... nothing will work but Musk will say that humanity is dumb

[–] [email protected] 56 points 4 days ago (18 children)

Whatever. The next generation will have to learn to trust whether the material is true or not by using sources like Wikipedia or books by well-regarded authors.

The other thing that he doesn't understand (and most "AI" advocates don't either) is that LLMs have nothing to do with facts or information. They're just probabilistic models that pick the next word(s) based on context. Anyone trying to address the facts and information produced by these models is completely missing the point.

[–] [email protected] 15 points 4 days ago (5 children)

Thinking wikipedia or other unbiased sources will still be available in a decade or so is wishful thinking. Once the digital stranglehold kicks in, it'll be mandatory sign-in with gov vetted identity provider and your sources will be limited to what that gov allows you to see. MMW.

load more comments (5 replies)
load more comments (17 replies)
[–] [email protected] 27 points 4 days ago* (last edited 4 days ago)

How high on ketamine is he?

3.5 (maybe we should call it 4)

I think calling it 3.5 might already be too optimistic

[–] [email protected] 16 points 4 days ago

First error to correct:

We will use Grok 3.5 (maybe we should call it 4), which has advanced reasoning, to rewrite the entire corpus of human knowledge, adding missing ~~information~~ errors and deleting ~~errors~~ information.

[–] [email protected] 28 points 4 days ago (3 children)

Elon should seriously see a medical professional.

[–] [email protected] 7 points 4 days ago

He should be locked up in a mental institute. Indefinitely.

load more comments (2 replies)
[–] [email protected] 18 points 4 days ago

We have never been at war with Eurasia. We have always been at war with East Asia

[–] [email protected] 5 points 5 days ago (2 children)

Like all Point-Haired Bosses through the history, Elon has not heard of (or consciously chooses to ignore) one of the fundamental laws of computing: garbage in, garbage out

[–] [email protected] 1 points 4 days ago

Garbage out is what he aims for.

load more comments (1 replies)
[–] [email protected] 8 points 5 days ago

What a loser. He'll keep rewriting it until it fits his world-view

[–] [email protected] 43 points 5 days ago

Because neural networks aren't known to suffer from model collapse when using their output as training data. /s

Most billionaires are mediocre sociopaths but Elon Musk takes it to the "Emperors New Clothes" levels of intellectual destitution.

[–] [email protected] 5 points 5 days ago

Every single endeavor that musk is involved in, is toxic af. He, and all of this businesses, are cancers metastasizing within our society. We really should remove them.

[–] [email protected] 12 points 5 days ago

When you think he can't be more of a wanker with an ameba brain.... He surprises you

[–] [email protected] 50 points 5 days ago (1 children)

So where will Musk find that missing information and how will he detect "errors"?

[–] [email protected] 17 points 4 days ago

I expect he'll ask Grok and believe the answer.

[–] [email protected] 37 points 5 days ago (2 children)

Training an AI model on AI output? Isn't that like the one big no-no?

[–] [email protected] 24 points 5 days ago (1 children)

We have seen from his many other comments about this, that he just wants a propaganda bot that regurgitates all of the right wing talking points. So that will definitely be easier to achieve if he does it that way.

load more comments (1 replies)
load more comments (1 replies)
[–] [email protected] 6 points 5 days ago

Good thing he's not trying to rewrite the Human Animus, because that's how you end up losing Deimos.

[–] [email protected] 107 points 5 days ago (1 children)

"If we take this 0.84 accuracy model and train another 0.84 accuracy model on it that will make it a 1.68 accuracy model!"

~Fucking Dumbass

[–] [email protected] 29 points 4 days ago (1 children)
load more comments (1 replies)
[–] [email protected] 8 points 5 days ago (1 children)

We will take the entire library of human knowledge, cleans it, and ensure our version is the only record available.

The only comfort I have is knowing anything that is true can be relearned by observing reality through the lense of science, which is itself reproducible from observing how we observe reality.

load more comments (1 replies)
[–] [email protected] 23 points 5 days ago

So "Deleting errors" meaning rewriting history, further fuckin' up facts and definitely sowing hatred and misinformation. Just call it like it is, techbro‘s new reality. 🖕🏻

[–] [email protected] 11 points 5 days ago

Most if not all leading models use synthetic data extensively to do exactly this. However, the synthetic data needs to be well defined and essentially programmed by the data scientists. If you don't define the data very carefully, ideally math or programs you can verify as correct automatically, it's worse than useless. The scope is usually very narrow, no hitchhikers guide to the galaxy rewrite.

But in any case he's probably just parroting whatever his engineers pitched him to look smart and in charge.

[–] [email protected] 3 points 5 days ago* (last edited 5 days ago)

I think most AI corp tech bros do want to control information, they just aren't high enough on Ket to say it out loud.

[–] [email protected] 5 points 5 days ago

Prepare for Grokipedia to only have one article about white genocide, then every other article links to "Did you mean White Genocide?"

[–] [email protected] 14 points 5 days ago (2 children)

I figure the whole point of this stuff is to trick people into replacing their own thoughts with these models, and effectively replace consensus reality with nonsense. Meanwhile, the oligarchy will utilise mass data collection via Palantir and ML to power the police state.

[–] [email protected] 0 points 5 days ago

Has consensus reality ever been a thing?

[–] [email protected] 3 points 5 days ago

I don't like it but sure seems like you're correct :(

[–] [email protected] 60 points 5 days ago* (last edited 5 days ago)

I elaborated below, but basically Musk has no idea WTF he’s talking about.

If I had his “f you” money, I’d at least try a diffusion or bitnet model (and open the weights for others to improve on), and probably 100 other papers I consider low hanging fruit, before this absolutely dumb boomer take.

He’s such an idiot know it all. It’s so painful whenever he ventures into a field you sorta know.

But he might just be shouting nonsense on Twitter while X employees actually do something different. Because if they take his orders verbatim they’re going to get crap models, even with all the stupid brute force they have.

[–] [email protected] 10 points 5 days ago (3 children)

Leme guess. The holocaust was a myth is first on his list.

He should just goto hell early.

[–] [email protected] 4 points 5 days ago

He should just goto hell early.

He's going to Mars as soon as FSD on Tesla is ready, next year for sure!, to not blow in his rocket then once there chat with his amazing chatbot telling him, with 20min delay for each message, that he truly is the best.

What an absolute retard.

[–] [email protected] 1 points 5 days ago

Just one of those errors to be deleted.

[–] [email protected] 2 points 5 days ago

It already proved its inability with facts with its white genocide rantings.

[–] [email protected] 52 points 5 days ago

Dude is gonna spend Manhattan Project level money making another stupid fucking shitbot. Trained on regurgitated AI Slop.

Glorious.

[–] [email protected] 13 points 5 days ago (1 children)

This is it I'm adding 'Musk' to my block list I'm so tired of the pseudo intellectual bullshit with bad interpretation science fiction work

[–] [email protected] 6 points 5 days ago

I think deep down musk knows he's fairly mediocre intelligence wise. I think the drugs allow him to temporarily forget that.

load more comments
view more: ‹ prev next ›