Holy shit. Dunning Kruger is fully engaged in these post comments
this post was submitted on 17 May 2024
502 points (94.8% liked)
Technology
59055 readers
3173 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
it's only going to get worse, especially as datasets deteriorate.
With things like reddit being overrun by AI, and also selling AI training data, i can only imagine what mess that's going to cause.
Hallucinations, like depression, is a multifaceted issue. Training data is only a piece of it. Quantized models, overfitted training models rely on memory at the cost of obviously correct training data. Poorly structured Inferences can confuse a model.
Rest assured, this isn't just training data.
yeah there's also this stuff as well, though i consider that to be a more technical challenge, rather than a hard limit.
I think you are spot on. I tend to think the problems may begin to outnumber the potentials.
and we haven't even gotten into the problem of what happens when you have no more data to feed it, do you make more? That's an impossible task.
There's already attempts to create synthetic data to train on
>The verge
Don't take away the hallucinations, how am I supposed to do ERP with the models then?
You do enterprise resource planning with AI hallucinations?
Yeah! Just like water's "wetness" problem. It's kinda fundamental to how the tech operates.
view more: next ›