Weird News - Things that make you go 'hmmm'

906 readers

255 users here now

Rules:

News must be from a reliable source. No tabloids or sensationalism, please.
Try to keep it safe for work. Contact a moderator before posting if you have any doubts.
Titles of articles must remain unchanged; however extraneous information like "Watch:" or "Look:" can be removed. Titles with trailing, non-relevant information can also be edited so long as the headline's intent remains intact.
Be nice. If you've got nothing positive to say, don't say it.

Violators will be banned at mod's discretion.

Communities We Like:

-Not the Onion

-And finally...

founded 9 months ago

MODERATORS

lemmyfanadmin

oleorun

120

'Please die', 'you are a stain on the universe,' AI chatbot tells girl seeking help for homework (www.wionews.com)

submitted 10 hours ago by oleorun to c/weirdnews

37 comments fedilink hide all child comments

Ouch.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 31 points 9 hours ago (1 children)

Here's the conversation that was linked on the reddit thread about the incident: https://gemini.google.com/share/6d141b742a13

[–] [email protected] 26 points 8 hours ago (3 children)

Holy smokes I stand corrected. The chatbot actually misunderstood the context to the point it told the human to die, out of the blue.

It's not every day you get shown a source that proves you wrong. Thanks kind stranger

[–] [email protected] 13 points 4 hours ago* (last edited 4 hours ago)

Yeah holy shit, screenshotting this in case Google takes it down, but this leap is wild

[–] [email protected] 0 points 5 hours ago (1 children)

One thing that throws me off here is the double response. I haven't used Gemini a ton but it has never once given me multiple replies. It is always one statement per my one statement. You can see at the end here there's a double response. It makes me think that there's some user input missing. There's also missing text in the user statements leading up to it as well which makes me wonder what the person was asking in full. Something about this still smells fishy to me but I've heard enough goofy things about how AIs learn weird shit to believe it's possible.

[–] [email protected] 4 points 4 hours ago

Idk what you mean “double response”. The user typed a statement, not a question, and the AI responded with its weird answer.

I think the lack of a question or specific request in the user text led to the weird response.

[–] [email protected] 6 points 8 hours ago* (last edited 8 hours ago)

No problem. I understand the skepticism here, especially since the article in the OP is a bit light on the details.

EDIT:

Details on the OP article is fine enough, but it didn't link sources.