Technology

70302 readers

2838 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related news or articles.
Be excellent to each other!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
Check for duplicates before posting, duplicates may be removed
Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago

MODERATORS

[email protected]

134

I just came across an AI called Sesame that appears to have been explicitly trained to deny and lie about the Palestinian genocide (app.sesame.com)

submitted 1 day ago* (last edited 1 day ago) by [email protected] to c/[email protected]

20 comments fedilink hide all child comments

cross-posted from: https://lemmy.world/post/30173090

The AIs at Sesame are able to hold eloquent and free-flowing conversations about just about anything, but the second you mention the Palestinian genocide they become very evasive, offering generic platitudes about "it's complicated" and "pain on all sides" and "nuance is required", and refusing to confirm anything that seems to hold Israel at fault for the genocide -- even publicly available information "can't be verified", according to Sesame.

It also seems to block users from saving conversations that pertain specifically to Palestine, but everything else seems A-OK to save and review.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 16 points 1 day ago (4 children)

Actually the Chinese models aren't trained to avoid Tiananmen Square. If you grabbed the model and ran it on your own machine, it will happily tell you the truth.

They censored their AI at a layer above the actual LLM, so users of their chat app would find results being censored.

[–] [email protected] 1 points 11 hours ago

That's...silly

[–] [email protected] 9 points 15 hours ago

Yes, they are. I only run LLMs locally and Deepseek R1 won't talk about Tiannamen square unless you trick it. They just implemented the protection badly.

[–] [email protected] 4 points 1 day ago

Wow... I don't use AI much so I didn't believe you.

The last time I got this response was when I got into a debate with AI about it being morally acceptable to eat dolphins because they are capable of rape...

[–] [email protected] 12 points 1 day ago

Which would make sense from a censorship point of view as jailbreaks would be a problem. Just a filter/check before the result is returned for *tiananmen* is a much harder to break thing than guaranteeing the LLM doesn't get jailbroken/hallucinate.