This is a most excellent place for technology news and articles.
It's a good thing that ChatGPT is only one of the many LLM's to choose from.
I'm inclined to believe that they're throwing all prompts and outputs into a db and searching that.
As someone who fiddled with Stable Diffusion which also has optional invisible watermarks this is a good feature. It is so that AI training will avoid content marking itself as AI generated. If people want to hide that their content is AI generated then, sadly, it's harder to detect.
Watermarking everything I digitally publish to keep my original content out of a training set.
Publishing a website full of de-watermarked AI slop to ruin future LLMs.
Arent there better methods to poison AI?
I have heard Glaze and Nightshade are good, but have never used them
They're getting out of date already because newer models are catching up on them. It's a cat and mouse game that will likely never end.
More info if you're seriously considering it. https://codoraven.com/blog/ai/stable-diffusion-the-invisible-watermark-in-generated-images/
I don't actually know if any model creators check for the watermark or not.
They could inject random zero width non joiners to help detection too. Easy to defeat, but something a layperson would have to go through extra effort to filter out. Kinda like how some plagiarism cases have been won by pointing out identical misspelled words.
Yeah, no chance they'd rely on something that would be so easy to defeat. Watermarking by using word patterns is far more likely.
Still easy to defeat by just using another LLM to rephrase it though.
It's one of many things they could do just like how security is a layers thing.
They could, but adding random zero width characters into words would also destroy ever spell checker, giving it away immediately and making sure that even unaware people would filter it. Doing it outside the words would leave them with too few spots to use for proper watermarking.
I think it's far more likely they'll use some kind of pattern in the tokens - that way the watermark will remain even when you don't copypaste it.
But yeah, as said, they will never tell how it's implemented, but it can still be simply subverted.
What's the false positive rate tho
Am I the only one who rewrites most of ChatGPT's output into my own words because it's "voice" is garbage anyway? I ask it to write me a cover letter and that gives me a rough outline and some points to make, but I have to do massive editing to avoid redundancy, awkward phrasing, outright lies, etc.
I can't imagine turning in raw ChatGPT output. I had one of my developers use Bing AI to write code and submitted that shit raw and it was immediately obvious because some relatively simple code has really weird artifacts like overwriting a value that had no reason to even be touched.
Yes, but I use chatgpt to do the rewrites too
i use it to make outlines which are usually very good and then I use the class materials to flesh out the outlines in my own words. All my words but ChatGPT told me what to include and in what order.
That's valid. And I'd be surprised if that could be watermarked.
For me I find it sounds too much like a marketing person or something I'd see in an ad or a website so I "dumb it down" a bit to make it not sound too corporate. Sometimes telling Chatgpt to do so fixes this though.
Lol. AI gonna take over the developers job. Like that's even close to happening.
LLMs aren't going to take coding jobs, there are specific case AIs being trained for that. They write code that works but does not make sense to human eyes. It's fucking terrifying but EVERYONE just keeps focusing on the LLMS.
There are at least 2 more dangerous model types being used right now to influence elections and manipulate online spaces and ALL everyone cares about is their fucking parrot bots....
Please elaborate for the uneducated
Thanks, great read. Appreciate it. That was one example but you mentioned two - are you thinking of some of the broader disinformation applications in addition to the data gathering mentioned?
Look, I don't want to waste your time so let me tell you this is a subject I have been concerned about, researched, coded for, and posting about mass manipulation via AI since the 90s.
You can really be pedantic and nit-picky all you want, it really doesn't matter to me. AI is the second greatest existential threat we face as a species. If you haven't already been convinced at least to some degree of its danger, nothing I will say will change your mind anyway.
The most dangerous right now AI manifestation is in sentiment identification and control, the second is autonomous armed robots.
Thanks my dude. I was just asking you an honest question. Appreciate the information
Get bent in extradimensional vectors.
You seem angry :-p
You seem blocked
Few years ago the output of GPT was complete gibberish and few years before that even producing such gibberish would've been impressive.
It doesn't take anyone's job untill it does.
Few years ago the output of GPT was complete gibberish
That's not really true. Older GPTs were already really good. Did you ever see SubredditSimulator? I'm pretty sure that first came around like 10 years ago.
They were good for about a paragraph, maybe less.
As soon as they reached the attention limit they started talking gibberish.
The first time I saw text written by GPT it all seemed alright at first glance but once you started to actually read it was immediately obvious it had no idea what it was talking about. It was grammatically correct nonsense.
Idk it looks good to me. Straight to the main branch you go.
so the AI is going to say 'like' every third word?
Humans instinctively do something analogous with natural language, using poetic forms like rhyme, meter, and alliteration. (For example, the speeches from Shakespeare’s plays are immediately detectable because they’re in iambic pentameter.)
Imagine you lacked the natural human ability to detect verse, making poetry indistinguishable from prose. As far as you could tell, it would be like an invisible watermark that only specialists could detect. LLMs can use a similar approach, making up their own patterns that are opaque to humans but detectable to themselves.
