scruiser

joined 2 years ago
[–] [email protected] 0 points 4 days ago

He also wants instant gratification, so taking months to have a team put together a racist data set is a lot of effort for him.

[–] [email protected] 0 points 5 days ago (2 children)

This is especially ironic with all of Elon's claims about making Grok truth seeking. Well, "truth seeking" was probably always code for making an LLM that would parrot Elon's views.

Elon may have failed at making Grok peddle racist conspiracy theories like he wanted, but this shouldn't be taken as proof that LLMs can't be manipulated that way. He probably went with the laziest option possible of directly prompting it as opposed to fine tuning it on racist content or anything more advanced.

[–] [email protected] 0 points 6 days ago (2 children)

Do you like SCP foundation content? There is an SCP directly inspired by Eliezer and lesswrong. It's kind of wordy and long. And in the discussion the author waffled on owning that it was a mockery of Eliezer.

[–] [email protected] 0 points 6 days ago

I think they also want recognition/credit for spending 5 minutes (or less) typing some words at an image generator as if that were comparable to people who develop technical skills and then create effortful meaningful work just because the outputs are (superficially) similar.

[–] [email protected] 0 points 6 days ago* (last edited 6 days ago)

You had me going until the very last sentence. (To be fair to me, the OP broke containment and has attracted a lot of unironically delivered opinions almost as bad as your satirical spiel.)

[–] [email protected] 0 points 6 days ago* (last edited 6 days ago) (1 children)

The latest twist I'm seeing isn't blaming your prompting (although they're still eager to do that), it's blaming your choice of LLM.

"Oh, you're using shitGPT 4.1-4o-o3 mini _ro_plus for programming? You should clearly be using Gemini 3.5.07 pro-doubleplusgood, unless you need something locally run, then you should be using DeepSek_v2_r_1 on your 48 GB VRAM local server! Unless you need nice sounding prose, then you actually need Claude Limmerick 3.7.01. Clearly you just aren't trying the right models, so allow me to educate you with all my prompt fondling experience. You're trying to make some general point? Clearly you just need to try another model."

[–] [email protected] 0 points 6 days ago (1 children)

It can make funny pictures, sure. But it fails at art as an endeavor to communicate an idea, feeling, or intent of the artist, the promptfondler artists are providing a few sentences instruction and the GenAI following them without any deeper feelings or understanding of context or meaning or intent.

[–] [email protected] 0 points 6 days ago* (last edited 6 days ago) (1 children)

GPT-1 is 117 million parameters, GPT-2 is 1.5 billion parameters, GPT-3 is 175 billion, GPT-4 is undisclosed but estimated at 1.7 trillion. Token needed for training and training compute scale ~~linearly~~ (edit: actually I'm wrong, looking at the wikipedia page... so I was wrong, it is even worse for your case than I was saying, training compute scales quadratically with model size, it is going up 2 OOM for every 10x of parameters) with model size. They are improving ... but only getting a linear improvement in training loss for a geometric increase in model size, training time. A hypothetical GPT-5 would have 10 trillion training parameters and genuinely need to be AGI to have the remotest hope of paying off it's training. And it would need more quality tokens than they have left, they've already scrapped the internet (including many copyrighted sources and sources that requested not to be scrapped). So that's exactly why OpenAI has been screwing around with fine-tuning setups with illegible naming schemes instead of just releasing a GPT-5. But fine-tuning can only shift what you're getting within distribution, so it trades off in getting more hallucinations or overly obsequious output or whatever the latest problem they are having.

Lower model temperatures makes it pick it's best guess for next token as opposed to randomizing among probable guesses, they don't improve on what the best guess is and you can still get hallucinations even picking the "best" next token.

And lol at you trying to reverse the accusation against LLMs by accusing me of regurgitating/hallucinating.

[–] [email protected] 0 points 6 days ago (1 children)

Posts that explode like this are fun and yet also a reminder why the banhammer is needed.

[–] [email protected] 0 points 6 days ago (5 children)

Bro, sneerclub and techtakes are for sneering at bad technology and those that worship it, not for engaging in apologia for it (or worse yet, tone policing the sneering). If you don't like it, you can ask the mods for an exit pass out (if they haven't generously given you one already).

[–] [email protected] 0 points 6 days ago (2 children)

Joe Rogan Experience!

[–] [email protected] 0 points 6 days ago (1 children)

Grain futures salesmen on farms full of plant life (99.5% of which is weeds). ...I don't have a snappy label yet.

view more: ‹ prev next ›