Technology

"Converted what I said into the truth"

Now I'm not against the point you're making in any way, I think the bots are hardcore yes men.

Buut... I have a 1060 and I got it around when No Man's Sky came out, and I did try it on my 4k LED TV. It did run, but it also stuttered quite a bit.

Now I'm currently thinking of updating my card, as I've updated the rest of the PC last year. A 3070 is basically what I'm considering, unless I can find a nice 4000 series with good VRAM.

My point here being that this isn't the best example you could have given, as I've basically had that conversation several times in real life, exactly like that, as "it runs" is somewhat subjective.

LLM's obviously have trouble with subjective things, as we humans do too.

But again, I agree with the point you're trying to make. You can get these bots to say anything. It amused me that the blocks are much more easily circumvented just by telling them to ignore something or by talking hypothetically. Idk but at least very strong text based erotica was easy to get out of them last year, which I think should not have been the case, probably.

This is an issue with all models, also the paid ones and its actually much worse then in the example where you at least expressed not being happy with the initial result.

My biggest road block with AI is that i ask a minor clarifying question. “Why did you do this in that way?” Expecting a genuine answer and being met with “i am so sorry here is some rubbish instead. “

My guess is this has to do with the fact that llms cannot actually reason so they also cannot provide honest clarification about their own steps, at best they can observe there own output and generate a possible explanation to it. That would actually be good enough for me but instead it collapses into a pattern where any questioning is labeled as critique with logical follow up for its assistant program is to apologize and try again.

While I'd generally agree thst they are wrong or make up incorrect info on this case it was correct.

It gave you the min specs for vr the first time and updated specs for no man's sky the second time when you asked a more specific question.

It used your prompt of a 3070 and gave a similar perf amd card.

It doesn't know the answer, it can't run the game in vr to test. It relies on information sourced and isn't magic.

I have some vague memory of lyrics, which I am trying to find the song title theyre from. I am pretty certain of the band. Google was of no use.

I asked ChatGPT. It gave me a song title. Wasn’t correct. It apologised and gave me a different one - again, incorrect. I asked it to provide the lyrics to the song it had suggested. It gave me the correct lyrics for the song it had suggested, but inserted the lyrics I had provided, randomly into the song.

I said it was wrong - it apologised, and tried again. Rinse repeat.

I feel part of the issue is LLMs feel they have to provide an answer, and can’t say it doesn’t know the answer. Which highlights a huge limitation of these systems - they can’t know if something is right or wrong. Where these systems suggest can index and parse vast amounts of data and suggest you can ask it questions about that data, fundamentally (imo) it needs to be able to say “I dont have the data to provide that answer”

Most times what I get when asking it coding questions is a half-baked response that has a logic error or five in it.

Once I query it about one of those errors it replies with, "You're right, X should be Y because of (technical reason Z). Here's the updated code that fixes it".

It will then give me some code that does actually work, but does dumb things, like recalculating complex but static values inside a loop. When I ask if there's any performance improvements it can do, suddenly it's full of helpful ways to improve the code that can make it run 10 to 100 times faster and fix those issues. Apparently if I want performant code, I have to explicitly ask for it.

For some things it will offer solutions that don't solve the issue that I raise, no matter how many different ways I phrase the issue and try and coax it towards a solution. At that point, it basically can't, and it gets bogged down to minor alterations that don't really achieve anything.

Sometimes when it hits that point I can say "start again, and use (this methodology)" and it will suddenly hit upon a solution that's workable.

So basically, right now it's good for regurgitating some statistically plausible information that can be further refined with a couple of good questions from your side.

Of course, for that to work you have to know the domain you're working in fairly well already otherwise you're shit out of luck.

ChatGPT does not "hallucinate" or "lie". It does not perceive, so it can't hallucinate. It has no intent, so it can't lie. It generates text without any regard to whether said text is true or false.

All AI share a central design flaw of being what people think they should return based on weighted averages of 'what people are saying' with a little randomization to spice things up. They are not designed to return factual information because they are not actually intelligent so they don't know fact from fiction.

ChatGPT is designed to 'chat' with you like a real person, who happens to be agreeable so you will keep chatting with it. Using it for any kind of fact based searching is the opposite of what it is designed to do.

I think some of the issue is that the bulk of its knowledge is from a few years back and it relies on searching the internet to fill the gap. But it prefers the older database it was trained against.

Yes and no. 1060 is fine for basic VR stuff. I used my Vive and Quest 2 on one.

May I offer you a fairly convincing explanation