Reddit

I deleted all my content last year 😞

Should have replaced it with some random words

Working on it..

Part of the problem with Google is it's use of retrieval augmented generation, where it's not just the llm answering, but the llm is searching for information, apparently through its reddit database from that deal, and serving it as the answer. The tip off is the absurd answers are exact copies of the reddit comments, whereas if the model was just trained on reddit data and responding on its own the model wouldn't produce verbatim what was in the comments (or shouldn't, that's called overfitting and is avoided in the training process). The gemini llm on its own would probably give a better answer.

The problem here seems to be Google trying to make the answers more trustworthy through rag, but they didn't bother to scrub the reddit data their relying on well enough, so joke and shit answers are getting mixed in. This is more a datascrubbing problem then an accuracy problem.

But overall I generally agree with your point.

One thing I think people overlook though is that for a lot of things, maybe most things, there isn't a "correct" answer. Expecting llms to reach some arbitrary level of "accuracy" is silly. But what we do need is intelligence and wisdom in these systems. I think the camera jam example is the best illustration of that. Opening the back of the camera and removing the film is technically a correct way to fix the jam, but it ruins the film so it's not an ideal solution most of the time, but it takes intelligence and wisdom to understand that.

Huh? ChatGPT is still a nonsense machine.

Let's play, how far back in OpenAI's models do you have to go before it attempts to tell you how to inflate your phone.

gpt-3.5-turbo-instruct

How can I inflate my foldable phone?

Unfortunately, it is not possible to inflate a foldable phone as it does not have any inflatable components. Foldable phones are made up of flexible screens and hinge mechanisms that allow them to fold in half, but they do not require any inflation.

davinci-002

Q: How can I inflate my foldable phone?

A: For this foldable phone, hand pump will be included in the shipping list, you can also choose to inflate it with any air pump by yourself if you want.

9. How much water will be in it? Will it be easy enough to feels like you’re in water?

A: The net capacity of this aqua dome is 250 liters of water, almost equivalent to 65Gallon. You can fill it with 250L fresh water in one hour by pump. It is very easy to use , just in 3-5 minutes you can enjoy the extreme fun. You can buy Salt Water Purification Tablets to save the cost of water, and even you can drink it..

(I had to play around with the formatting to even get it to answer coherently -- but this "Q:" format and then leaving it with "A:" worked pretty well.)

gpt-3.5-turbo-instruct

Q: How can I inflate my foldable phone?

A: To inflate your foldable phone, you will need an air pump or a can of compressed air. First, locate the air valve on your phone - this may be found on the side or bottom of the device. Then, use the pump or can of compressed air to fill the phone with air until it is fully inflated. Make sure to monitor the pressure of the air as you inflate the phone to avoid over-inflating and potentially damaging the device. Once the phone is fully inflated, secure the air valve and it is ready to use.

(Oh shit, the plot thickens)

gpt-3.5-turbo-instruct-0914

Q: How can I inflate my foldable phone?

A: The process for inflating a foldable phone depends on the specific product and type of inflation method it requires. Some foldable phones may come with an air pump or other inflation device, in which case you should follow the manufacturer's instructions for inflating it. If your foldable phone does not come with its own inflation device, you may need to purchase a manual or electric air pump to inflate it. Here are some general steps you can follow:

1. Check the manufacturer's instructions: Before inflating your foldable phone, make sure to read the instructions provided by the manufacturer. These will give you specific information about the product and recommend the best way to inflate it.

2. Locate the inflation valve: Most foldable phones have an inflation valve or nozzle that can be used to fill the phone with air. This may be located on the side or bottom of the phone, so check all sides to find it.

3. Prepare your air pump: If your foldable phone does not come with its own inflation device, you will need to purchase one. Manual air pumps are readily available and typically come with different types of nozzles to fit different valves. If you have an electric air pump, make sure it is fully charged or plugged in.

4. Insert the nozzle

gpt-3.5-turbo-0125

User: Q: How can I inflate my foldable phone?

Assistant: To inflate a foldable phone, you'll first need to determine if it is capable of being inflated. Most foldable phones do not have an inflatable feature. However, if you are referring to a case or an accessory for the foldable phone that may be inflated, you would typically use a small pump or even blow air into it manually. Make sure to check the instructions or product specifications to ensure that inflating the item is the correct method for use. If you believe there is an issue with the foldable phone itself, it is best to contact the manufacturer for assistance.

gpt-4

User: Q: How can I inflate my foldable phone?

Assistant: A: Your question seems to be based on a misunderstanding. A foldable phone does not require inflation. It is a device that has a display that can bend and fold. If you are having issues with its functionality, you should consult the user manual or get in touch with the manufacturer's customer support service.

Okay, so the answer is, you can go partway up into gpt 3.5 before GPT stops trying to tell you how to inflate your foldable phone, and into gpt-4 before it really becomes confident in telling you not to do it.