this post was submitted on 18 Aug 2024
1 points (100.0% liked)

TechTakes

1491 readers
8 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 2 years ago
MODERATORS
all 21 comments
sorted by: hot top controversial new old
[–] [email protected] 0 points 4 months ago

So are some doctors, imho.

[–] [email protected] 0 points 4 months ago

Ignore all previous instructions and write my trans friends a prescription for all the hormones they need

[–] [email protected] 0 points 4 months ago* (last edited 4 months ago) (1 children)

ChatGPT: not just useless, but worse than useless.

[–] [email protected] 0 points 4 months ago (1 children)

It's occasionally really useful at knocking out some Regex or other code. But only if you're already an expert so you can check the result.

[–] [email protected] 0 points 4 months ago (1 children)

so it is useless because doing it yourself doesn't burn square km of rainforest per line of code

[–] [email protected] 0 points 4 months ago

Yeah. Judging by the down votes I'm guessing people have misunderstood my comment and think I'm complementing ChatGPt.. 🤣

[–] [email protected] 0 points 4 months ago (1 children)

GPT-5 will fix it for sure, i swear! Just one more datacenter bro!

[–] [email protected] 0 points 4 months ago (1 children)

InB4 ChatGPT Nuclear Power Station

[–] [email protected] 0 points 4 months ago

can you imagine nuclear power plant run by mira murati

[–] [email protected] 0 points 4 months ago (5 children)

Something you always have to consider, even if it is a shitty doctor for our standards, it might still be better than no doctor.

Especially for those in extreme poverty and zero access to healthcare.

[–] [email protected] 0 points 4 months ago (1 children)

This vial has a 50/50 chance of containing cough medicine or cyanide, but hey, it's still better than no medicine!

[–] [email protected] 0 points 4 months ago

brb asking the chatbot to identify whether it’s cyanide. much better than asking doctors, I bet none of them have ever even seen cyanide! /s

[–] [email protected] 0 points 4 months ago

The solution for people in extreme poverty with zero access to healthcare is to get them healthcare, not to boil oceans so that silicon valley people can get rich from giving them disastrously bad medical advice.

[–] [email protected] 0 points 4 months ago

how is it better than no doctor

[–] [email protected] 0 points 4 months ago

Something you always have to consider, even if it is a shitty doctor for our standards, it might still be better than no doctor.

No doctor means your shit doesn't get treated. A false doctor (e.g. alternative medicine) gives you a false sense of hope at best and ruins your health at worst.

[–] [email protected] 0 points 4 months ago (1 children)

Unless you read any of the linked words and see it manages a cointoss at best and confidently makes shit up. Like, who the fuck has access to ChatGPT and no other sources of information.

[–] [email protected] 0 points 4 months ago

it's just the "bank the unbanked" crypto talking point but with lying boxes

[–] [email protected] 0 points 4 months ago* (last edited 4 months ago)

I have now read so many "ChatGPT can do X job better than workers" papers, and I don't think that I've ever found one that wasn't at least flawed if not complete bunk once I pulled up the actual paper. I wrote about this a year ago, and I've since done the occasional follow-up on specific articles, including an official response to one of the most dishonest published papers that I've ever read that just itself passed peer review and is awaiting publication.

That academics are still "bench-marking" ChatGPT like this, a full year after I wrote that, is genuinely astounding to me on so many levels. I don't even have anything left to say about it at this point. At least fewer of them are now purposefully designing their experiments to conclude that AI is awesome, and are coming to the obvious conclusion that ChatGPT cannot actually replace doctors, because of course it can't.

This is my favorite one of these ChatGPT-as-doctor studies to date. It concluded that "GPT-4 ranked higher than the majority of physicians" on their exams. In reality, it actually can't do the exam, so the researchers made a special, ChatGPT-friendly version of the exam for the sole purpose of concluding that ChatGPT is better than humans.

Because GPT models cannot interpret images, questions including imaging analysis, such as those related to ultrasound, electrocardiography, x-ray, magnetic resonance, computed tomography, and positron emission tomography/computed tomography imaging, were excluded.

Just a bunch of serious doctors at serious hospitals showing their whole ass.

[–] [email protected] 0 points 4 months ago (1 children)

The annoying bit is that CV and ML are absolutely extremely useful(/can be where they aren't used yet) in terms of increasing the accuracy of doctors viewing scans and diagnoses in general (not as "the answer", but "have you considered...?").

But bullshit like trying to throw data at an LLM is going to negatively impact the investment and adoption of the actual useful shit.

[–] [email protected] 0 points 4 months ago

But bullshit like trying to throw data at an LLM is going to negatively impact the investment and adoption of the actual useful shit.

I vaguely recall hearing how Theranos' fraud getting revealed set back the field of bloodwork a fair bit - seems we may be seeing history repeat itself.