this post was submitted on 15 Sep 2024
885 points (98.2% liked)

Technology

59378 readers
3118 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 272 points 2 months ago (44 children)

Wow, the text generator that doesn't actually understand what it's "writing" is making mistakes? Who could have seen that coming?

I once asked one to write a basic 50-line Python program (just to flesh things out), and it made so many basic errors that any first-year CS student could catch. Nobody should trust LLMs with anything related to security, FFS.

[–] [email protected] 59 points 2 months ago (3 children)

My experience with ChatGPT goes like this:

  • Write me a block of code that makes x thing
  • Certainly, here's your code
  • Me: This is wrong.
  • You're right, this is the correct version
  • Me: This is wrong again.
  • You're right, this is the correct version
  • Me: Wrong again, you piece of junk.
  • I'm sorry, this is the correct version.
  • (even more useless code) ... and so on.
[–] [email protected] 31 points 2 months ago* (last edited 2 months ago) (2 children)

I interviewed someone who used AI (CoPilot, I think), and while it somewhat worked, it gave the wrong implementation of a basic algorithm. We pointed out the mistake, the developer fixed it (we had to provide the basic algorithm, which was fine), and then they refactored and AI spat out the same mistake, which the developer again didn't notice.

AI is fine if you know what you're doing and can correct the mistakes it makes (i.e. use it as fancy code completion), but you really do need to know what you're doing. I recommend new developers avoid AI like the plague until they can use it to cut out the mundane stuff instead of filling in their knowledge gaps. It'll do a decent job at certain prompts (i.e. generate me a function/class that...), but you're going to need to go through line-by-line and make sure it's actually doing the right thing. I find writing code to be much faster than reading and correcting code so I don't bother w/ AI, but YMMV.

An area where it's probably ideal is finding stuff in documentation. Some projects are huge and their search sucks, so being able to say, "find the docs for a function in library X that does..." I know what I want, I just may not remember the name or the module, and I certainly don't remember the argument order.

[–] [email protected] 8 points 2 months ago

AI is like having an intern you can delegate to. If you give it a simple enough task with clear direction, it can come up with something useful, but you need to check.

[–] [email protected] 19 points 2 months ago (1 children)

AI is fine if you know what you're doing and can correct the mistakes it makes (i.e. use it as fancy code completion)

I'm not a developer and i havent touched code for over 10 yrs, but when i heard about my company pushing AI tools on the devs, i thought exactly what you said. It should be a tool for experienced devs who already know what they're doing....

Lo and behold they did the opposite... They fired all the senior people and pushed AI on the interns and new grads.... and then expected AI to suddenly make the jr devs work like the expensive Sr devs they just fired...

Wtf

[–] [email protected] 7 points 2 months ago

Yeah, it makes no sense. AI is at best a replacement for junior devs and interns.

[–] [email protected] 36 points 2 months ago* (last edited 2 months ago)

All the while it gets further and further from the requirements. So you open five more conversations, give them the same prompt, and try pick which one is least wrong.

All the while realising you did this to save time but at this point coding from scratch would have been faster.

[–] [email protected] 9 points 2 months ago (1 children)

That sums up my experience too, but I have found it good for discussing functions for SQL and Powershell. Sometimes, it’ll throw something into its garbage code and I’ll be like “what does this do?” It’ll explain how it’s supposed to work, I’ll then work out its correct usage and solve my problem. Weirdly, it’s almost MORE helpful than if it just gave me functional code, because I have to learn how to properly use it rather than just copy/paste what it gives me.

[–] [email protected] 6 points 2 months ago

That's true. The mistakes actually make learning possible!

Man, designing CS curriculum will be easy in future. Just ask it to do something simple, and ask your CS students to correct the code.

load more comments (40 replies)