I was using phoenix and elixir right when Chat gpt came out and people were like "it'll take our jerb".
I tried to get it to build a basic module that built a playing deck of cards. At first it looked OK, the basic layout made sense, but then I realised it called functions that weren't there, some functions were just empty, since logic was wrong and actually it was all around terrible.
I tried to fix it with prompts and it got worse or implemented my suggestions incorrectly and was still broken.
Ultimately it took a lot longer to get no where than if I'd just written it by myself. But I could see how someone with not much knowledge in the area could see the output and be impressed.