this post was submitted on 14 Mar 2024
179 points (97.4% liked)

Technology

59331 readers
5341 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Global service provider Keywords, which recently worked on acclaimed projects like Alan Wake 2, Baldur's Gate 3, and The Legends of Zelda: Tears of the Kingdom, conducted an experiment last year.

The company tried to make a 2D video game relying solely on generative AI (GenAI) tools and technology. The R&D initiative was dubbed 'Project Ava' and saw a team, initially from Electric Square Malta, evaluate and leverage over 400 (unnamed) tools to understand how they might "augment" game development.

As detailed in the company's latest fiscal report, however, the project ultimately proved that while some generative AI tools might simplify or accelerate certain processes, they are currently "unable to replace talent."

top 20 comments
sorted by: hot top controversial new old
[–] [email protected] 36 points 8 months ago (3 children)

Story time:

I'm a software developer for a large, multinational company. Yesterday, I needed to update the Knex migrations for the project I'm assigned to. We needed three new PostgreSQL tables, with several foreign key constraints. I added the migration to our existing migrations in a backend plugin we're building out.

I use Copilot for developers regularly. It was helpful in this case, generating the table migrations automatically. Of course, it hallucinated a few methods Knex doesn't have, but I'm used to things like that, and easily corrected them. Once I was done testing, I created a pull request to merge the commit in my working branch with the main branch in git.

Now, look at what I just wrote. If you're not a developer, you probably have no idea what "Knex" or "PostgreSQL" mean. You probably recognize the words "foreign," "key," and "constraints," but you haven't got a clue why I'm using them in that order or what I'm referring to. It likely looks like I'm using the word "migrations" completely incorrectly. You don't know what it means for "Knex" to have "methods." Words like "git," "pull request," and "commit" just read like gibberish to you.

You wouldn't know how to ask Copilot to do anything. You wouldn't know where to place any results you manage to get from it. If your boss came to you and said, "here's this feature requirement, make it happen," you would fail. You wouldn't know why, either. Hell, you wouldn't even know what it is your boss is trying to accomplish. You could spend the next six months trying to figure it all out, and maybe you'd succeed, but probably not. Because you aren't a developer.

I'm a developer. All of what I wrote above makes perfect sense to me, and it's one of the simplest tasks I could tackle. Took about fifteen minutes to accomplish, from creating the migration file to getting the PR ready to merge.


I've been lambasted for insisting that large language models aren't going to replace actual professionals because they're not capable of joined-up thinking, meta-cognition, or creativity. I get told they'll be able to do all of that any day now, and my boss will be able to fire all of his employees and replace them with an MBA - or worse, do the work himself. Depending on the attitudes of who I'm talking to, this is either a catastrophe or the greatest thing since sliced bread.

It's neither, because that's not going to happen. Look at the story above, and tell me you could do the same thing with no training or understanding, because ChatGPT could do it all. You know that's bullshit. It can't. LLMs are useful tools for people like me, and that's it. It's another tool in the toolbox, like IntelliSense and linters - two more terms you don't know if you're not a developer.

The bloom is beginning to come off the rose. Businesses are gradually realizing the pie-in-the-sky promises of LLM boosters are bogus.

[–] [email protected] 11 points 8 months ago (1 children)

The majority of my time isn't spent writing code; it's reading code, reviewing changes, and thinking about code.

[–] [email protected] 3 points 8 months ago

Amen to that! I also spend a fair amount of time thinking about new features and how they would plug into our vast ecosystem, no part of which could Copilot possibly know anything about.

[–] [email protected] 4 points 8 months ago

Honestly, the shorter way to say all of this is “the AI” is supposed to make everyone a coder. “The AI” is supposed to make everyone an artist. Who is doing more coding or art than they used to? I know some people are (I am) but I know most people aren’t, even a little bit. That’s how you know it’s a tool for people who want it, or wanted it before it existed, but it’s not really driving any new demand at the level that would replace the experts already in place who can use the tool.

[–] [email protected] 7 points 8 months ago (1 children)

People know what pull requests are. I make them to my girlfriend all the time.

[–] [email protected] 6 points 8 months ago (1 children)
[–] [email protected] 7 points 8 months ago

The python knexes at midnight.

[–] [email protected] 1 points 8 months ago

Art is media that conveys emotions and ideas from one human to another. Unless a machine has emotions of its own, it cannot make art. It is just making media.

[–] [email protected] 20 points 8 months ago* (last edited 8 months ago)

Anytime you look under the hood of something billed as “completely AI generated” media, you find a team of really talented, creative people. Music, books, short films, and of course games. It's the same story time and again, and the story is marketing.

Creative people using AI as a tool can do creative things.

[–] [email protected] 2 points 8 months ago* (last edited 8 months ago)

Wait, the really are named "Keywords"?

[–] [email protected] 3 points 8 months ago

They've clearly never played snake 2

[–] [email protected] 24 points 8 months ago

These are just new tools to create art, always have been and all the moral panic over making all creatives redundant and subsequent investor salivation and hype were never consistent with reality.

After all the people who will be able to make the most use of them are already those who know a thing or two about their craft.

[–] [email protected] 7 points 8 months ago (1 children)

I wonder if they will get banned from gamedev events like Kenney is.

[–] [email protected] 3 points 8 months ago (1 children)

Kenney the guy that makes assets?

[–] [email protected] 7 points 8 months ago

Yes. He complained about a sponsor to an organiser. The sponsor was an AI company. They banned him.

[–] [email protected] 52 points 8 months ago

I think many industries are going to quickly realise the limited utility of GenAI and the bubble will pop quite quickly when that happens.