this post was submitted on 04 Jun 2024
388 points (91.8% liked)
Technology
59429 readers
2992 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
On the plus side, the industry is rapidly moving towards locally-run AI models specifically because they don't want to purchase and run fleets of these absurd things or any other expensive hardware.
Yeah, I think the author misses the point in regard to power consumption. Companies will not buy loads of these and use them in addition to existing hardware. They will buy these to get rid of current hardware. It's not clear (yet) if that will increase, decrease or not affect power consumption.
Even if companies were replacing existing hardware, the existing hardware uses less power. So whether it is additional hardware or not, there will be an increase in energy demand, which is bad for climate change.
I have personally worked on a project where we replaced several older nodes in datacenters with only one modern one. That used more power than two older nodes combined, but since we were shutting down 15-20, we saved a lot of power. Not every replacement is 1:1, most aren't.