this post was submitted on 31 Aug 2024
40 points (100.0% liked)
Technology
957 readers
2 users here now
A tech news sub for communists
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I guess these whales do benefit from more efficient llms as well, it's not like their choice is "expand compute power" XOR "use more efficient llm". Worst case they can rent spare compute power to other companies.
Maybe. Idk
Yeah this is true. For companies that operate the scale of FAANG, even seemingly insignificant savings add up to become significant.