this post was submitted on 09 Jan 2025
478 points (99.2% liked)
Opensource
1662 readers
140 users here now
A community for discussion about open source software! Ask questions, share knowledge, share news, or post interesting stuff related to it!
⠀
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Training the model yourself would take years on a single machine. If you factor that into your cost per query, it blows up.
The data centers are (currently) mainly used for training new models.
But if you divide the cost of training by the number of people using the model, it should be pretty low.