this post was submitted on 21 Feb 2024
-33 points (9.8% liked)
Showerthoughts
29612 readers
1056 users here now
A "Showerthought" is a simple term used to describe the thoughts that pop into your head while you're doing everyday things like taking a shower, driving, or just daydreaming. The best ones are thoughts that many people can relate to and they find something funny or interesting in regular stuff.
Rules
- All posts must be showerthoughts
- The entire showerthought must be in the title
- Avoid politics (NEW RULE as of 5 Nov 2024, trying it out)
- Posts must be original/unique
- Adhere to Lemmy's Code of Conduct
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I don't quite understand what you're going for.
How does this protect us from data brokers?
Can't you already pull the data of an entire instance via the api?
If you don't trust your instance admins, have you considered setting up your own?
You could ask the host through the api to do that, and that's the same the problem with Reddit. What we have changed here on Lemmy is more instances to choose from, the public knowledge grows with the instance and I wouldn't expect the host to let you access the data for free as the value(communities) grows.
There is real value in the data, way more than ever, bc it is the source for LLM.
So you fear that instance admins would start closing their apis. It would've been real helpful if that was on the on the original post.
The api is accessible and I don't see that changing because it is, y'know, required for federation. If you want backups, you can start scraping or host a private instance that subscribes to everything you want to save.
Releasing dumps the way you described would be a massive burden on admins, or even completely infeasible.
It adds work but it is actually very easy, the texts and images aren't that big. The burden is eased by more people engage in seeding(hosting) the data.
Well, let's just say that I doubt you'll be able to sell this idea to instance admins.
However, you can become the change you wish to see yourself. You can start scraping today and create your own dumps that way; the apis are yet to be closed.