The Open-Source Software Saving the Internet From AI Bot Scrapers : opensource

[–] [email protected] 10 points 3 days ago

Brodie interviewed the creator of Anubis a little while back, it's pretty good.

[+] [email protected] -37 points 3 days ago (13 children)

I’d like to use Anubis but the strange hentai character as a mascot is not too professional

[–] [email protected] 16 points 3 days ago

It's just image files, you can remove them or replace the images with something more corporate. The author does state they'd prefer you didn't change the pictures, but the license doesn't require adhering to their personal request. I know at least 2 sites I've visited previously had Anubis running with a generic checkmark or X that replaced the mascot

[–] [email protected] 32 points 3 days ago (1 children)

hentai?

[–] [email protected] 14 points 3 days ago (2 children)

Anime whatever. God I sound like a boomer.

load more comments (2 replies)

load more comments (11 replies)

[–] [email protected] 7 points 3 days ago

I had seen that prompt, but never searched about it. I found it a little annoying, mostly because I didn't know what it was for, but now I won't mind. I hope more solutions are developed :D

[+] [email protected] -17 points 3 days ago (21 children)

I get that website admins are desperate for a solution, but Anubis is fundamentally flawed.

It is hostile to the user, because it is very slow on older hardware andere forces you to use javascript.

It is bad for the environment, because it wastes energy on useless computations similar to mining crypto. If more websites start using this, that really adds up.

But most importantly, it won't work in the end. These scraping tech companies have much deeper pockets and can use specialized hardware that is much more efficient at solving these challenges than a normal web browser.

[–] [email protected] 24 points 3 days ago (1 children)

That last paragraph is nothing but defeatism

[–] [email protected] 2 points 3 days ago (1 children)

On the contrary, I'm hoping for a solution that is better than this.

Do you disagree with any part of my assessment? How do you think Anubis will work long term?

load more comments (1 replies)

load more comments (20 replies)

[–] [email protected] 90 points 3 days ago (7 children)

This is fantastic and I appreciate that it scales well on the server side.

Ai scraping is a scourge and I would love to know the collective amount of power wasted due to the necessity of countermeasures like this and add this to the total wasted by ai.

load more comments (7 replies)

Open Source

Useful Links

Rules

Related Communities