1074
AI companies are violating a basic social contract of the web and and ignoring robots.txt
(www.theverge.com)
This is a most excellent place for technology news and articles.
last i checked humans dont access every page on a website nearly simultaneously...
And if you imitate a human then honestly who cares.