Aatube@kbin.socialtoTechnology@lemmy.world•AI companies are violating a basic social contract of the web and and ignoring robots.txt
0·
10 months agorobots.txt is purely textual; you can’t run JavaScript or log anything. Plus, one who doesn’t intend to follow robots.txt wouldn’t query it.
have you tried plasma 6?