Andy Reid@lemmy.world to Technology@lemmy.worldEnglish · 1 year agoAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comexternal-linkmessage-square26fedilinkarrow-up11
arrow-up11external-linkAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comAndy Reid@lemmy.world to Technology@lemmy.worldEnglish · 1 year agomessage-square26fedilink
minus-squareLvxferre@mander.xyzlinkfedilinkEnglisharrow-up1·edit-21 year agoYup, it’s the same approach as email spam traps. Except the naughty list, but… holy fuck a shareable bot IP list is an amazing addition, it would increase the damage to those web crawling businesses.
Yup, it’s the same approach as email spam traps. Except the naughty list, but… holy fuck a shareable bot IP list is an amazing addition, it would increase the damage to those web crawling businesses.