Andy Reid@lemmy.world to Technology@lemmy.worldEnglish · 9 months agoAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comexternal-linkmessage-square48fedilinkarrow-up1605arrow-down18
arrow-up1597arrow-down1external-linkAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comAndy Reid@lemmy.world to Technology@lemmy.worldEnglish · 9 months agomessage-square48fedilink
minus-squarertxn@lemmy.worldlinkfedilinkEnglisharrow-up47·edit-29 months agoI would be shocked if any big corpo actually gave a shit about it, AI or no AI. if exists("/robots.txt"): no it fucking doesn't
minus-squareDingoBilly@lemmy.worldlinkfedilinkEnglisharrow-up1·9 months agoYeah I always found it surprising that everyone just agreed to follow a text file on a website on how to act. It’s one of the worst thought out/significant issues with browsing still out there from the beginning pretty much.
I would be shocked if any big corpo actually gave a shit about it, AI or no AI.
if exists("/robots.txt"): no it fucking doesn'tYeah I always found it surprising that everyone just agreed to follow a text file on a website on how to act. It’s one of the worst thought out/significant issues with browsing still out there from the beginning pretty much.