Andy Reid to [email protected]English • 1 year agoAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comexternal-linkmessage-square195fedilinkarrow-up11.09Karrow-down115cross-posted to: [email protected]
arrow-up11.07Karrow-down1external-linkAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comAndy Reid to [email protected]English • 1 year agomessage-square195fedilinkcross-posted to: [email protected]
minus-square@[email protected]linkfedilinkEnglish17•1 year agoWhat social contract? When sites regularly have a robots.txt that says “only Google may crawl”, and are effectively helping enforce a monolopy, that’s not a social contract I’d ever agree to.
minus-square@[email protected]linkfedilinkEnglish17•1 year agoI had a one-eared rabbit. He was a monolopy.
minus-square@[email protected]linkfedilinkEnglish2•1 year agoOnly if its model is a Lopunny missing an ear
minus-square@[email protected]linkfedilinkEnglish1•1 year agoI was thinking of a short lil bunny wearing a top hat and monocle with one ear sticking out of the center of the top hat but that works too
minus-squareCosmic ClericlinkfedilinkEnglish5•1 year ago When sites regularly have a robots.txt that says “only Google may crawl” Is that actually true? If so, why would they do that?
What social contract? When sites regularly have a
robots.txtthat says “only Google may crawl”, and are effectively helping enforce a monolopy, that’s not a social contract I’d ever agree to.I had a one-eared rabbit. He was a monolopy.
Sounds like a Pal name lol
Only if its model is a Lopunny missing an ear
I was thinking of a short lil bunny wearing a top hat and monocle with one ear sticking out of the center of the top hat but that works too
Is that actually true?
If so, why would they do that?