empireOfLove to Privacy GuidesEnglish · 1 year agoOpenAI finally admitted they're crawling the web to profit off of GPT. Block it from your sites using robots.txt.platform.openai.comexternal-linkmessage-square56fedilinkarrow-up1400cross-posted to: technology@lemmy.mllemmy_ca_support@lemmy.catechnews@radiation.partyhackernews@derp.foo
arrow-up1400external-linkOpenAI finally admitted they're crawling the web to profit off of GPT. Block it from your sites using robots.txt.platform.openai.comempireOfLove to Privacy GuidesEnglish · 1 year agomessage-square56fedilinkcross-posted to: technology@lemmy.mllemmy_ca_support@lemmy.catechnews@radiation.partyhackernews@derp.foo
minus-squareSpectacle8011@lemmy.comfysnug.spacelinkfedilinkEnglisharrow-up3·1 year agoI’m surprised they’re not just using Common Crawl.
I’m surprised they’re not just using Common Crawl.