empireOfLove@lemmy.one to Privacy Guides@lemmy.oneEnglish · 1 year agoOpenAI finally admitted they're crawling the web to profit off of GPT. Block it from your sites using robots.txt.platform.openai.comexternal-linkmessage-square56fedilinkarrow-up1400arrow-down10cross-posted to: programming@zerobytes.monstertechnology@lemmy.mllemmy_ca_support@lemmy.cahackernews@lemmy.smeargle.fanstechnews@radiation.partyhackernews@derp.foo
arrow-up1400arrow-down1external-linkOpenAI finally admitted they're crawling the web to profit off of GPT. Block it from your sites using robots.txt.platform.openai.comempireOfLove@lemmy.one to Privacy Guides@lemmy.oneEnglish · 1 year agomessage-square56fedilinkcross-posted to: programming@zerobytes.monstertechnology@lemmy.mllemmy_ca_support@lemmy.cahackernews@lemmy.smeargle.fanstechnews@radiation.partyhackernews@derp.foo
minus-squareSpectacle8011@lemmy.comfysnug.spacelinkfedilinkEnglisharrow-up3·1 year agoI’m surprised they’re not just using Common Crawl.
I’m surprised they’re not just using Common Crawl.