Pierre-Yves Lapersonne@programming.dev to Open Source@lemmy.ml · 6 days agoHow GitHub monopoly is destroying the open source ecosystemploum.netexternal-linkmessage-square44fedilinkarrow-up1340 cross-posted to: programming@programming.devopensource@programming.devopensource@lemmit.online
arrow-up1340external-linkHow GitHub monopoly is destroying the open source ecosystemploum.netPierre-Yves Lapersonne@programming.dev to Open Source@lemmy.ml · 6 days agomessage-square44fedilink cross-posted to: programming@programming.devopensource@programming.devopensource@lemmit.online
minus-squareDave@lemmy.nzlinkfedilinkarrow-up2·6 days agoIf big tech are the issue, then try this robots.txt (yes on github…): https://github.com/ai-robots-txt/ai.robots.txt My issue is with the scrapers pretending to be something they aren’t. Tens of thousands of requests, spread over IPs, mostly from China and Singapore but increasingly from South America.
If big tech are the issue, then try this robots.txt (yes on github…): https://github.com/ai-robots-txt/ai.robots.txt
My issue is with the scrapers pretending to be something they aren’t. Tens of thousands of requests, spread over IPs, mostly from China and Singapore but increasingly from South America.