Thanks to a particularly annoying botnet, everyone’s favorite anime cat girl firewall is now helping protect piefed.ca & lemmy.ca from bots and scrapers.

This is requests per second and these are all thousands of scrapers on residential IPs hammering us:

They’d increase their usage until the site started struggling, then move on. I banned their user agents, but have no interest in a cat & mouse game. Anubis should hopefully keep things running much smoother for everyone.

Let me know if you have any trouble!

  • 9point6@lemmy.world
    link
    fedilink
    English
    arrow-up
    11
    ·
    4 days ago

    How come you’re looking for an alternative? Does it not do the job for you or something?

    • ikt@aussie.zone
      link
      fedilink
      English
      arrow-up
      9
      ·
      4 days ago

      tbh i would prefer something silent instead of a full screen block page while it figures out whether I’m a bot or not

      I don’t even like cloudflare click to confirm you’re not a bot pages which auto confirm

      • [object Object]@lemmy.ca
        link
        fedilink
        English
        arrow-up
        8
        ·
        edit-2
        4 days ago

        To my knowledge, which is often wrong, that’s necessary.

        It’s a proof of work system, so your browser has to receive the challenge work, create background workers to do it, then submit the results and get authenticated.

        If the work wasn’t challenging (slow), then it wouldn’t be any impediment to scrapers and bots.

        Whether there are alternatives to proof of work that work well, I do not know. But fingerprinting alone is actually very difficult.

      • 9point6@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        3 days ago

        FWIW I think cloudflare and similar do the full screen thing too, they just render a blank page though so it just feels like more load time.

        I don’t run Anubis on my stuff currently, but I’d be surprised if it doesn’t have a similar feature