• dan@lemm.ee
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    1 year ago

    The problem with scraping is that while it’s difficult/impossible to block completely, it’s pretty easy to keep making changes to your site to disrupt scrapers. The work required by the scraper to adapt to those changes is usually way more than the work you put in to disrupt them.

    So if a commercial site wants to make scraping unreliable and impractical, they almost certainly can.