• lud@lemm.ee
    link
    fedilink
    arrow-up
    0
    ·
    5 months ago

    Indexing is what “scrapers” mostly do.

    That’s how search engines work. If you don’t allow any scraping don’t be surprised if you get no visitors.