• yogurtwrong@lemmy.worldEnglish
    0·
    3 months ago

    I hate the fact that reddit has so much valuable data in it, like thousands of extremely niche subreddits and answers to your questions.

    I wish someone could just mirror it all

    • yogurtwrong@lemmy.worldEnglish
      1·
      3 months ago

      Actually, I found archiveteam’s reddit dump. I think we can re-host this on activitypub, as a form of read-only, easy to browse archive.

      The data is on archive.org is marked non-downloadable to limit traffic. I emailed archive.org requesting one of the 10GB pieces to experiment with. Fingers crossed

      • yogurtwrong@lemmy.worldEnglish
        1·
        3 months ago

        Hi Aesistril,

        Thanks for contacting us.

        If it is restricted it is not publicly available.

        Thanks for using archive.org

        Best, Internet Archive Team

        I heard that they gave links when you emailed them but nah