Hi, I requested reddit for my data and I got 16Mb of CSVs… which is a considerable amount. Do anyone know of any tool to process / visualize / search … the data. I asume the format is the same for everyone, so maybe someone has already built something like that.

EDIT: the problem is not performance, with files <5Mb I can search with notepad++ in miliseconds. What I’m looking for is a user friendly interface (ideally with thumbnail images, links and such).

The problem with searching for “reddit export data visualizer” is that Google shows posts from reddit about visualization of generic data.

Thanks.

  • slazer2au
    link
    fedilink
    21 year ago

    Firstly, can you even open the Csvs? If you can then Power Bi Desktop by Microsoft is the emerging goto for data visualisation

    • @Crul@lemm.eeOP
      link
      fedilink
      5
      edit-2
      1 year ago

      Yes, no problem reading the CSVs, sorry if that wasn’t clear.

      I was looking for something more specific. Ideally something like a local web app that renders the posts, comments,… in a webpage with thumbnails and links to reddit elements.

      But that’s probably asking too much :).
      Thanks for the suggestion!

      • 𝒍𝒆𝒎𝒂𝒏𝒏
        link
        21 year ago

        If you find one, let me know pretty please…

        I found a UI for my Hangouts data a while back, occasionally skim through those old chats once in a while. It’s nice to have a tool that visualises data request files in a user friendly way

        • @Crul@lemm.eeOP
          link
          fedilink
          3
          edit-2
          1 year ago

          I’m searching on github different CSV filenames and I found a couple of projects that may be relevant:

          EDIT: This one also looks interesting:

          I’m still trying to figure out how to use them.

      • @Crul@lemm.eeOP
        link
        fedilink
        21 year ago

        The links you posted are weird:

        • https://pixeldrain.com/u/KfgV7bqn: It offers to download a file with the name Antimutt in r-Excel ultra.paq8o which I have no idea what is for.

        • https://the-eye.eu/redarcs: It says “This Reddit Community Has Been Archived”

        • @Antimutt@lemmy.world
          link
          fedilink
          11 year ago

          The first is the result when I extracted all lines with my nick in them from the csv, stored with the best compression around. The second is where to get the csv - and a lot of communities have been archived there, like it says.

          • @Crul@lemm.eeOP
            link
            fedilink
            21 year ago

            Just to confirm I understand: you are talking about Power Query VS Power Bi for dealing with huge datasets, right?

            Because, in my case, with 16Mb, I don’t see the need for anything specially powerful. My problem is not performace, but convenience.

            Thanks for the input.