For me it feels like breaking up with someone after many years. At the same time, I feel a bit dirty mentioning the name in the post title.
2 points
how exaclty does this pushshift work? I downloaded some zsts from it but what do I do with them?
2 points
The file you downloaded is a compressed JSON file, it’s not something you can really just look at. But it contains all the data needed to build a nice UI around.
I don’t know what OS you are on but on linux you can run zstd -d -c file.zst | jq . and it will print everything in the file. It’s not really readable though. Also it doesn’t have any of the media content, only the text
