I think it's pretty weird when the JSON data is fully missing, but the HTML is there.
Doesn't make sense to me.
And last time it wasn't 1 thread, it was around 6 or 7 threads.
Why can't CodeMonkey fix this?
Did anyone contact him over this?
That's really weird. I'm checking the catalog that I saved in an SQL table every day or so, and the Generals are all at 751 posts (based on JSON data), so this looks fine.
I have now even implemented code that internally marks Q posts as archived so that they don't get deleted when they fall off the catalog, all attachments of Q posts are also marked for archiving (this archives even pngs or jpegs) + I also mark posts that Q made but without tripcode in a special way and also mark them as archived. Works fine for now.
Still I got another issue that I stumbled over yesterday. Some videos, and just some are not actually archived on wayback machine. There is an URL when you ask wayback machine, but when you go there you are told that it wasn't archived. First I thought media.8kun was blacklisted, but today the latest archived videos work again. Wayback Machine seems to be quite broken.
I will now have to implement code that verifies that an archive actually exists.