AutoArchiveAnon here.

All threads are now archived using wayback machine automatically.

Atm that is triggered twice a day.

Lower 80% of the catalog is archived.

When a bread is updated after being archived, it will get archived again.

I'm now onto the MP4s.

I have looked through a few breads, and not that many mp4s get posted. Instead of trying to detect notable mp4s, how about I set it up to archive literally all .mp4s that have been posted?

That way mp4s will be preserved (unless wayback machine removes them), and other sites may even link to the archived mp4.

Can also someone please contact CodeMonkey?

I noticed that not all images are archived on wayback machine, same happens on archive.today.

On archive.today I see that tons of images are getting requested at the same time, and after some time it seems most pending requests are blocked. Maybe DDoS protection getting triggered?

Maybe a robots.txt specifying a crawl-delay could fix this.

>>9892862

I forgot to mention: JSON data is also archived as well.

>>9892903

I can set up automatic archiving on archive.today as well, still it can all be taken down.

archive.today doesn't archive mp4s, so I have to use wayback machine for that.

8kun seems to archive threads as well, but it throws away the images + MP4s, so these are all getting lost which is quite a shame.

For wearethene.ws it's also bad, because right now that site hosts the images, but not the MP4s (I can understand), so without archiving these movies are getting lost too and sometimes nuggets are getting posted.

Personally I would even like to archive youtube videos, but I can't host them on my own and even wayback machine doesn't archive most of the youtube videos either. I found a few that were actually archived, which is weird. 9/11 ones for example.

>>9893053

Cheese Pizza

>>9893203

What a Qincidence…

>>9893303

There ya go.