Anonymous ID: 21906d April 1, 2023, 12:24 p.m. No.159978   🗄️.is 🔗kun   >>9979 >>9984

>>159976

TripleA here btw. :)

 

I can also switch my posting code to the new thread, but the threads should not have been deleted, it normally gets archived. On /qr/ it's kept

 

>>159977

No problem. I'm archiving images according to notable detection though, so I guess that is good.

Anonymous ID: 21906d April 1, 2023, 12:26 p.m. No.159979   🗄️.is 🔗kun   >>9981

>>159978

>>159977

just fyi, I just disabled notables posting for /mnr/

as I said attached files are archived on wayback machine depending on notable status. And I will keep that, unless you want that gone too.

Anonymous ID: 21906d April 1, 2023, 1:41 p.m. No.159981   🗄️.is 🔗kun   >>9987 >>0006

>>159979

Tom, one question. If I would create a new board for all sorts of notables, and post /mnr/ notables over there into a thread, would that be fine with you?

 

I even thought about re-posting notables as a whole. This would be useful, because that way normies wouldn't have to wade through countless of crap (not related to /mnr/ of course, but related to /qr/)

 

And that way it would also take ages for any of them to fall off the catalog too.

Anonymous ID: 21906d April 2, 2023, 8 a.m. No.160014   🗄️.is 🔗kun   >>0015

>>159984

>I don't know what they were for anon.

The archives on wayback?

Because the images get lost as soon as a thread falls off the catalog. The text data is archived on 8kun, but everything else is GONE.

 

That's why I archive all videos and certain other files on wayback.

 

>Qresear.ch

Also doesn't backup images, or videos. And their notable parser doesn't work properly on top of that.

 

A baker in 2020 actually asked around what to do about all the images and videos getting lost. I had the idea, and then implemented the whole system. In the end I even posted notables, which was only a little extra on top of the archiving.

 

I can't archive literally everything in full size, because wayback machine doesn't allow that many archives to be made.

Anonymous ID: 21906d April 2, 2023, 8:11 a.m. No.160015   🗄️.is 🔗kun   >>0016

>>160014

>I can't archive literally everything in full size, because wayback machine doesn't allow that many archives to be made.

Plus of course archiving all the spam and other garbage in full size would be a waste anyway.

 

Still that's the actual reason behind the notable parser. Without it, notable images would get lost. Now they aren't.

 

This also includes Q posts and posts that Q replied to. All the attached files are also archived. Sometimes someone does this manually, but not always. And I don't care who archives it in the end. I care that it is getting archived.

 

I even contacted ResignationAnon several times, he could for example link to wayback archives for the users, but it seems he doesn't care, or doesn't think that it would be a good idea. I also wanted to tell him the way I parse notables, which works wonderfully for me, but it seems he also doesn't care.And really the parser over there is missing out, which is a shame.And how they are presented is also not very good. Over here you got mouse over, and all videos are mentioned separately, so for these you don't even have to call up the post.

 

And right videos, bitchute videos are getting archived as well, whenever possible. In fact all videos are also indexed internally, so that one can figure out what it was, in case it gets censored/removed/flagged to be private.

Anonymous ID: 21906d April 2, 2023, 8:17 a.m. No.160016   🗄️.is 🔗kun   >>0017

>>160015

>Plus of course archiving all the spam and other garbage in full size would be a waste anyway.

Of course the full threads are still getting archived, so you can still see thumbnails of all the images that were posted.

 

I also archive the JSON data, and ResignationAnon saves that himself, but the data is not public. The wayback data is public. And he regrets not saving the originals from the start, so quite a bit of that data is gone for good. 8kun also doesn't preserve JSON data internally. When a thread is archived on here, JSON data is GONE. JSON contains all the data of the posts.

 

One can parse the HTML archive pages to get all the data, and I got a parser for that. I wanted to get all the older data at some point, but as far as I remember a bit of data is not available in the archived HTML data, so at least that's gone for good.

 

Regarding HTML archives onhere.

One could implement that the images are loaded from wayback. One could even write a simple JavaScript to change links accordingly, without Jim having to do anything. Or you can just load up the thread on wayback.

 

This has been done since around mid 2020. Sadly it took me a few months to get it all working, I even had to get myself a server that is able to handle it all for that job and had to write all that software from scratch.

Anonymous ID: 21906d April 2, 2023, 8:19 a.m. No.160017   🗄️.is 🔗kun   >>0018

>>160016

And on top of even that, whenever a thread gets deleted, typically by accident, Jim doesn't have backups, but I do.

 

I can send Jim or BO the JSON data to get the thread restored, which helped a lot a few times.

 

I don't just archive to wayback, I also archive to my own system locally.

Anonymous ID: 21906d April 2, 2023, 8:23 a.m. No.160018   🗄️.is 🔗kun   >>0019

>>160017

>I don't just archive to wayback, I also archive to my own system locally.

Enough babbling from me, but I in fact do "archive offline", as Q said. Just in case it could come useful.

 

I have all files attached to notable posts stored locally and also offline, not connected to the internet. Not even connected to power.