>>1034522

Hmmm…. I wasn't thinking about doing an indented method of arranging things. Should I be?

And if I knew how to pass off some of the work to others, I'd do it. It's a LOT for one person to do. One of the reasons it's been taking so long is because I'm still adding to the database, etc. If I had left the entire database online, perhaps? But the clowns were shitting things up with some truly raunchy stuff, and I didn't want to republish that. Truth is, though, that I've done some preliminary with this already. It shouldn't take me long to finish the coding. But it will take a while to do the following:

-properly identify the bread and map posts on some 2300 threads (Yes, this matters.)

-identify the posts listed on the map posts

Even so, I've identified enough bread and maps already that some interesting stuff should begin floating to the surface. That's part of what is taking so long. The code is pointless without at least some of that done.

I'm eager to get to work on this. I lost an entire evening/night due to a power outage.

>>1040483

I think what I'm getting at is that it's difficult to share the work without putting the entire database back online again. If I do that, I may have to do the following:

-Buy dedicated hosting. If I do that, I'll be putting a donation button on the site for sure. So far, this has all been from my own time (a LOT of it) and resources.

-Including a "report this post" button. Like I said, I don't want to be republishing truly obnoxious unrelated stuff. But it's all on me right now, and I can only do so much by myself. I'd have to let the community help me control that content.

But you know, really, the way I'm doing things now has a good side to it. There's a lot of fluff in the complete database. The way I'm doing things now eliminates a lot of that. You're going to get the dense info rich posts this way.

The program can now save data for the contexting. Tomorrow (aka, after I wake up in the morning), I will be working on display.

>>1049462

The Research Tool can now display context the way I described above EXCEPT that I have not built in a show/hide button yet.

Right now, you have available to you SOME context that I calculated during my initial work putting together a contexting feature a couple months ago. I have more up through the date on the first image, but I have to get an export/import process built to get it into the online database. Since I have an export/import system for the posts, it shouldn't take much to make a modified version for the contexts.

My current task list is:

– Build the export/import process for the contexts.

– Get the contexts calculated for the 2300 or so more threads that I currently have. This could take several days.

– Then perhaps I'll look at getting that show/hide button in there. I might do it in the middle of working on getting the contexts calculated if I get bored of that.

– After that, including POTUS tweets is next.

http:// q-questions.info/research-tool.php

>>1059896

That's up to you and how you want to display your data. It might be cool to automate at least the downloading of new threads for what I'm doing. But to get the contexting right, I have to go through what comes in anyway. As mentioned before, not properly identifying bread and maps can overload the context chains.

Contexting functionality is complete. The export/import process to make calculated contexts is complete.

I asked Anons on the general thread whether it is more important to calculate the contexts or to include POTUS tweets. The ones who responded want the tweets, so that's next.

>>1088682

That would be great! A JSON source would speed that process along greatly.

I'm looking at the help page, but I don't understand how to actually make the call to your API. It looks like the call I would want to use is

GET api/timeline/{2}

but I don't see how to actually implement it.

>>1091190

I think I figured out what I need to do. I just need to add the path to the URL.

>>1090922

There are only 32 tweets in the JSON I got with api/timeline/2. There must have been more than that since October. Maybe I need a different call?

>>1091802

Do you recall any words that would have been in the post?

>>1092170

Try these. I was not able to find any PDF files posted recently about this.

>>208025

>>209411

>>211959

>>214550

>>674819

>>725107 (Unfortunately, I was not able to find the fullsize image of this one. Put a request on the general thread as well as Lost & Found if you really want it. Ask them to put it in the Lost & Found thread so you can find it if you look later.)

>>1003999

>>1092387

Looks like those got deleted. I'll make them available on the Research Tool for you.

http:// q-questions.info/research-tool.php

Look in a few hours. I have to run to an appointment right now.

>>1092973

I'm glad you found it. I'm beginning to think that I need to get the entire database back up there again, even if I have to not upload the images. We've had a couple of search requests like this for which I've had the data. In this case, the original posts had been removed, which would explain why he couldn't find it.

>>1093804

One of the posts I found would have led you there.

>>1093804

There is an awful lot of absolute garbage posts out there, to be sure. And now that there are over 1.5 million of them, there is no way one person can censure out the stuff that absolutely should not be republished. I don't like the idea of putting all of the unreviewed stuff up there without their images, either, since a lot of the intel is in those images. It's a tough call. Even though I do have a content warning on the research page, I have concerns about the legal side of just blindly posting some of those images. I most definitely couldn't do it without a reporting feature.

>>1092764

I was hoping for the complete set of Trump tweets since Q showed up in late October. Do any of your API calls provide that?

>>1096311

> trumptwitterarchive

Thank you for the suggestion. That was what I was looking for. I've got it done now.

>>1099779

>>1100463

I've pulled it into the same database that contains the chan posts. I don't want to make too many exceptions to how I do things. That makes it more difficult to keep track of what is for what.

>>1100463

Eventually, the cream of the project will be going into that WP site that's at the front of the URL. That will take care of appearances nicely.

>>1100681

And all of the text is back up there now. People won't have to request searches anymore.

>>1106873

>Archive OFFLINE immediately.

>Offline only.

>>1117592

I'm not sure what was meant by the recent Q post. Does that affect our work? And what is the scope of the request?

>>1119101

That was the reason I finally ended up putting it online as well. It seemed a shame to keep that functionality to myself. I reworked a few things to make it better in a multiuser environment. It ended up being better for myself as well.

>>1119154

I believe USBs are magnetic. CDs and DVDs are your best choices.

Don't mind me. I'm just trying to find some missing posts.

>>309741, >>309240, >>209205

Well, now I feel stupid. I just realized there's an "Expand all images" link in the lower right of the page header. Had I realized this, I would not have lost so many full size images. One save could have been done in thumbnail most, and another in full size mode, and I would have had everything on the page.

The ctrl-S method of saving a page will NOT automatically pick up the full size images when in thumbnail mode. If the page is expanded when the save is done, then you'll get the full size images (but not the thumnails, though this is a minor issue).

So here's my suggestion to get the best archiving:

You can save once or twice, but one of the saves should be in expanded most. If you want the thumbnail mode as well, then that's a separate save.

(All of the official archives so far have been in thumbnail mode.)

>>1171658

Not yet, apparently. It's a lot of files. It's going to take some time to upload them all, possibly a few days. Even my thumbnail image set takes a long time to upload.